TCH AI SPR SCI NE Nevenka Lukic · Towards Data Engineering DuckDB: The Death Of Small-Scale Spark While everyone debates the future of distributed compute, a single binary is quietly replacing Spark clusters for most of the data…
TCH AI SCI NE Nevenka Lukic · Dev Genius Polars vs Pandas in Production Pipelines The tool that made Python data engineering accessible is quietly becoming the thing that slows it down.
TCH NE Nevenka Lukic · Towards Data Engineering Designing Idempotent Data Pipelines Article 4 in the single-engineer data stack series. Article 1 swapped Spark for DuckDB. Article 2 swapped Pandas for Polars. Article 3…
TCH NE Nevenka Lukic · Towards Data Engineering CDC Explained: Why Full Refresh ETL Is Dying This is the third article in a trilogy on the modern single-engineer data stack. The first covered DuckDB replacing small-scale Spark. The…
