← Back to list

Compare columnar storage (Parquet/ORC) vs row storage (Avro/CSV) in analytics-heavy workloads.

Data Layout

NS Academy · 2025-09-22 08:55 · 0 claps · 1.1 min read
#data-science #columnar-storage #analytics
Open on Medium ↗
Wiki topics: RAG · RAG & Retrieval ML · Machine Learning GRW · Growth & Analytics 🔬 · Science · General 🎮 · Gaming

Compare columnar storage (Parquet/ORC) vs row storage (Avro/CSV) in analytics-heavy workloads.

Data Layout

**Columnar formats like Parquet and ORC store data column by column, while row-based formats like Avro and CSV store data row by row**. This means that in columnar storage, reading a few columns requires accessing only those columns on disk, reducing I/O. In row-based storage, even if you need only one column, the entire row must be read, which increases disk usage and slows queries.

Query Performance

Columnar formats excel at analytical queries such as aggregations, filters, and scans because they allow **predicate pushdown** and only read the required columns. Row-based formats are slower for these workloads because the system has to read entire rows. Joins and aggregations are faster in columnar storage, especially for wide tables.

Write and Update Patterns

Row-based formats handle small inserts and updates efficiently because each row is self-contained. Columnar formats are optimized for batch writes and append-only operations, making them less suitable for frequent row-level updates. Updating or deleting data in columnar files often requires rewriting the files.

Storage Efficiency

Columnar formats generally achieve **higher compression because data in each column is of the same type and often has repeating patterns. Row-based formats have [lower compression](https://www.n-school.com/data-science-course-in-coimbatore/)** efficiency, leading to larger file sizes. Schema evolution is well-supported in Parquet, ORC, and Avro, but CSV lacks formal schema support.

Integration with Analytics Tools

Columnar formats are highly optimized for big data and analytics platforms like Spark, Hive, Presto, and Redshift Spectrum. They also improve performance for dashboards and BI tools. Row-based formats are universally supported but do not provide the same level of query performance for **analytical workloads.**


메타데이터
post_id
0e76bcd5ec18
slug
compare-columnar-storage-parquet-orc-vs-row-storage-avro-csv-in-analytics-heavy-workloads-0e76bcd5ec18
url
https://medium.com/@sharetonschool/compare-columnar-storage-parquet-orc-vs-row-storage-avro-csv-in-analytics-heavy-workloads-0e76bcd5ec18
canonical_url
https://medium.com/@sharetonschool/compare-columnar-storage-parquet-orc-vs-row-storage-avro-csv-in-analytics-heavy-workloads-0e76bcd5ec18
author_url
https://medium.com/@sharetonschool
status
ok
fetched_at
2026-07-23 19:20:31