Big Data File Formats, Explained
Parquet vs ORC vs AVRO vs JSON. Which one to choose and how to use them?
Published in
9 min readFeb 28, 2023
I’m a big fan of data warehouse (DWH) solutions with ELT-designed (Extract-Load-Transform) data pipelines. However, at some point, I faced the requirement to process raw event data in Cloud Storage and had to choose the file format for data files.