Brief History of Data Engineering
Jesse Anderson
DECEMBER 12, 2022
Hadoop was hard to program, and Apache Hive came along in 2010 to add SQL. Apache Spark came in 2009 and gave a unified batch and streaming engine. Apache Flink came in 2011 and gave us our first real streaming engine. It is prominently data engineering and all of the technical debt difficulties that come with data.
Let's personalize your content