Brief History of Data Engineering
Jesse Anderson
DECEMBER 12, 2022
They were the first companies to commercialize open source big data technologies and pushed the marketing and commercialization of Hadoop. With an immutable file system like HDFS, we needed scalable databases to read and write data randomly. Apache Spark came in 2009 and gave a unified batch and streaming engine.
Let's personalize your content