article thumbnail

Brief History of Data Engineering

Jesse Anderson

Doug Cutting took those papers and created Apache Hadoop in 2005. They were the first companies to commercialize open source big data technologies and pushed the marketing and commercialization of Hadoop. Hadoop was hard to program, and Apache Hive came along in 2010 to add SQL. They eventually merged in 2012.

article thumbnail

Data News — Week 23.10

Christophe Blefari

The MAD landscape The Machine learning, Artificial intelligence & Data (MAD) Landscape is a company index that has been initiated in 2012 by Matt Turck a Managing Director at First Mark. Evolution between 2012 and 2023. We jumped from 142 logos to 1414, the world changed but Pig remains.

Banking 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

How to get started with dbt

Christophe Blefari

dbt was born out of the analysis that more and more companies were switching from on-premise Hadoop data infrastructure to cloud data warehouses. First let's understand why dbt exists. This switch has been lead by modern data stack vision.

article thumbnail

Recap of Hadoop News for November

ProjectPro

News on Hadoop – November 2015 2nd Generation Hadoop has become the most critical cloud applications platform, Nov 2, 2015, TechRepublic.com Hadoop version of 1.0 Hadoop second generation is designed to support real time applications where Hadoop is used not just as a storage system but as an application platform.

Hadoop 52
article thumbnail

Recap of Hadoop News for April 2017

ProjectPro

News on Hadoop-April 2017 AI Will Eclipse Hadoop, Says Forrester, So Cloudera Files For IPO As A Machine Learning Platform. Apache Hadoop was one of the revolutionary technology in the big data space but now it is buried deep by Deep Learning. Forbes.com, April 3, 2017. Hortonworks HDP 2.6 SiliconAngle.com, April 5, 2017.

Hadoop 52
article thumbnail

Hadoop- The Next Big Thing in India

ProjectPro

Big Data Hadoop skills are most sought after as there is no open source framework that can deal with petabytes of data generated by organizations the way hadoop does. 2014 was the year people realized the capability of transforming big data to valuable information and the power of Hadoop in impeding it. million in 2012.

Hadoop 52
article thumbnail

Apache Hadoop turns 10: The Rise and Glory of Hadoop

ProjectPro

It is difficult to believe that the first Hadoop cluster was put into production at Yahoo, 10 years ago, on January 28 th , 2006. Ten years ago nobody was aware that an open source technology, like Apache Hadoop will fire a revolution in the world of big data. Happy Birthday Hadoop With more than 1.7

Hadoop 40