article thumbnail

Brief History of Data Engineering

Jesse Anderson

Doug Cutting took those papers and created Apache Hadoop in 2005. Cloudera was started in 2008, and HortonWorks started in 2011. They were the first companies to commercialize open source big data technologies and pushed the marketing and commercialization of Hadoop. It gained in usage and eventually displaced Hadoop.

article thumbnail

Data Engineers of Netflix?—?Interview with Kevin Wylie

Netflix Tech

His favorite TV shows: Ozark, Breaking Bad, Black Mirror, Barry, and Chernobyl Since I joined Netflix back in 2011, my favorite project has been designing and building the first version of our entertainment knowledge graph. When I joined Netflix back in 2011, our content analytics team was just 3 people.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Avec Snowflake, Peaksys concilie pour Cdiscount une data platform unique et le cloisonnement des données entre toutes les filiales 

Snowflake

Cdiscount : du commerce en ligne aux services orientés B2B Figure historique du commerce en ligne français, créée en 1998 et marketplace depuis 2011, Cdiscount s’appuie aujourd’hui sur ses savoir-faire pour compléter sa stratégie avec des offres B2B : services de logistique, déploiement de marketplace et même cybersécurité.

Hadoop 52
article thumbnail

The Rise of the Data Engineer

Maxime Beauchemin

I joined Facebook in 2011 as a business intelligence engineer. This discipline also integrates specialization around the operation of so called “big data” distributed systems, along with concepts around the extended Hadoop ecosystem, stream processing, and in computation at scale. By the time I left in 2013, I was a data engineer.

article thumbnail

5 Big Data Use Cases- How Companies Use Big Data

ProjectPro

Let’s take a look at how Amazon uses Big Data- Amazon has approximately 1 million hadoop clusters to support their risk management, affiliate network, website updates, machine learning systems and more. Amazon launched a promotional offer in 2011 – “Amazon pays shoppers $5 if they walk out of the store without any purchases.”

article thumbnail

Hottest IT Certifications of 2015- NoSQL Databases (MongoDB Certification)

ProjectPro

A recent survey conducted by Dice estimates that salaries for employees who use Hadoop and NoSQL are more than $100,000.This According to a recent survey conducted by CompTIA on IT certifications- 66% of organizations consider IT certifications as highly valuable- a significant increase from 30% in 2011.

NoSQL 40
article thumbnail

Getting to Know Hadoop 3.0 -Features and Enhancements

ProjectPro

Hadoop was first made publicly available as an open source in 2011, since then it has undergone major changes in three different versions. Apache Hadoop 3 is round the corner with members of the Hadoop community at Apache Software Foundation still testing it. The major release of Hadoop 3.x x vs. Hadoop 3.x

Hadoop 52