Remove 2005 Remove Data Storage Remove Hadoop Remove NoSQL
article thumbnail

Big Data Timeline- Series of Big Data Evolution

ProjectPro

The largest item on Claude Shannon’s list of items was the Library of Congress that measured 100 trillion bits of data. 1960 - Data warehousing became cheaper. 1996 - Digital data storage became cost effective than paper - according to R.J.T. Varian and Peter Lyman at UC Berkeley in computer storage terms.

article thumbnail

20 Best Open Source Big Data Projects to Contribute on GitHub

ProjectPro

DataFrames are used by Spark SQL to accommodate structured and semi-structured data. Apache Spark is also quite versatile, and it can run on a standalone cluster mode or Hadoop YARN , EC2, Mesos, Kubernetes, etc. Presto allows you to query data stored in Hive, Cassandra, relational databases, and even bespoke data storage.