Remove Data Pipeline Remove Hadoop Remove Lambda Architecture Remove MongoDB
article thumbnail

Handling Bursty Traffic in Real-Time Analytics Applications

Rockset

Database makers have experimented with different designs to scale for bursts of data traffic without sacrificing speed, features or cost. Lambda Architecture: Too Many Compromises A decade ago, a multitiered database architecture called Lambda began to emerge. One layer processes batches of historic data.

article thumbnail

Aggregator Leaf Tailer: An Alternative to Lambda Architecture for Real-Time Analytics

Rockset

That meant a system that was sufficiently nimble and powerful to execute fast SQL queries on raw data, essentially performing any needed transformations as part of the query step, and not as part of a complex data pipeline. The final output would be written to a serving system like Apache Cassandra, Elasticsearch or MongoDB.

article thumbnail

20+ Data Engineering Projects for Beginners with Source Code

ProjectPro

Data Sourcing: Building pipelines to source data from different company data warehouses is fundamental to the responsibilities of a data engineer. So, work on projects that guide you on how to build end-to-end ETL/ELT data pipelines. Also, explore other alternatives like Apache Hadoop and Spark RDD.