Remove Data Analysis Tools Remove Database Remove Kafka Remove Lambda Architecture
article thumbnail

20+ Data Engineering Projects for Beginners with Source Code

ProjectPro

This architecture shows that simulated sensor data is ingested from MQTT to Kafka. The data in Kafka is analyzed with Spark Streaming API, and the data is stored in a column store called HBase. Finally, the data is published and visualized on a Java-based custom Dashboard. This is called Hot Path.