Towards Data Science

JANUARY 16, 2024

Business units required data relevant to their analysis. Result: Companies started to sell pre-configured data warehouses as products. The concept of `Data Marts` was introduced. Image by the author 2004 to 2010 — The elephant enters the room New wave of applications emerged — Social Media, Software observability, etc.

Data Warehouse 69

Data Warehouse Data Architecture Relational Database NoSQL 69

Zalando Engineering

FEBRUARY 28, 2018

The processes that run the computation and store data of your application are executors: Returns computed data to the driver. For Big Data processing, the most common form of data is key-value pairs. Spark enables us to project down such complex data types to key-value pairs as Pair RDD.

Data Analysis 40

Data Analysis Hadoop Datasets Scala 40

ProjectPro

JUNE 6, 2015

We know that data warehouse is very big and a very complicated tool to maintain and to meet Big Data problems. In BI we just consider structured data. We never imagined that we can also analyze some videos or logs or similar semi-structured data. We just focused on structured data on the databases.

Business Intelligence 40

Business Intelligence Big Data BI Hadoop 40

Knowledge Hut

DECEMBER 26, 2023

The job of a data engineer is to develop models using machine learning to scan, label and organize this unstructured data. This process helps convert the unstructured data into structured data, which can easily be collected and interpreted using analytical tools.

Data Engineering 98

Data Engineering Data Engineer Engineering Pipeline-centric 98