Data Engineering Weekly

MARCH 24, 2023

Why should we care about Data Creation Process? All Successful Data-Driven organizations have one thing in common; They have a high-quality & efficient data creation process. It could be either booking a taxi or ordering your lunch; everything is a workflow engine. Event Sourcing Change Data Capture [CDC] Outbox pattern 1.

Engineering 67

Engineering Data Transportation Database 67

ProjectPro

OCTOBER 20, 2021

With so many pseudo-data scientists cropping up due to numerous data science bootcamps and courses that offer theoretical learning, the interview questions for AI and machine learning jobs are getting streamlined to filter those who understand how real-world implementation works. The value of a company lies solely in the interview process.

Machine Learning 52

Machine Learning Algorithm Government Data Science 52

phData: Data Engineering

JANUARY 3, 2022

Roadmapping The Data Strategy Journey How Do Software Engineering Principles Solve This? Why Is This Challenging? Why is that? Your business likely has competitors that are trying to beat you to market, technology is constantly evolving, and so are your customers. Want to Save This eBook for Later? No problem!

IT 52

IT AWS Software Engineer Software Engineering 52

ProjectPro

MAY 31, 2021

This blog lists over 20 big data projects you can work on to showcase your big data skills and gain hands-on experience in big data tools and technologies. Kicking off a big data analytics project is always the most challenging part. The first crucial step to launching your project initiative is to have a solid project plan.

Big Data 52

Big Data Coding Project Hadoop 52

Confluent

FEBRUARY 27, 2019

With serverless being all the rage, it brings with it a tidal change of innovation. FaaS functions only solve the compute part, but where is data stored and managed, and how is it accessed? What is more, as the world adopts the event-driven streaming architecture, how does it fit with serverless? Event-first FaaS?

Kafka 109

Kafka AWS Architecture Cloud 109

Confluent

MAY 9, 2019

So far in this series, we have recognized that by going back to first principles, we have a new foundation to work with. Event-first thinking enables us to build a new atomic unit: the event. Everything is asynchronous; everything is stored; everything is partitioned; everything scales.

Kafka 92

Kafka Pipeline-centric Architecture Database-centric 92

Confluent

FEBRUARY 13, 2019

Part 1 of this series discussed why you need to embrace event-first thinking, while this article builds a rationale for different styles of event-driven architectures and compares and contrasts scaling, persistence and runtime models. Event-driven architecture. Being event first.

Architecture 89

Architecture Programming Kafka Database-centric 89