Start Data Engineering

MAY 9, 2020

Change data capture is a software design pattern used to capture changes to data and take corresponding action based on that change. The change to data is usually one of read, update or delete. The corresponding action usually is supposed to occur in another system in response to the change that was made in the source system.

Kafka 246

Kafka Data Designing Systems 246

Team Data Science

MAY 10, 2020

With careful consideration and learning about your market, the choices you need to make become narrower and more clear. I can now begin drafting my data ingestion/ streaming pipeline without being overwhelmed. For A Quick Recap You can find the first blog post here, where I learned which tech is most in demand in Toronto: [link] And the second blog post is here where I learn which Toronto industries need data engineers the most: [link] The Pipeline Proposal I'll be creating several pipelines in

Data Pipeline 130

Data Pipeline Data Ingestion AWS Kafka 130

Confluent

MAY 15, 2020

Currently, Apache Kafka® uses Apache ZooKeeper™ to store its metadata. Data such as the location of partitions and the configuration of topics are stored outside of Kafka itself, in a […].

Kafka 145

Kafka Metadata IT Project 145

Data Engineering Podcast

MAY 11, 2020

Summary There have been several generations of platforms for managing streaming data, each with their own strengths and weaknesses, and different areas of focus. Pulsar is one of the recent entrants which has quickly gained adoption and an impressive set of capabilities. In this episode Sijie Guo discusses his motivations for spending so much of his time and energy on contributing to the project and growing the community.

Lambda Architecture 100

Lambda Architecture Cloud Kafka Hadoop 100

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Teradata

MAY 13, 2020

The COVID-19 pandemic has brought with it a Perfect Storm of disruption that impacts all of us -- from our health to the economy to the supply chain. Read more.

IT 105

IT 105

Preset

MAY 10, 2020

Setting up Apache Superset for the first time can be difficult. Here's an easy way to accomplish the task!

40

40

Confluent

MAY 11, 2020

Everyone wants their infrastructure to be highly available, and ksqlDB is no different. But crucial properties like high availability don’t come without a thoughtful, rigorous design. We thought hard about […].

Kafka 111

Kafka Designing Process 111

Confluent

MAY 13, 2020

We’re pleased to announce the release of ksqlDB 0.9.0! This version includes support for multi-join statements, enhanced LIKE expressions, and a host of usability improvements. We’ll go through a few […].

Process 94

Process 94

Teradata

MAY 11, 2020

Learn how advanced analytics are being used in China amidst the COVID-19 pandemic to help combat the spread of coronavirus now and in the future.

59

59

Teradata

MAY 12, 2020

Teradata's top-ranked analytic software capabilities that market-leading companies have been using for years is available right now on Amazon Web Services (AWS). Learn more.

AWS 52

AWS Amazon Web Services Data 52

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Certification