article thumbnail

Building and deploying MySQL Raft at Meta

Engineering at Meta

We’re rolling out MySQL Raft with the aim to eventually replace our current MySQL semisynchronous databases. The biggest win of MySQL Raft was simplification of the operation and making MySQL servers take care of promotions and membership. At Meta, we run one of the largest deployments of MySQL in the world.

MySQL 136
article thumbnail

Build Better Data Products By Creating Data, Not Consuming It

Data Engineering Podcast

In this episode Nick King discusses how you can be intentional about data creation in your applications and services to reduce the friction and errors involved in building data products and ML applications. What are the organizational patterns that are required to support effective workflows for building data generation capabilities?

Building 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Building Data Pipelines That Run From Source To Analysis And Activation With Hevo Data

Data Engineering Podcast

Building reliable data pipelines is a complex and costly undertaking with many layered requirements. In order to reduce the amount of time and effort required to build pipelines that power critical insights Manish Jethani co-founded Hevo Data. RudderStack helps you build a customer data platform on your warehouse or data lake.

article thumbnail

How to Implement CDC for MySQL and Postgres

Rockset

There are multiple change data capture methods available when using a MySQL or Postgres database. In this post, we’re going to dive deeper into the different ways you can implement CDC if you have either a MySQL and Postgres database and compare the approaches.

MySQL 52
article thumbnail

Comparing ClickHouse vs Rockset for Event and CDC Streams

Rockset

Event streams, such as clickstreams, IoT data and other time series data, are common sources of data into these apps. The broad adoption of Apache Kafka has helped make these event streams more accessible. In this post, we compare two options for real-time analytics on event and CDC streams: Rockset and ClickHouse.

MySQL 52
article thumbnail

Unlocking The Potential Of Streaming Data Applications Without The Operational Headache At Grainite

Data Engineering Podcast

The peril is that building a robust and scalable streaming architecture is always more complicated and error-prone than you think it's going to be. RudderStack Transformations lets you customize your event data in real-time with your own JavaScript or Python code. Don't miss out on their only event this year!

MySQL 130
article thumbnail

Powering Real-Time Analytics at Scale on MySQL and PostgreSQL

Rockset

Rockset replicates the data in real-time from your primary database, including both the initial full-copy data replication into Rockset and staying in sync by continuously reading your MySQL or PostgreSQL change streams.