Remove Data Architecture Remove Data Programming Remove Metadata Remove SQL
article thumbnail

Keeping Your Data Warehouse In Order With DataForm

Data Engineering Podcast

Summary Managing a data warehouse can be challenging, especially when trying to maintain a common set of patterns. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo! and Facebook, scaling from mere terabytes to petabytes of analytic data. Visit Datacoral.com today to find out more.

article thumbnail

Build Maintainable And Testable Data Applications With Dagster

Data Engineering Podcast

In this episode he explains his motivation for creating a product for data management, how the programming model simplifies the work of building testable and maintainable pipelines, and his vision for the future of data programming. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

Building 100
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Data Scientist vs Data Engineer: Differences and Why You Need Both

AltexSoft

They set up resources required by the model, create pipelines to connect them with data, manage computer resources, and monitor and configure the model’s performance. Managing data and metadata. There are different ways how data can be stored: a data warehouse, numerous data lakes and data hubs , etc.

article thumbnail

Scaling Data Trust: How AutoTrader UK Migrated to a Decentralized Data Platform with Monte Carlo

Monte Carlo

“We want to empower Auto Trader and its customers to make data-informed decisions,” said Edward, “and democratize access to data through a self-serve platform.” Whether it’s custom SQL rules or dbt tests, you have to do that upfront configuration,” said Edward.

Data 40