Remove Data Architecture Remove Data Pipeline Remove Data Programming Remove Metadata
article thumbnail

Build Maintainable And Testable Data Applications With Dagster

Data Engineering Podcast

In this episode he explains his motivation for creating a product for data management, how the programming model simplifies the work of building testable and maintainable pipelines, and his vision for the future of data programming. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

Building 100
article thumbnail

Keeping Your Data Warehouse In Order With DataForm

Data Engineering Podcast

Dataform is a platform that helps you apply engineering principles to your data transformations and table definitions, including unit testing SQL scripts, defining repeatable pipelines, and adding metadata to your warehouse to improve your team’s communication. This week’s episode is also sponsored by Datacoral.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Data Scientist vs Data Engineer: Differences and Why You Need Both

AltexSoft

They’re integral specialists in data science projects and cooperate with data scientists by backing up their algorithms with solid data pipelines. Juxtaposing data scientist vs engineer tasks. One data scientist usually needs two or three data engineers. Managing data and metadata.

article thumbnail

Scaling Data Trust: How AutoTrader UK Migrated to a Decentralized Data Platform with Monte Carlo

Monte Carlo

“We want to empower Auto Trader and its customers to make data-informed decisions,” said Edward, “and democratize access to data through a self-serve platform.” are logging in and engaging with data in Looker every month, including complex, higher-profile data products such as financial reporting. Enter Monte Carlo.

Data 40