Remove Data Architecture Remove Data Management Remove Data Programming Remove Kafka
article thumbnail

Build Maintainable And Testable Data Applications With Dagster

Data Engineering Podcast

In this episode he explains his motivation for creating a product for data management, how the programming model simplifies the work of building testable and maintainable pipelines, and his vision for the future of data programming. If you are building dataflows then Dagster is definitely worth exploring.

Building 100
article thumbnail

Fast Analytics On Semi-Structured And Structured Data In The Cloud

Data Engineering Podcast

In this episode CEO Venkat Venkataramani and SVP of Product Shruti Bhat explain the origins of Rockset, how it is architected to allow for fast and flexible SQL analytics on your data, and how their serverless platform can save you the time and effort of implementing portions of your own infrastructure.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Automating Your Production Dataflows On Spark

Data Engineering Podcast

This is a great conversation to get an understanding of all of the incidental engineering that is necessary to make your data reliable. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo! and Facebook, scaling from terabytes to petabytes of analytic data. Closing Announcements Thank you for listening!

article thumbnail

Keeping Your Data Warehouse In Order With DataForm

Data Engineering Podcast

In this episode CTO and co-founder of Dataform Lewis Hemens joins the show to explain his motivation for creating the platform and company, how it works under the covers, and how you can start using it today to get your data warehouse under control. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

article thumbnail

Data Scientist vs Data Engineer: Differences and Why You Need Both

AltexSoft

ML models are designed by data scientists, but data engineers deploy those into production. They set up resources required by the model, create pipelines to connect them with data, manage computer resources, and monitor and configure the model’s performance. Managing data and metadata. Programming.