Data Engineering Podcast

MARCH 25, 2023

Summary The promise of streaming data is that it allows you to react to new information as it happens, rather than introducing latency by batching records together. The peril is that building a robust and scalable streaming architecture is always more complicated and error-prone than you think it's going to be. We feel your pain.

MySQL 130

MySQL Python Architecture Machine Learning 130

Data Engineering Podcast

DECEMBER 18, 2022

Summary The data ecosystem has seen a constant flurry of activity for the past several years, and it shows no signs of slowing down. In this episode Juan Sequeda and Tim Gasper from data.world share their views on the core principles that you can use to ground your work and avoid getting caught in the hype cycles.

Data Lake 100

Data Lake Data Warehouse Data Pipeline MongoDB 100

Tweag

MAY 24, 2023

In this final episode, I’ll cover testing strategies that can be learnt from functional programming and applied to your Python code. However, it would be remiss of us to snub languages that don’t enforce the same disciplines, but are nonetheless popular choices in industry. Ivory towers are lonely places, after all.

Python 105

Python Programming Language Programming Coding 105

Data Engineering Podcast

DECEMBER 25, 2022

In this episode he shares the work that he and his team have done to simplify integration of secure enclaves and trusted computing environments into analytical workflows and how you can start using it without re-engineering your existing systems. And don't forget to thank them for their continued support of this show!

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Netflix Tech

AUGUST 24, 2022

Working within the time budget introduces an extra resource constraint for the recommender system. The evaluation process may include trying to recognize the show from its box art, watching trailers, reading its synopsis or in some cases reading reviews for the show on some external website.

Algorithm 71

Algorithm Systems Datasets Architecture 71

Netflix Tech

DECEMBER 3, 2022

That article was a deep dive into one of the more technical aspects of Dataflow and didn’t properly introduce this tool in the first place. version Show the version and exit. --version Show the version and exit. help Show this message and exit. Options: --docker-image TEXT Url of the docker image to run in. --run-in-docker

Data Pipeline 143

Data Pipeline Scala Metadata Food 143