Data Engineering Podcast

OCTOBER 15, 2023

Summary Building streaming applications has gotten substantially easier over the past several years. Despite this, it is still operationally challenging to deploy and maintain your own stream processing infrastructure. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products.

Process 182

Process Building SQL BI 182

Data Engineering Podcast

MARCH 15, 2021

Summary The team at DoorDash has a complex set of optimization challenges to deal with using data that they collect from a multi-sided marketplace. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows.

Management 100

Management Data Warehouse PostgreSQL Kafka 100

Data Engineering Weekly

JANUARY 22, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. Sign up free to test out the tool today. So far, we have published. The response humbles me.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Pipeline 52

AltexSoft

JULY 18, 2023

Spark Streaming enhances the core engine of Apache Spark by providing near-real-time processing capabilities, which are essential for developing streaming analytics applications. To some, the word Apache may bring images of Native American tribes celebrated for their tenacity and adaptability. For this, we have a short, engaging video.

Big Data 52

Big Data Data Process Process Hadoop 52

Rockset

DECEMBER 9, 2021

Companies that undertook big data projects ran head-long into the high cost, rigidity and complexity of managing complex on-premises data stacks. Long gone are the days when employees would use old school ERP systems to reorder supplies. Lifting-and-shifting their big data environment into the cloud only made things more complex.

Transportation 52

Transportation BI SQL Data Warehouse 52

Monte Carlo

AUGUST 19, 2023

By integrating tools from a variety of vendors, a data platform enables a data engineering team to not only manage an organization’s data but also activate it for a domain’s use cases. From data sources and use cases to industry and company size, how a company structures its data platform will depend on a variety of critical factors.

Building 52

Building BI Data Lake Data Governance 52