Data Engineering Podcast

DECEMBER 22, 2019

In this episode Frank McSherry, chief scientist of Materialize, explains why it was created, what use cases it enables, and how it works to provide fast queries on continually updated data. We have partnered with organizations such as O’Reilly Media, Corinium Global Intelligence, ODSC, and Data Council.

SQL 100

SQL Building Engineering Java 100

Data Engineering Podcast

SEPTEMBER 7, 2020

This frequently requires cumbersome and time-consuming data integration. In this episode he explains how it is designed to allow for querying and combining data where it resides, the use cases that such an architecture unlocks, and the innovative ways that it is being employed at companies across the world.

Architecture 100

Architecture Data Architecture SQL Engineering 100

Data Engineering Podcast

OCTOBER 22, 2023

In this episode Ranjith Raghunath shares his thoughts on how to build a strategy for the development, delivery, and evolution of data products. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. With Materialize, you can! Rudderstack :

BI 162

BI SQL Machine Learning Programming Language 162

Data Engineering Podcast

OCTOBER 8, 2023

In this episode he shares his journey of data collection and analysis and the challenges of automating an intentionally manual industry. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. With Materialize, you can!

Insurance 162

Insurance BI SQL Machine Learning 162

Data Engineering Podcast

JULY 12, 2021

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management You listen to this show to learn about all of the latest tools, patterns, and practices that power data engineering projects across every domain. Can you start by giving your definition of the modern data stack?

Designing 100

Designing Data Warehouse Data Governance Consulting 100

Data Engineering Podcast

AUGUST 27, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.

Database 130

Database Building PostgreSQL BI 130

Data Engineering Podcast

AUGUST 20, 2023

In this episode Greg Werner explains how they are using generative AI as an assistive tool for creating educational material, as well as building a data driven experience for learners. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Education 130

Education BI SQL Database 130

Data Engineering Podcast

JULY 2, 2023

In this episode Razi Raziuddin shares how data engineering teams can support the machine learning workflow through the development and support of systems that empower data scientists and ML engineers to build and maintain their own features. What is feature engineering is and why/to whom it matters?

Machine Learning 130

Machine Learning Data Engineering Data Engineer Engineering 130

ProjectPro

FEBRUARY 16, 2023

At the heart of these data engineering skills lies SQL that helps data engineers manage and manipulate large amounts of data. Did you know SQL is the top skill listed in 73.4% of data engineer job postings on Indeed? Almost all major tech organizations use SQL. use SQL, compared to 61.7%

Data Engineering 52

Data Engineering Data Engineer SQL Engineering 52

Data Engineering Podcast

JULY 9, 2023

In this episode Maxime Beauchemin of Airflow and Superset fame shares his vision for the entity-centric data model and how you can incorporate it into your own warehouse design. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Database-centric 130

Database-centric Machine Learning SQL Data Engineering 130

Knowledge Hut

MARCH 28, 2024

Data Engineer Career: Overview Currently, with the enormous growth in the volume, variety, and veracity of data generated and the will of large firms to store and analyze their data, data management is a critical aspect of data science. That’s where data engineers are on the go.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Data Engineering Podcast

JUNE 19, 2022

In this episode Ryan explains how he and his team have designed their platform to bring everyone onto a level playing field and the benefits that it provides to the organization. Datafold built automated regression testing to help data and analytics engineers deal with data quality in their pull requests.

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Knowledge Hut

DECEMBER 26, 2023

Certain roles like Data Scientists require a good knowledge of coding compared to other roles. Data Science also requires applying Machine Learning algorithms, which is why some knowledge of programming languages like Python, SQL, R, Java, or C/C++ is also required.

Data Science 97

Data Science BI Business Intelligence Data Mining 97

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode she shares the story behind the project, the details of how it is implemented, and how you can use it for your own data projects. Datafold built automated regression testing to help data and analytics engineers deal with data quality in their pull requests. Can you describe what Zingg is and the story behind it?

MongoDB 130

MongoDB Scala MySQL Data Lake 130

Data Engineering Podcast

APRIL 14, 2024

In this episode Oren Eini, CEO and creator of RavenDB, explores the nuances of relational vs. non-relational engines, and the strategies for designing a non-relational database. Data lakes are notoriously complex. What are the factors that convince teams to use a NoSQL vs. SQL database? Your first 30 days are free!

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Data Engineering Podcast

MAY 22, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Machine Learning 130

Machine Learning Data Engineering Data Engineer Cloud 130

Data Engineering Podcast

DECEMBER 4, 2022

In this episode Arjun Narayan explains how the technical barriers to adopting real-time data in your analytics and applications have become surmountable by organizations of all sizes. Datafold built automated regression testing to help data and analytics engineers deal with data quality in their pull requests.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Knowledge Hut

APRIL 23, 2024

In the current digital era, data has become a crucial asset for businesses in all industries. Effective data management is essential for businesses to make informed decisions, enhance customer experiences, and acquire a competitive edge. Data accuracy, completeness, and consistency depend on efficient ETL operations.

Database 52

Database Management Relational Database SQL 52

Knowledge Hut

MAY 9, 2024

Highest Paying Data Science Job Titles Studies suggest the data scientists' employment rate will surge to 36% by 2031. While only 33% of job ads specifically demand a data science degree, the highly sought-after technical skills are SQL and Python. They manage data storage and the ETL process.

Data Science 52

Data Science Data Mining Data Architect Programming Language 52

Data Engineering Podcast

APRIL 19, 2020

Eventador is a managed platform designed to let you focus on using the data that you collect, without worrying about how to make it reliable. How has your experience at ObjectRocket influenced your approach to streaming SQL? What are the main use cases that you are seeing people use for streaming SQL?

Building 100

Building PostgreSQL MongoDB SQL 100

Knowledge Hut

JANUARY 18, 2024

This section will help you know the top 10 Data Scientist jobs for freshers. Machine Learning Engineers Machine learning engineers are technically skilled programmers whose job is to research, develop, and design self-running software for automating prediction models. Ensure collecting, storage, and analysis of data is accurate.

Data Science 98

Data Science Business Analyst ETL Method Data Architect 98

Data Engineering Podcast

NOVEMBER 13, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

MongoDB 100

MongoDB Scala Google Cloud MySQL 100

Data Engineering Podcast

DECEMBER 11, 2022

Summary One of the most critical aspects of software projects is managing its data. Managing the operational concerns for your database can be complex and expensive, especially if you need to scale to large volumes of data, high traffic, or geographically distributed usage. or any other destination you choose.

Database 100

Database MySQL Data Lake MongoDB 100

Data Engineering Podcast

JANUARY 7, 2022

This is a great exploration of what it means to treat your data platform as a living system and apply state of the art engineering to it. Prophecy provides an easy-to-use visual interface to design & deploy data pipelines on Apache Spark & Apache Airflow. No more scripts, just SQL. How does it work?

BI 100

BI Data Warehouse Metadata SQL 100

Data Engineering Podcast

AUGUST 27, 2021

Summary The reason that so much time and energy is spent on data integration is because of how our applications are designed. By making the software be the owner of the data that it generates, we have to go through the trouble of extracting the information to then be used elsewhere. No more scripts, just SQL.

Data Integration 100

Data Integration Architecture Data Warehouse Data Lake 100

Data Engineering Podcast

AUGUST 6, 2021

In this episode CTO Amaury Dumoulin shares his perspective on the complexity of letting everyone in the company find answers to their questions and how Castor is designed to help. The data you’re looking for is already in your data warehouse and BI tools. No more scripts, just SQL.

Database 100

Database SQL BI Business Intelligence 100

Data Engineering Podcast

DECEMBER 11, 2021

In this episode he explains how it can be used to build rich and useful profiles of your users, the system architecture that powers it, and some of the ways that it is being integrated into an organization’s broader data ecosystem. The data you’re looking for is already in your data warehouse and BI tools.

Data Warehouse 100

Data Warehouse Raw Data Data Lake BI 100

Data Engineering Podcast

OCTOBER 2, 2022

In this episode co-founder Martin Sahlen explains the impact that easy access to lineage information can have on the work of data engineers and analysts, and how he and his team have designed their platform to offer that information to engineers and stakeholders in the places that they interact with data.

IT 100

IT Food PostgreSQL MongoDB 100

Ascend.io

SEPTEMBER 5, 2023

In the fast-evolving landscape of cloud data solutions, Snowflake has consistently been at the forefront of innovation, offering enterprises sophisticated tools to optimize their data management. Customers can now process their native code inside Snowflake, essentially bringing the compute to the data.

IT 59

IT Scala Java Programming Language 59

Data Engineering Podcast

AUGUST 20, 2021

In this episode Vikrant Dubey discusses his work on the Cuelake project which allows data analysts to build a lakehouse with SQL queries. The data you’re looking for is already in your data warehouse and BI tools. No more scripts, just SQL. Get started for free at dataengineeringpodcast.com/hightouch.

Building 100

Building Data Lake Data Warehouse SQL 100

Knowledge Hut

MARCH 27, 2024

An ordered set of data kept in a computer system and typically managed by a database management system (DBMS) is called a database. Table modeling of the data in standard databases facilitates efficient searching and processing. SQL, or structured query language, is widely used for writing and querying data.

Database 52

Database Algorithm Relational Database PostgreSQL 52

Data Engineering Podcast

MARCH 2, 2020

Developers can work with the SQL constructs that they are familiar with while automatically getting the durability and reliability that Kafka offers. You listen to this show to learn and stay up to date with what’s happening in databases, streaming platforms, big data, and everything else you need to know about modern data management.

Kafka 100

Kafka Process PostgreSQL MySQL 100

Data Engineering Podcast

AUGUST 14, 2021

Summary The vast majority of data tools and platforms that you hear about are designed for working with structured, text-based data. What do you do when you need to manage unstructured information, or build a computer vision model? The data you’re looking for is already in your data warehouse and BI tools.

Unstructured Data 100

Unstructured Data Machine Learning Data Lake SQL 100

Data Engineering Podcast

DECEMBER 19, 2021

In this episode Pardhu Gunnam and Mars Lan explain how they have designed the architecture and user experience to allow everyone to collaborate on the data lifecycle and provide opportunities for automation and extensible workflows. The data you’re looking for is already in your data warehouse and BI tools.

Systems 100

Systems Building Metadata Data Warehouse 100

Data Engineering Podcast

DECEMBER 4, 2021

The whole process of hiring is an important organizational skill to cultivate and this is an interesting exploration of the specific challenges involved in finding data professionals. The data you’re looking for is already in your data warehouse and BI tools. No more scripts, just SQL.

Data Warehouse 100

Data Warehouse Data Lake BI Business Intelligence 100

Data Engineering Podcast

DECEMBER 4, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Business Intelligence 100

Business Intelligence Metadata BI MongoDB 100

Data Engineering Weekly

NOVEMBER 5, 2023

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Netflix: Streaming SQL in Data Mesh Learnings from our journey In hindsight, we wish we had invested in enabling Flink SQL on the DataMesh platform much earlier.

Data Engineering 52

Data Engineering Data Engineer Engineering SQL 52