Data Engineering Podcast

APRIL 24, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Missing data?

Data Warehouse 100

Data Warehouse Data Lake Data Pipeline BI 100

Data Engineering Podcast

JULY 3, 2022

She also discusses her views on the role of the data lakehouse as a building block for these architectures and the ongoing influence that it will have as the technology matures. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Tired of deploying bad data?

Architecture 100

Architecture Metadata MongoDB MySQL 100

Data Engineering Podcast

JUNE 12, 2022

In this episode she shares her thoughts and insights on how to be intentional about establishing your own data team. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Data Engineering Podcast

JUNE 5, 2022

In this episode Sean Falconer explains the idea of a data privacy vault and how this new architectural element can drastically reduce the potential for making a mistake with how you manage regulated or personally identifiable information. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Security 100

Data Security Metadata MongoDB Scala 100

Data Engineering Podcast

DECEMBER 21, 2020

If you are starting down the path of implementing a data governance strategy then this episode will provide a great overview of what is involved. If you hand a book to a new data engineer, what wisdom would you add to it? What is data governance? If you hand a book to a new data engineer, what wisdom would you add to it?

Data Governance 130

Data Governance Government Data Lake Banking 130

Data Engineering Podcast

JANUARY 4, 2021

Summary As more organizations are gaining experience with data management and incorporating analytics into their decision making, their next move is to adopt machine learning. Monte Carlo’s end-to-end Data Observability Platform monitors and alerts for data issues across your data warehouses, data lakes, ETL, and business intelligence.

Python 100

Python Machine Learning Data Lake Computer Science 100

Data Engineering Podcast

JANUARY 11, 2021

This is a fascinating conversation on the technical challenges involved, the opportunities that such as system provides, and the complexities inherent to building a successful business on open source. There are a number of different reasons and methods for versioning data, such as the work being done with Datomic, LakeFS, DVC, etc.

PostgreSQL 100

PostgreSQL Python Data Lake Computer Science 100

The Modern Data Company

JANUARY 31, 2023

We also had the opportunity to talk about DataOS and the new paradigm it presents to the world of data. Our founders — and, as a result, the entire company — think about data differently than everyone else. This post highlights exactly how our founders taught us to think differently about data and why it matters.

Retail 98

Retail Healthcare Data Architecture Data Pipeline 98

Striim

FEBRUARY 10, 2023

Macy’s migrated its on-premise inventory and order data to Google Cloud storage to reach its objectives. The company decided to move to the cloud based on the benefits of cost efficiency, flexibility, and improved data management. Help customers visualize their data using a business intelligence tool.

Data Analytics 52

Data Analytics Telecommunication Insurance Google Cloud 52

AltexSoft

MARCH 30, 2023

What is Databricks Databricks is an analytics platform with a unified set of tools for data engineering, data management , data science, and machine learning. It combines the best elements of a data warehouse, a centralized repository for structured data, and a data lake used to host large amounts of raw data.

Scala 64

Scala Data Lake BI Google Cloud 64

AltexSoft

OCTOBER 8, 2021

The bad news is, integrating data can become a tedious task, especially when done manually. Luckily, there are various data integration tools that support automation and provide a unified data view for more efficient data management. Data integration process. Here, we’ll be comparing such vendors as.

Data Integration 52

Data Integration Hadoop Data Warehouse Data Lake 52

Monte Carlo

FEBRUARY 6, 2023

How should your business intelligence improve as a result of this migration? Set your budget While you’ll likely save on a data warehouse migration to cloud tooling, the migration process will create costs of its own. This can either be built manually or through data pipeline services like Fivetran.

Data Warehouse 52

Data Warehouse AWS Data Validation Data 52

Monte Carlo

APRIL 20, 2023

Overwhelmed data engineers need to have the proper context of the blast radius to understand which incidents need to be addressed right away, and which incidents are a secondary priority. This is one of the most frequent data lineage use cases leveraged by Vox.

Data Warehouse 52

Data Warehouse BI Data Government 52

AltexSoft

SEPTEMBER 10, 2021

So, why does anyone need to integrate data in the first place? Today, companies want their business decisions to be driven by data. But here’s the thing — information required for business intelligence (BI) and analytics processes often lives in a breadth of databases and applications. Middleware data integration.

Data Integration 52

Data Integration Data Consolidation Data Warehouse BI 52