Data Engineering Podcast

MAY 3, 2021

Summary The Data industry is changing rapidly, and one of the most active areas of growth is automation of data workflows. Taking cues from the DevOps movement of the past decade data professionals are orienting around the concept of DataOps. How does this differ from "business as usual" in the data industry?

Data Warehouse 100

Data Warehouse Data Pipeline BI Metadata 100

Data Engineering Podcast

AUGUST 5, 2019

Announcements Welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

PostgreSQL 100

PostgreSQL MongoDB Metadata Media 100

Knowledge Hut

SEPTEMBER 29, 2023

One of the pivotal responsibilities is managing data workflows and pipelines, a core aspect of a data engineer's role. To truly understand the importance of data engineers, we can explore the hierarchy of needs in data science.

Certification 52

Certification Data Engineering Data Engineer Engineering 52

Data Engineering Podcast

SEPTEMBER 17, 2023

Linked data technologies provide a means of tightly coupling metadata with raw information. In this episode Brian Platz explains how JSON-LD can be used as a shared representation of linked data for building semantic data products. What is the overlap between knowledge graphs and "linked data products"?

Building 189

Building BI SQL Python 189

Data Engineering Podcast

DECEMBER 18, 2022

In this episode Abe Gong brings his experiences with the Great Expectations project and community to discuss the technical and organizational considerations involved in implementing these constraints to your data workflows. Atlan is the metadata hub for your data ecosystem. Missing data? Stale dashboards?

Metadata 130

Metadata Business Intelligence Data Lake BI 130

Data Engineering Podcast

NOVEMBER 26, 2023

In this episode Tobias Macey shares his thoughts on the challenges that he is facing as he prepares to build the next set of architectural layers for his data platform to enable a larger audience to start accessing the data being managed by his team. Data lakes are notoriously complex.

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Databand.ai

AUGUST 30, 2023

DataOps , short for data operations, is an emerging discipline that focuses on improving the collaboration, integration, and automation of data processes across an organization. Enhanced Data Quality Data quality is a critical factor in the success of data analytics projects.

Data Cleanse 52

Data Cleanse Data Pipeline Data Ingestion Data Validation 52

Ascend.io

DECEMBER 11, 2023

Data orchestration is the process of efficiently coordinating the movement and processing of data across multiple, disparate systems and services within a company. So, why is data orchestration a big deal? It automates and optimizes data processes, reducing manual effort and the likelihood of errors.

Data Workflow 52

Data Workflow Data Pipeline Data Lake Data 52

Databand.ai

AUGUST 30, 2023

The goal of this strategy is to streamline the entire process of extracting insights from raw data by removing silos between teams and technologies. A unified DataOps strategy gives companies the ability to fully harness their valuable information assets, while ensuring compliance with data regulations like GDPR or CCPA.

Data Governance 40

Data Governance Data Cleanse Government Data Pipeline 40

AltexSoft

SEPTEMBER 21, 2023

The Elastic Stacks Elasticsearch is integral within analytics stacks, collaborating seamlessly with other tools developed by Elastic to manage the entire data workflow — from ingestion to visualization. Each document has unique metadata fields like index , type , and id that help identify its storage location and nature.

Engineering 52

Engineering NoSQL Programming Language Java 52

Data Engineering Podcast

SEPTEMBER 18, 2022

In this episode he discusses the challenge of maintaining shared visibility and understanding of data work across the various stakeholders and his efforts to make it a seamless experience. Atlan is the metadata hub for your data ecosystem. And don’t forget to thank them for their continued support of this show!

Building 100

Building Metadata MongoDB MySQL 100

Databand.ai

DECEMBER 29, 2022

He believes in making data do the work through proper data management based on strategic rationale and business alignment. On LinkedIn, he posts frequently about big data, master data, data science, data management, and data storytelling.

BI 52

BI Consulting Data Science Data Governance 52