Data Engineering Podcast

SEPTEMBER 3, 2018

Using master data management to build a data catalog helps you answer these questions reliably and simplify the process of building your business intelligence reports. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

Data Management 100

Data Management Management Relational Database Business Intelligence 100

Snowflake

JANUARY 15, 2024

Leading companies around the world rely on Informatica data management solutions to manage and integrate data across various platforms from virtually any data source and on any cloud. Snowflake Native Apps help app providers deliver value to customers quickly, and Enterprise Data Integrator is no exception.

Data Integration 97

Data Integration BI Cloud Data 97

The Modern Data Company

FEBRUARY 2, 2024

Ever wondered why building data-driven applications feels like an uphill battle? It’s not just you – turning raw data into something meaningful can be a real challenge. In today’s fast-paced business environment, data-driven insights are the lifeblood of staying ahead.

Raw Data 75

Raw Data Utilities Government Data 75

The Modern Data Company

DECEMBER 29, 2022

And much of this involves finally harnessing data and new technologies to the fullest potential. Many of Deloitte’s Predictions Will Require Access to Real-time Data Analysis The report lists several areas where consumer demand will shift banking products. A robust understanding of potential new customers.

Banking 52

Banking Pipeline-centric Building Finance 52

Snowflake

NOVEMBER 1, 2023

Snowflake is announcing new product capabilities that are changing how developers build, deliver, distribute and operate their applications. These features collectively help developers build more quickly within a unified platform, distribute products globally, deliver them securely, and scale without operational burden. Let’s dive in!

AWS 99

AWS Programming Language Database Data Science 99

The Modern Data Company

JANUARY 22, 2024

The Modern Story: Navigating Complexity and Rethinking Data in The Business Landscape Enterprises face a data landscape marked by the proliferation of IoT-generated data, an influx of unstructured data, and a pervasive need for comprehensive data analytics.

Data Integration 98

Data Integration Metadata Government Unstructured Data 98

Snowflake

FEBRUARY 12, 2024

This vast amount of data is an important revenue stream and helps build value in 5G, bringing the ROI the industry has been waiting for. The session will also discuss challenges of data monetization such as privacy regulations, and legitimate data harvesting and storage.

Python 82

Python Manufacturing Cloud Government 82

The Modern Data Company

JANUARY 22, 2024

The Modern Story: Navigating Complexity and Rethinking Data in The Business Landscape Enterprises face a data landscape marked by the proliferation of IoT-generated data, an influx of unstructured data, and a pervasive need for comprehensive data analytics.

Data Integration 87

Data Integration Metadata Government Unstructured Data 87

Monte Carlo

MAY 31, 2023

A variety of factors can threaten the integrity of your data, from human error and ineffective training to a lack of security and liberal data access. A data integrity framework is a system of processes and technologies that work together to improve data quality, security, and compliance at scale.

Building 52

Building Data Validation Healthcare Data Integration 52

Data Engineering Podcast

DECEMBER 21, 2020

Summary Data governance is a term that encompasses a wide range of responsibilities, both technical and process oriented. One of the more complex aspects is that of access control to the data assets that an organization is responsible for managing. What is data governance? How is the Immuta platform architected?

Data Governance 130

Data Governance Government Data Lake Banking 130

The Modern Data Company

FEBRUARY 15, 2023

Maintaining a clear strategy for gathering, storing, and labeling data is challenging. Limited resources: Data management has always been resource intensive, but not all organizations can maintain a full data team. Without suitable resources for company-wide data management, it’s easier to fall behind.

Government 98

Government Data Governance Raw Data Data 98

The Modern Data Company

JANUARY 31, 2023

Another year, another chance to learn more about the world of data. In 2023, The Modern Data Company (Modern) hopes to reach more companies and organizations with our data operating system, build incredible value from existing and upcoming data assets, and share insights into major shifts in what it means to be data-driven.

Retail 98

Retail Healthcare Data Architecture Data Pipeline 98

Cloudera

DECEMBER 20, 2023

That’s why we’re building an ecosystem of technology providers to make it easier, more economical, and safer for our customers to maximize the value they get from AI. The data management platform, models, and end applications are powered by cloud infrastructure and/or specialized hardware.

Amazon Web Services 71

Amazon Web Services AWS Machine Learning Datasets 71

Data Engineering Podcast

JUNE 1, 2021

Summary Every part of the business relies on data, yet only a small team has the context and expertise to build and maintain workflows and data pipelines to transform, clean, and integrate it. RudderStack’s smart customer data pipeline is warehouse-first. What are the main goals that you have for Shipyard?

Data Pipeline 100

Data Pipeline Data Warehouse Data Workflow Data 100

Data Engineering Podcast

MAY 18, 2021

In order to eliminate the wasted effort of building custom integrations every time you want to combine lineage information across systems Julien Le Dem introduced the OpenLineage specification. RudderStack’s smart customer data pipeline is warehouse-first. What are your goals for the OpenLineage effort?

Metadata 100

Metadata Kafka Data Warehouse Hadoop 100

The Modern Data Company

APRIL 20, 2023

On the surface, it’s an operating system designed specifically for managing and processing large amounts of data. It typically provides a scalable and flexible infrastructure for storing, processing, and analyzing big data and should also include features that support data management, data protection, and data governance.

Systems 95

Systems Entertainment Government Big Data 95

The Modern Data Company

MARCH 1, 2024

Data Products work similarly, offering pre-packaged, actionable data units tailored to specific business goals. We will delve into the world of Data Products, exploring their transformative potential for CDOs and data teams. Data Products simplify access and processing, empowering faster decision-making.

Database-centric 40

Database-centric Data Lake Government Retail 40

Data Engineering Podcast

AUGUST 10, 2020

Summary Event based data is a rich source of information for analytics, unless none of the event structures are consistent. The team at Iteratively are building a platform to manage the end to end flow of collaboration around what events are needed, how to structure the attributes, and how they are captured.

Data Collection 100

Data Collection Data Engineering Data Engineer Education 100

Data Engineering Podcast

FEBRUARY 24, 2020

Summary Misaligned priorities across business units can lead to tensions that drive members of the organization to build data and analytics projects without the guidance or support of engineering or IT staff. The availability of cloud platforms and managed services makes this a viable option, but can lead to downstream challenges.

IT 100

IT Data Lake Data Pipeline Media 100

Data Engineering Podcast

AUGUST 24, 2020

In this episode Mars Lan and Pardhu Gunnam explain how they designed the platform, how it integrates into their data platforms, and how it is being used to power data discovery and analytics at LinkedIn. If you hand a book to a new data engineer, what wisdom would you add to it? Who is the target audience for DataHub?

Metadata 100

Metadata Management Kafka Data Engineering 100

Data Engineering Weekly

JULY 23, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles, so you can quickly ship actionable, enriched data to every downstream team. See how it works today.

Data Engineering 52

Data Engineering Data Engineer Engineering Deep Learning 52

Data Engineering Podcast

SEPTEMBER 28, 2020

Summary Kafka has become a de facto standard interface for building decoupled systems and working with streaming data. To make the benefits of the Kafka ecosystem more accessible and reduce the operational burden, Alexander Gallego and his team at Vectorized created the Red Panda engine.

Kafka 100

Kafka BI Big Data Data Engineering 100

Snowflake

AUGUST 21, 2023

Data-as-a-product: By considering data resources through a product lens, teams can adopt practices centered around quality and ease of use. Self-service data platforms: Consistent domain-agnostic access and security measures create a structure that is both clearly defined and repeatable across platforms/domains.

Pipeline-centric 52

Pipeline-centric Architecture Government Data Architect 52

Data Engineering Podcast

OCTOBER 9, 2018

This was a deep dive on how to build a successful company around a powerful platform, and how that platform simplifies operations for enterprise grade data management. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

PostgreSQL 100

PostgreSQL BI Data Warehouse Machine Learning 100

Workfall

JULY 25, 2023

It acts as an intermediary between your Google Spreadsheet and the applications you build, enabling you to interact with your Google Sheets data programmatically. With Sheety API, you can perform CRUD (Create, Read, Update, Delete) operations on the data in your Google Sheets using simple HTTP requests. Create a new file (.env

Python 76

Python Programming Language Coding Accessible 76

Data Engineering Podcast

SEPTEMBER 9, 2018

They also explain some of the types of data that you can use with Chaos Search, how to load it into S3, and when you might want to choose it over Amazon Athena for our serverless data analysis. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

IT 100

IT PostgreSQL Scala AWS 100

Data Engineering Podcast

JULY 1, 2019

It was an interesting conversation about how he stress tested the Instaclustr managed service for benchmarking an application that has real-world utility. By integrating each silo independently – data is able to integrate without any direct relation. At CluedIn they call it “eventual connectivity”.

Kafka 100

Kafka Finance Media Architecture 100

Data Engineering Podcast

JULY 14, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Machine Learning 100

Machine Learning Media Cloud Data 100

Data Engineering Podcast

SEPTEMBER 23, 2018

Summary As your data needs scale across an organization the need for a carefully considered approach to collection, storage, organization, and access becomes increasingly critical. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

Data Lake 100

Data Lake Data Warehouse Data Architecture Architecture 100

Precisely

MAY 31, 2023

According to research performed at Drexel University’s LeBow College of Business, 76% of data practitioners are trying to improve their data-driven decision-making, and more than half don’t feel that they can fully trust their data. The end result is that users can’t trust their data because it lacks integrity.

Data Integration 52

Data Integration Metadata Data Governance Data 52

Knowledge Hut

JANUARY 23, 2024

Installing and using MongoDB has become essential for web developers due to its growing popularity and the seamless manner in which it allows efficient data management. Step 8: In the "Ready to install MongoDB" page, click the "Install" button, give administrator access, and wait for the installation to finish.

MongoDB 52

MongoDB Database NoSQL Architecture 52

The Modern Data Company

JULY 31, 2023

How DataOS is Approaching Data Products DataOS, an integrated platform, streamlines and expedites data development cycles. Equipped with comprehensive tools, teams can easily build, manage, deploy, and iterate on data products while ensuring seamless compatibility with existing data infrastructure.

Government 98

Government Data Governance Architecture Data Pipeline 98

Monte Carlo

JUNE 14, 2022

This fanfare turned out to be justified as Slootman, co-founder Benoit Dageville, and Christian Kleinerman took the stage to reveal a series of announcements that promise to disrupt the data management landscape – and beyond. We’ve written previously about how building an external data product is hard. That story?

Cloud 52

Cloud Data Ingestion Government Python 52

Monte Carlo

MAY 25, 2023

Data consumers can easily access up-to-date information about the quality of data assets before they use them, streamlining collaboration across the organization while building trust in data. The pipeline might succeed, but we wouldn’t know if the data was right, wrong, or indifferent.

Metadata 52

Metadata Data Governance Government Business Intelligence 52

Data Engineering Podcast

JULY 8, 2019

It was interesting to learn about some of the custom data types and performance optimizations that are included. By integrating each silo independently – data is able to integrate without any direct relation. It was interesting to learn about some of the custom data types and performance optimizations that are included.

Data Warehouse 100

Data Warehouse MySQL Data Lake Hadoop 100

Monte Carlo

FEBRUARY 20, 2024

Choosing one tool over another isn’t just about the features it offers today; it’s a bet on the future of how data will flow within organizations. Consideration What to Look For Integration Capabilities Support for a diverse array of data sources and destinations, ensuring compatibility with your data ecosystem.

Data Ingestion 52

Data Ingestion Google Cloud Kafka AWS 52

Confluent

MAY 22, 2019

We’ll also provide demo code so you can try it out for yourself. The explosive number of devices generating, tracking and sharing data across a variety of networks is overwhelming to most data management solutions. Demo of Scylla and Confluent integration. IoT is a fast-growing market, already known to be over $1.2

Kafka 97

Kafka Google Cloud NoSQL Entertainment 97