Data Engineering Podcast

APRIL 24, 2022

WhyLogs is a powerful library for flexibly instrumenting all of your data systems to understand the entire lifecycle of your data from source to productionized model. You have full control over your data and their plugin system lets you integrate with all of your other data tools, including data warehouses and SaaS platforms.

Machine Learning 100

Machine Learning Systems Data Lake Metadata 100

Data Engineering Podcast

DECEMBER 19, 2021

In this episode Pardhu Gunnam and Mars Lan explain how they have designed the architecture and user experience to allow everyone to collaborate on the data lifecycle and provide opportunities for automation and extensible workflows. Supercharge your business teams with customer data using Hightouch for Reverse ETL today.

Systems 100

Systems Building Metadata Data Warehouse 100

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. What factors are most important when building a data management ecosystem?

Data Management 52

Data Management Management Data Lake Data Warehouse 52

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. What factors are most important when building a data management ecosystem?

Data Management 52

Data Management Management Data Lake Data Warehouse 52

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. What factors are most important when building a data management ecosystem?

Data Management 52

Data Management Data Lake Management Data Warehouse 52

Data Engineering Podcast

JULY 27, 2020

Summary A majority of the scalable data processing platforms that we rely on are built as distributed systems. Kyle Kingsbury created the Jepsen framework for testing the guarantees of distributed data processing systems and identifying when and why they break. Can you start by describing what the Jepsen project is?

Systems 100

Systems Building Scala Java 100

Data Engineering Podcast

JANUARY 21, 2019

They discuss the challenges of being at global scale from the start, hiring and training talented engineers, prototyping and deploying new systems in the cloud, and what they have learned in the process. This is a useful conversation for engineers, managers, and leadership who are interested in building enterprise big data systems.

Big Data 100

Big Data Systems Building Hadoop 100

Data Engineering Podcast

SEPTEMBER 11, 2022

Summary Data engineering systems are complex and interconnected with myriad and often opaque chains of dependencies. As they scale, the problems of visibility and dependency management can increase at an exponential rate. Interview Introduction How did you get involved in the area of data management?

Systems 100

Systems Metadata Building MongoDB 100

Data Engineering Podcast

JULY 20, 2020

Summary Wind energy is an important component of an ecologically friendly power system, but there are a number of variables that can affect the overall efficiency of the turbines. Michael Tegtmeier founded Turbit Systems to help operators of wind farms identify and correct problems that contribute to suboptimal power outputs.

Systems 100

Systems Manufacturing Machine Learning Algorithm 100

Data Engineering Podcast

MAY 6, 2019

Summary The database market continues to expand, offering systems that are suited to virtually every use case. In this episode Ryan Worl explains how it is architected, how to use it for your applications, and provides examples of system design patterns that can be built on top of it. Can you describe how FoundationDB is architected?

Systems 100

Systems MongoDB NoSQL Database 100

ArcGIS

OCTOBER 17, 2023

This article covers what is coming and how you should prepare your data. The new U.S. datums of 2022 will soon be released.

Systems 141

Systems Data Data Management Government 141

Data Engineering Podcast

JULY 5, 2021

Deploying, managing, and scaling that orchestration can consume a large fraction of a data team’s energy so it is important to pick something that provides the power and flexibility that you need. This is a fascinating platform with an endless set of use cases and a great team of people behind it.

Systems 100

Systems Management Data Warehouse Programming Language 100

Ascend.io

AUGUST 15, 2023

This same principle holds true in data management. It’s no surprise, then, that the quest for Fivetran alternatives is on the rise as organizations set their sights on a more holistic data approach. Defense: Saving Money with Intelligent Data Refresh In football, a solid defense does more than just stop goals.

Data Management 52

Data Management Management Data Ingestion Data Pipeline 52

Data Engineering Podcast

SEPTEMBER 3, 2018

Summary With the proliferation of data sources to give a more comprehensive view of the information critical to your business it is even more important to have a canonical view of the entities that you care about. Can you start by establishing a definition of data mastering that we can work from?

Data Management 100

Data Management Management Relational Database Business Intelligence 100

ArcGIS

MARCH 9, 2023

Learn about differences between subnetwork system diagrams and standard diagrams to decide whether system diagrams are relevant for you

Systems 64

Systems Utilities Telecommunication Data Management 64

InData Labs

DECEMBER 9, 2021

In today’s digitized medical landscape, effective treatment and better outcomes for patients depend on the smart use of medical data. Healthcare data management treats data as a powerful asset and improves health services. The rise of EHR/EMR systems also promotes more effective handling of patient data.

Healthcare 52

Healthcare Data Management Medical IT 52

ProjectPro

FEBRUARY 16, 2023

With so much riding on the efficiency of ETL processes for data engineering teams, it is essential to take a deep dive into the complex world of ETL on AWS to take your data management to the next level. AWS refers to Amazon Web Service, the most widely used cloud computing system.

AWS 52

AWS Data Management ETL Tools Management 52

Cloudera

FEBRUARY 4, 2021

I am pleased to announce that Cloudera was just named the Risk Data Repository and Data Management Product of the Year in the Risk Markets Technology Awards 2021. . Supporting the industry’s risk data depository and data management needs. End-to-end Data Lifecycle.

Technology 88

Technology Data Management Management Insurance 88

Rockset

MARCH 21, 2019

When we started Rockset, we envisioned building a powerful cloud data management system that was really easy to use. Making the data stack simpler is fundamental to making data usable by developers and data scientists. The data management should feel limitless.

SQL 52

SQL Data Management Management Engineering 52

Cloudera

APRIL 25, 2019

As well as managing the UK’s currency, supply of money and interest rates, the institute has a diverse range of responsibilities including gathering and analyzing data from banks, building societies, credit unions, insurers and mortgage companies to inform policy decisions and guide UK government departments and international organizations.

Data Management 59

Data Management Banking Management Insurance 59

Data Engineering Podcast

DECEMBER 3, 2023

Summary The first step of data pipelines is to move the data to a place where you can process and prepare it for its eventual purpose. Data transfer systems are a critical component of data enablement, and building them to support large volumes of information is a complex endeavor.

Systems 130

Systems Designing Data Lake SQL 130

Data Engineering Podcast

OCTOBER 15, 2023

Decodable was built with a mission of eliminating all of the painful aspects of developing and deploying stream processing systems for engineering teams. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Process 182

Process Building SQL BI 182

Snowflake

APRIL 8, 2024

BigGeo BigGeo accelerates geospatial data processing by optimizing performance and eliminating challenges typically associated with big data. Implentio Implentio is a centralized tool that helps ecommerce ops and finance teams efficiently and cost-effectively manage fulfillment and logistics spending.

Pipeline-centric 122

Pipeline-centric Food Healthcare Unstructured Data 122

Data Engineering Podcast

SEPTEMBER 3, 2023

The dlt project was created to eliminate overhead and bring data integration into your full control as a library component of your overall data system. In this episode Adrian Brudaru explains how it works, the benefits that it provides over other data integration solutions, and how you can start building pipelines today.

Data Integration 162

Data Integration BI SQL Python 162

Data Engineering Podcast

FEBRUARY 26, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Are you tired of dealing with the headache that is the 'Modern Data Stack'? It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. We feel your pain.

Building 147

Building Metadata Machine Learning Data Integration 147

Data Engineering Podcast

AUGUST 27, 2023

Summary Data persistence is one of the most challenging aspects of computer systems. In the era of the cloud most developers rely on hosted services to manage their databases, but what if you are a cloud service? What are the different methods that you have used for managing database instances? Why Postgres?

Database 130

Database Building PostgreSQL BI 130

Data Engineering Podcast

JULY 2, 2023

In this episode Razi Raziuddin shares how data engineering teams can support the machine learning workflow through the development and support of systems that empower data scientists and ML engineers to build and maintain their own features. What is feature engineering is and why/to whom it matters?

Machine Learning 130

Machine Learning Data Engineering Data Engineer Engineering 130

Knowledge Hut

APRIL 23, 2024

For example, in 1880, the US Census Bureau needed to handle the 1880 Census data. They realized that compiling this data and converting it into information would take over 10 years without an efficient system. Thus, it is no wonder that the origin of big data is a topic many big data professionals like to explore.

Big Data 52

Big Data Amazon Web Services Media Cloud Computing 52

Data Engineering Podcast

JULY 16, 2023

In his recent book "Datapreneurs" he reflects on the people and businesses that he has known and worked with and how they relied on data to deliver valuable services and drive meaningful change. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

SQL 130

SQL Machine Learning Python Data 130

Knowledge Hut

JANUARY 18, 2024

The opportunities are endless in this field — you can get a job as an operation analyst, quantitative analyst, IT systems analyst, healthcare data analyst, data analyst consultant, and many more. A Python with Data Science course is a great career investment and will pay off great rewards in the future. Choose data sets.

Data Science 98

Data Science Business Analyst ETL Method Data Architect 98

Edureka

MAY 6, 2024

MLOps is an emerging discipline that aims to unify and streamline the machine learning system development (Dev) and operations (Ops) lifecycle. MLOps refers to the practice and discipline within machine learning that aims to unify and streamline machine learning system development (Dev) and operations (Ops).

Machine Learning 52

Machine Learning Metadata Programming Language Healthcare 52

Knowledge Hut

DECEMBER 26, 2023

Cybersecurity is defending sensitive data and important systems from online threats. To safeguard your data and systems, it's crucial to have a collection of cybersecurity tools and techniques at your disposal. Usually, the management regulates who has access to data, networks, and computer systems.

Hospitality 98

Hospitality Finance Electronics Retail 98

Hevo

MARCH 28, 2024

NetSuite is a cloud-based data management tool, while SQL Server is a high-powered relational database management system. If you are trying to optimize your data management procedures by integrating data from NetSuite to SQL Server, you are in the right place.

SQL 52

SQL Relational Database Data Database 52

DataKitchen

MAY 10, 2024

Data observability here includes conducting regression tests and assessing the impact of these changes. This ensures that any new integration or code alteration does not adversely affect the existing systems, thus safeguarding the overall system integrity.

Data Ingestion 58

Data Ingestion Datasets Data Coding 58

DataKitchen

MAY 10, 2024

The Five Use Cases in Data Observability: Effective Data Anomaly Monitoring (#2) Introduction Ensuring the accuracy and timeliness of data ingestion is a cornerstone for maintaining the integrity of data systems. This comprehensive approach allows data teams to: Quickly find and rectify problematic data.

Data Ingestion 40

Data Ingestion Transportation High Quality Data Data Schemas 40

Databand.ai

AUGUST 30, 2023

Data Consistency vs Data Integrity: Similarities and Differences Joseph Arnold August 30, 2023 What Is Data Consistency? Data consistency refers to the state of data in which all copies or instances are the same across all systems and databases.

Data Integration 52

Data Integration Data Cleanse Data Validation High Quality Data 52

Cloudera

FEBRUARY 7, 2024

How enterprise-grade data management creates better and more efficient care. Medical and care professionals get faster and more complete information on the patient’s needs while medical systems and health insurers can analyze summarized data to predict care needs and prioritize services and spending around prevention and care.

Medical 101

Medical Healthcare Hospitality Insurance 101