Data Engineering Podcast

FEBRUARY 19, 2023

Because of their complete ownership of your data they constrain the possibilities of what data you can store and how it can be used. It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. Can you describe what Iceberg is and its position in the data lake/lakehouse ecosystem?

IT 147

IT Data Lake Metadata Data Warehouse 147

Data Engineering Podcast

JULY 17, 2022

Summary There are extensive and valuable data sets that are available outside the bounds of your organization. Whether that data is public, paid, or scraped it requires investment and upkeep to acquire and integrate it with your systems. Atlan is the metadata hub for your data ecosystem.

Data Management 130

Data Management Management Metadata MongoDB 130

Data Engineering Podcast

AUGUST 10, 2021

Stemma helps you establish and maintain that trust by giving visibility into who is using what data, annotating the reports with useful context, and understanding who is responsible for keeping it up to date. RudderStack’s smart customer data pipeline is warehouse-first. Then what do you do? Send a CSV via email?

IT 130

IT Building Data Warehouse Python 130

Teradata

SEPTEMBER 28, 2021

Our latest global industry survey, in partnership with Vanson Bourne, reveals that enterprises are contemplating long-term, data-focused IT investments to address changing market conditions.

Technology 52

Technology IT Data Management Cloud 52

Data Engineering Podcast

JUNE 26, 2022

Summary The most complicated part of data engineering is the effort involved in making the raw data fit into the narrative of the business. Master Data Management (MDM) is the process of building consensus around what the information actually means in the context of the business and then shaping the data to match those semantics.

Data Management 100

Data Management Management MongoDB Scala 100

Precisely

SEPTEMBER 5, 2023

With cloud computing, the capacity to extract value from data is greater than ever. As this realization grows, businesses are shifting their investments from hardware to technologies that optimize data assets. Nevertheless, MDM is not a silver bullet for data quality. Search: What data is available and from where?

Data Governance 52

Data Governance Government Data Management Management 52

Picnic Engineering

OCTOBER 17, 2023

Building the data foundation for world’s best online supermarket The Importance of MDM In the fast-paced world of technology, it’s easy to be captivated by the allure of artificial intelligence. The truth is, as companies want to unlock the power of data this starts with strong MDM. Consider our product range.

Data Management 52

Data Management Management Food Data 52

Striim

DECEMBER 12, 2023

Exciting news is on the horizon as Striim proudly announces its Technology Partnership with YugabyteDB, a collaboration set to reshape the landscape of data management. “At Striim, we believe in the transformative potential of data.

Data Management 59

Data Management Database-centric Management PostgreSQL 59

Data Engineering Podcast

SEPTEMBER 4, 2022

In this episode founders Barr Moses and Lior Gavish rejoin the show to reflect on the evolution and adoption of data observability technologies and the capabilities that are being introduced as the broader ecosystem adopts the practices. Atlan is the metadata hub for your data ecosystem. What is your take?

IT 100

IT Metadata MongoDB MySQL 100

Cloudera

JUNE 7, 2022

Only a fraction of data created is actually stored and managed, with analysts estimating it to be between 4 – 6 ZB in 2020. Clearly, hybrid data presents a massive opportunity and a tough challenge. Capitalizing on the potential requires the ability to harness the value of all of that data, no matter where it is.

IT 108

IT Unstructured Data Data Architecture Government 108

Data Engineering Podcast

JUNE 8, 2020

Summary The landscape of data management and processing is rapidly changing and evolving. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management What are the pieces of advice that you wish you had received early in your career of data engineering?

Data Management 100

Data Management Management Machine Learning Portfolio 100

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. What factors are most important when building a data management ecosystem?

Data Management 52

Data Management Data Lake Management Data Warehouse 52

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. What factors are most important when building a data management ecosystem?

Data Management 52

Data Management Management Data Lake Data Warehouse 52

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. What factors are most important when building a data management ecosystem?

Data Management 52

Data Management Management Data Lake Data Warehouse 52

Data Engineering Podcast

APRIL 16, 2022

Summary Putting machine learning models into production and keeping them there requires investing in well-managed systems to manage the full lifecycle of data cleaning, training, deployment and monitoring. What is the role of the data engineer in that process? Can you describe what MLOps is? How does it relate to DataOps?

Data Engineering 100

Data Engineering Data Engineer Engineering IT 100

Knowledge Hut

SEPTEMBER 21, 2023

Azure Expert certifications are emerging as a defining criterion for individuals looking to flourish in cloud computing in the fast-changing technological world. It ensures you're up to date in the ever-evolving world of technology. The domain is in high demand today and is the best for pursuing a career.

Certification 52

Certification IT Cloud Computing Cloud 52

Data Engineering Podcast

JULY 31, 2022

Summary Data lineage is the roadmap for your data platform, providing visibility into all of the dependencies for any report, machine learning model, or data warehouse table that you are working with. Atlan is the metadata hub for your data ecosystem. Data lineage and metadata systems are a hot topic right now.

IT 100

IT Metadata MongoDB MySQL 100

Data Engineering Podcast

OCTOBER 2, 2022

In this episode co-founder Martin Sahlen explains the impact that easy access to lineage information can have on the work of data engineers and analysts, and how he and his team have designed their platform to offer that information to engineers and stakeholders in the places that they interact with data.

IT 100

IT Food PostgreSQL MongoDB 100

Data Engineering Podcast

MARCH 8, 2021

explains how using Pilosa as the core he built the Molecula platform to eliminate the need to copy data between systems in able to make it accessible for analytical and machine learning purposes. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows.

IT 100

IT Data Warehouse MongoDB Kafka 100

Knowledge Hut

NOVEMBER 16, 2023

Moreover, the excitement to work with new technology and to embark on learning paths every day fuels the rising demand for IT jobs, not to forget the role of digitalization in this technology boost. Their main responsibilities include processing data, identifying valuable data sources, combining models, integrating data, etc.

IT 52

IT Software Engineer Software Engineering Cloud Computing 52

Knowledge Hut

SEPTEMBER 21, 2023

Microsoft certifications like the Azure Fundamentals AZ-900 are perfect for any kind of prospect who is considering their initial steps into technology or thinking about a career change and embracing a new specialization in certifications. Businesses around the world are using cloud services more than ever to help them grow.

Certification 52

Certification IT Cloud Computing Cloud 52

Data Engineering Podcast

FEBRUARY 24, 2020

Summary Misaligned priorities across business units can lead to tensions that drive members of the organization to build data and analytics projects without the guidance or support of engineering or IT staff. The availability of cloud platforms and managed services makes this a viable option, but can lead to downstream challenges.

IT 100

IT Data Lake Data Pipeline Media 100

Data Engineering Podcast

AUGUST 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Engineering 100

Data Engineering Data Engineer MongoDB Metadata 100

Data Engineering Podcast

JANUARY 25, 2021

Summary Businesses often need to be able to ingest data from their customers in order to power the services that they provide. In order to reduce the friction involved in supporting new data transformations David Molot and Hassan Syyid built the Hotlue platform. Can you start by describing what you are building at Hotglue?

Data Integration 100

Data Integration IT Python BI 100

Data Engineering Podcast

SEPTEMBER 3, 2018

Summary With the proliferation of data sources to give a more comprehensive view of the information critical to your business it is even more important to have a canonical view of the entities that you care about. Can you start by establishing a definition of data mastering that we can work from?

Data Management 100

Data Management Management Relational Database Business Intelligence 100

Data Engineering Podcast

AUGUST 6, 2023

Summary As businesses increasingly invest in technology and talent focused on data engineering and analytics, they want to know whether they are benefiting. So how do you calculate the return on investment for data? What are the typical motivations for measuring and tracking the ROI for a data team?

Machine Learning 130

Machine Learning SQL Data Data Engineering 130

Data Engineering Podcast

OCTOBER 15, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.

Process 182

Process Building SQL BI 182

Snowflake

MARCH 16, 2023

It needed to unite its data silos to give its customer, trading, and operational teams timely and robust insight to drive informed strategic decisions. Find out why its Chief Data and Insight Officer chose Snowflake as its unifying data platform—and how it’s given the partnership greater control over its data.

Data Process 52

Data Process Cloud Process IT 52

Data Engineering Podcast

JULY 16, 2023

Bob Muglia has had a front-row seat to many of the major shifts driven by technology over his career. In his recent book "Datapreneurs" he reflects on the people and businesses that he has known and worked with and how they relied on data to deliver valuable services and drive meaningful change.

SQL 130

SQL Machine Learning Python Data 130

Cloudera

APRIL 18, 2024

With the arrival of the latest AI-powered technologies like large language models (LLMs) and generative AI (GenAI), there’s a vast amount of opportunities for innovation, growth, and improved business outcomes right around the corner. All of that technology, though, depends on data to be successful.

Metadata 105

Metadata Government Data Governance Data 105

Data Engineering Podcast

OCTOBER 8, 2023

In this episode he shares his journey of data collection and analysis and the challenges of automating an intentionally manual industry. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. Closing Announcements Thank you for listening!

Insurance 162

Insurance BI SQL Machine Learning 162

Precisely

JANUARY 25, 2023

Financial institutions are using data in a myriad of different ways, from know-your-customer (KYC) compliance to marketing insights and channel optimization, from risk assessment and fraud detection to innovative AI and machine learning initiatives. This post examines the practical implications of poor data integrity.

Data Integration 52

Data Integration Banking IT Machine Learning 52

Data Engineering Podcast

SEPTEMBER 9, 2018

Summary Elasticsearch is a powerful tool for storing and analyzing data, but when using it for logs and other time oriented information it can become problematic to keep all of your history. Chaos Search was started to make it easy for you to keep all of your data and make it usable in S3, so that you can have the best of both worlds.

IT 100

IT PostgreSQL Scala AWS 100

Data Engineering Podcast

OCTOBER 22, 2023

In this episode Ranjith Raghunath shares his thoughts on how to build a strategy for the development, delivery, and evolution of data products. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

BI 162

BI SQL Machine Learning Programming Language 162

Snowflake

FEBRUARY 14, 2024

I’ve spent over 20 years helping large corporations gain significant market footholds by optimizing data, analytics and AI – and have seen firsthand how a holistic data strategy is foundational to avoiding wasted resource investment and achieving success in a new competitive landscape. Why have a data strategy?

Architecture 82

Architecture Government Data Management Management 82

Data Engineering Podcast

OCTOBER 1, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.

Building 162

Building BI SQL Machine Learning 162

Cloudera

FEBRUARY 7, 2024

How enterprise-grade data management creates better and more efficient care. This evolution of healthcare has set the stage for a new social acceptance of technology as a medium for healthcare delivery and remotely collected data as a key component to diagnosis. But what about privacy?

Medical 99

Medical Healthcare Hospitality Insurance 99