Data Engineering Podcast

MARCH 10, 2024

Data lakes are notoriously complex. For data engineers who battle to build and scale high quality data workflows on the data lake, Starburst powers petabyte-scale SQL analytics fast, at a fraction of the cost of traditional methods, so that you can meet all your data needs ranging from AI to data applications to complete analytics.

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Monte Carlo

MAY 29, 2024

PS, be sure to book a meeting with our team at the event to find out what’s happening with Monte Carlo and pick up some new swag!) 3:00-3:45pm: Beyond the Headlines: How CNN Builds Data Trust and Reliability: Alex Charalambides, Senior VP and CTO, WBD/CNN will share how his data team has doubled down on building data trust and reliability.

Cloud 69

Cloud Food Manufacturing Data Architect 69

Monte Carlo

OCTOBER 4, 2022

Now, roughly two years and 300 pages later, I’m thrilled to announce Data Quality Fundamentals is now available both online and in print. It’s our hope this book will prepare the next generation of data teams as they drive data product development and analytics strategy forward.

High Quality Data 52

High Quality Data Data Pipeline Media Data 52

Data Engineering Weekly

MAY 19, 2024

We added some additional features to bring the data community together this year. Book a 1:1 session with experts on career, tech stack, team management, and more!! The article about data asset pricing is one of the comprehensive thoughts I came across about pricing models, establishing two basic factors.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Data Engineering Podcast

JUNE 29, 2020

This was a great conversation about the complexities of working in a niche domain of data analysis and how to build a pipeline of high quality data from collection to analysis. If you hand a book to a new data engineer, what wisdom would you add to it?

Data Collection 100

Data Collection Management High Quality Data Metadata 100

Monte Carlo

FEBRUARY 27, 2024

Organizations need to connect LLMs with their proprietary data and business context to actually create value for their customers and employees. They need robust data pipelines, high-quality data, well-guarded privacy, and cost-effective scalability. Data engineers. Who can deliver?

Data Engineering 59

Data Engineering Data Engineer Engineering High Quality Data 59

AltexSoft

FEBRUARY 21, 2023

The key objective behind this task is to set the best booking prices to entice customers and ensure that hotels take full advantage of their business potential. Our team faced the challenge of data scarcity when working on the Rakuten project. While we were engaged in our project, we had to filter out non-informative bookings.

Hospitality 52

Hospitality Datasets Algorithm Machine Learning 52

Edureka

SEPTEMBER 11, 2023

GANs, or generative adversarial networks GANs, first developed by Ian Goodfellow in 2014, comprise a Discriminator network that assesses the data and a Generator network that generates it. The generator produces high-quality data because the two networks are trained together in a game-like setting.

Algorithm 52

Algorithm Entertainment Healthcare Deep Learning 52

Precisely

JANUARY 11, 2023

To remain competitive, you must proactively and systematically pursue new ways to leverage data to your advantage. As the value of data reaches new highs, the fundamental rules that govern data-driven decision-making haven’t changed. To make good decisions, you need high-quality data.

Data Governance 52

Data Governance Government Metadata Data 52

Workfall

JULY 4, 2023

DBT’s superpowers include seamlessly connecting with databases and data warehouses, performing amazing transformations, and effortlessly managing dependencies to ensure high-quality data. Each successful deployment enriches its data ecosystem, empowering decision-makers with valuable, up-to-date insights.

Data Warehouse 69

Data Warehouse SQL PostgreSQL Database 69

Monte Carlo

MAY 24, 2022

Before launching Monte Carlo, I spoke with hundreds of data leaders who all struggled to deliver high quality data despite having their teams spend upwards of 30% of their time and millions of dollars per year on this issue. JetBlue accelerated their data quality processes to match the real-time needs of their business.

High Quality Data 52

High Quality Data Data Lake Media Data 52

Monte Carlo

MAY 24, 2022

Monte Carlo research shows a correlation between data incidents and the amount of data an organization handles, with the average business experiencing at least one data incident for every 15 tables in their environment. “As The first several chapters of the book are accessible for free, here.

High Quality Data 52

High Quality Data Data Education Machine Learning 52

Data Engineering Weekly

NOVEMBER 11, 2022

Listening to all these conversations, After a decade, I still wonder why we can’t introduce simple “data contract” tooling to enable high-quality data creation to capture the ingredients. Am I worthy enough Data Engineer? We got the dbt superpower to make things work; ignore the Snowflake billing.

Systems 40

Systems High Quality Data Consulting Metadata 40

Monte Carlo

MARCH 23, 2022

According to Forrester , it’s significant: data-driven companies are 58% more likely to beat revenue goals than those who don’t use data to guide strategy and decision making. Trust is essential to efforts to democratize data, build a data mesh , and increase data adoption.

IT 52

IT Machine Learning High Quality Data Data 52

Monte Carlo

MARCH 28, 2024

A data observability tool is a key way to monitor and maintain high-quality data in your pipelines. When data discrepancies do occur, your team can act fast and resolve them quickly, before they reach stakeholders, maintaining a culture of data trust. Our promise: we will show you the product.

Data 52

Data High Quality Data Machine Learning Accessible 52

Monte Carlo

OCTOBER 11, 2022

We’ll then discuss how they can be avoided with an organizational commitment to high-quality data. Imagine this You’re a data scientist with a swagger working on a predictive model to optimize a fast-growing company’s digital marketing spend.

IT 52

IT Datasets Data Warehouse Data Analysis 52

Monte Carlo

JUNE 20, 2023

The only way to ensure we are delivering high-quality data products is to identify those consumers, understand their requirements and codify their expectations within a SLO/SLI framework. There are several other dimensions improving data product trust such as accuracy and availability.

Building 52

Building Data Datasets High Quality Data 52

Knowledge Hut

JANUARY 25, 2024

Standardizing Capitalization: The Language of Consistency Consider your data like a library, and inconsistent capitalization as books scattered randomly. Establish a style guide for your data, specifying how text should be capitalized, and ensure everyone follows these rules consistently.

Data Cleanse 52

Data Cleanse Datasets Data Preparation Data Science 52

Monte Carlo

APRIL 21, 2022

Snowflake Data Quality Feature #4: Snowsight Snowsight is another Snowflake data quality feature. Data quality isn’t simply about accuracy—it’s about providing value to the business. That’s why high-quality data also needs to be accessible, understandable, and discoverable. Check it out!

Metadata 52

Metadata Bytes Government Data 52

Monte Carlo

JUNE 23, 2022

Technologies like data observability can bring data monitoring to scale so there doesn’t need to be a trade off between quantity and big data quality, but the point remains data volume alone is insufficient to make a fraction of the impact of a well-maintained, high quality data product.

Big Data 40

Big Data Management Machine Learning Data Warehouse 40

Monte Carlo

AUGUST 10, 2023

While different solutions or tools may have significant differences in features offered, there is no real difference between data observability and data reliability engineering. Both terms are focused on the practice of ensuring healthy, high quality data across an organization. It is still relevant today.

Data Pipeline 98

Data Pipeline Software Engineer Software Engineering Machine Learning 98

Scribd Technology

JULY 27, 2021

In this series, we have already shared how we identify document types and extract information from documents , this post will discuss how insights from data were used to help build the taxonomy and our approach to assign categories to the user-uploaded documents.

High Quality Data 52

High Quality Data Metadata Datasets Algorithm 52

Monte Carlo

APRIL 26, 2022

Similarly, the discipline of DataOps helps teams remove silos and work more efficiently to deliver high-quality data products across the organization. DataOps professionals also leverage observability to decrease downtime as companies begint o ingest large amounts of data from various sources.

IT 64

IT Data Pipeline Data Engineering Data Engineer 64

AltexSoft

AUGUST 22, 2022

Structural metadata describes relationships among different parts of source data such as page numbers or tables of context in a book. This critical layer conducts some of the most important jobs for the data fabric — transforming, integrating, and cleansing the data close to data sources, making it usable for teams across the business.

Architecture 52

Architecture Metadata Data Lake Machine Learning 52

Monte Carlo

APRIL 1, 2021

Unfortunately, with COVID, you really could see that people don’t understand where the data comes from and what it means. You build trust when people understand where the data comes from, and when they understand that even high-quality data will never be perfectly clean. What was your favorite book in 2020?

Building 52

Building BI Business Intelligence Data 52

ProjectPro

FEBRUARY 21, 2023

Google Cloud Certified Professional Data Engineer Certifications An individual is fit for taking the GCP Data Engineering certification exam if he/she- Has more than three years of prior data engineering experience, including at least one year of solution design and management using Google Cloud.

Certification 52

Certification Data Engineering Data Engineer Engineering 52

Monte Carlo

AUGUST 17, 2021

Their artificial intelligence data-driven platform relies on high-quality data to make coverage recommendations for customers. With the right approach to data trust, teams across industries can eliminate Data Downtime and unlock the full potential of their data. Correction issued Saturday, Sept.

Insurance 40

Insurance Retail Data Pipeline Portfolio 40

Monte Carlo

MAY 17, 2023

Keeping these revenue generators online and accurate is a common data observability use case. Move Your Generative AI Strategy From Pitch Deck To Reality If generative AI is a gold rush, high quality data is the pickaxe. Do you want your team to get one alert or do you want to get 15 – all for the same incident?

Data 52

Data Data Pipeline Data Engineering Data Engineer 52

Monte Carlo

MAY 17, 2023

Keeping these revenue generators online and accurate is a common data observability use case. Move Your Generative AI Strategy From Pitch Deck To Reality If generative AI is a goldrush, high quality data is the pickaxe. Do you want your team to get one alert or do you want to get 15 – all for the same incident?

Data Pipeline 52

Data Pipeline Data Data Engineering Data Engineer 52