Monte Carlo

JULY 28, 2022

But perhaps one of the most common reasons for data quality challenges are software feature updates and other changes made upstream by software engineers. But, if it’s a matter of unawareness, why does it happen the second time? But, if it’s a matter of unawareness, why does it happen the second time?

Pipeline-centric 52

Pipeline-centric Software Engineer Software Engineering Database-centric 52

Monte Carlo

SEPTEMBER 6, 2022

It doesn’t care about how proactive you are at writing dbt tests, how perfectly your data is modeled, or how robust your architecture is. We had the opportunity to interview him for our blog a few weeks ago on these and other tips for building out the first data team at your startup. Here’s why.

Software Engineer 52

Software Engineer Software Engineering Retail Data 52

Monte Carlo

NOVEMBER 21, 2022

What’s next for the future of data engineering? Each year, we chat with one of our industry’s pioneering leaders about their predictions for the modern data stack – and share a few of our own. It looked like so much fun that I decided to grab my crystal ball and add a few suggestions to the mix.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

DataKitchen

FEBRUARY 2, 2023

What will the world of data tools be like at the end of 2025? The crazy idea is that data teams are beyond the boom decade of “spending extravagance” and need to focus on doing more with less. What will exist at the end of 2025? Central IT Data Teams focus on standards, compliance, and cost reduction.

Metadata 52

Metadata BI Government ETL Tools 52

phData: Data Engineering

JANUARY 3, 2022

DataOps: What Is It, Core Principles, and Tools For Implementation Nick Goble January 3, 2022 When building a successful company, it’s critical to have a strategy around how you build and scale your business from a technology and data perspective. You can read the full guide without giving us your email — keep scrolling !)

IT 52

IT AWS Software Engineer Software Engineering 52

phData: Data Engineering

MAY 11, 2023

Practices centered on software engineering principles can create a barrier to entry for teams with skilled data wranglers looking to take their infrastructure to the next level with cloud-native tools like Matillion for the Snowflake Data Cloud. That begs the question, if it is so easy to learn, “Why formalize a concept like ZDLC?”

Coding 52

Coding Software Engineer Software Engineering Government 52

Databand.ai

JANUARY 24, 2023

What is DataOps? The Ultimate Guide for Data Teams Eric Jones 2023-01-24 12:21:38 If you find yourself hearing a lot about DataOps and then subsequently asking, “ What is DataOps? This guide details everything you need to know about DataOps, including: What is DataOps?

Retail 52

Retail Banking Government Manufacturing 52

Monte Carlo

MAY 19, 2022

In his seminal 2017 blog post, The Downfall of the Data Engineer , Maxime Beauchemin wrote that the data engineer had the worst seat at the table. So, if the data engineer no longer has the worst seat at the table, who then on the data team has inherited this unfortunate title? Quite the opposite in fact.

Generalist 52

Generalist Data Governance Government Metadata 52

DataKitchen

AUGUST 8, 2023

The need for better observability over data quality and data pipelines is increasing due to distributed data landscapes, datasets diversity, and high data quality requirements. Traditional monitoring tools need to be more comprehensive to address new issues not previously understood or detected.

Data Pipeline 52

Data Pipeline Data Government Metadata 52

Monte Carlo

MAY 17, 2023

Data observability, an organization’s ability to fully understand the health and quality of the data in their systems, has become one of the hottest technologies in modern data engineering. In less than three years it has gone from an idea sketched out in a Barr Moses blog post to climbing the Gartner Hype Cycle for Emerging Technology.

Data 52

Data Data Pipeline Data Engineering Data Engineer 52

Monte Carlo

MAY 17, 2023

Data observability, an organization’s ability to fully understand the health and quality of the data in their systems, has become one of the hottest technologies in modern data engineering. In less than three years it has gone from an idea sketched out in a Barr Moses blog post to climbing the Gartner Hype Cycle for Emerging Technology.

Data Pipeline 52

Data Pipeline Data Data Engineering Data Engineer 52

Cloudera

NOVEMBER 27, 2023

This blog is a summary of what we observed there for anyone who was unable to attend or just wants to stay on top of what’s happening in streaming. The conference had a laser focus on the open source technology and the developers who bring it to their organizations. Takeaway No. Takeaway No. billion events/s.

Kafka 81

Kafka SQL ETL Tools Data Lake 81