Christophe Blefari

FEBRUARY 16, 2024

Italy Sora ( credits ) Hey you, time for the Data News. Next Wednesday I will participate to a Data Night Talk a open discussion about AI & data engineering with other content creators. Next Wednesday I will participate to a Data Night Talk a open discussion about AI & data engineering with other content creators.

Food 130

Food Data SQL Government 130

Christophe Blefari

JANUARY 27, 2023

My view from the train window ( credits ) Dear Data News readers it's a joy every week to write this newsletter, we are slowly approaching the second birthday of this newsletter. In order to celebrate this together I'd love to receive your stories about data —can be short or long, anonymous or not.

Data 130

Data Algorithm Data Pipeline SQL 130

Knowledge Hut

MAY 6, 2024

Introduction to Data-centric Agile Transformations Teams and Organizations adopt Agile to bring in the changes- faster turnaround, better results, quick reviews, dynamic teams. While teams get structured, work is re-evaluated, Scrum masters trained and Agile coaches hired, everyone knows change is coming.

IT 52

IT Data Management Building 52

Christophe Blefari

APRIL 14, 2023

Anyway, here the weekly Data News, written faster than usual. For Yann ChatGPT has nothing revolutionary, but he admits it's good engineering. Hot takes on the Modern Data Stack — Matt gives 5 hot takes about the MDS. I don’t totally agree with everything but this is a good read.

Datasets 130

Datasets Data Deep Learning SQL 130

Monte Carlo

MAY 3, 2024

It’s 2024, and the data estate has changed. Data systems are more diverse. But even though the data landscape is evolving, many enterprise data organizations are still managing data quality the “old” way: with simple data quality monitoring. For JetBlue’s data engineering team, that’s Microsoft Teams.

High Quality Data 52

High Quality Data Data Architecture Media 52

Christophe Blefari

DECEMBER 31, 2023

Before moving on to the Data News, a bit of personal news, in December, I took part in the MotherDuck meetup in Berlin. End of January, on the 31st I'll speak at a Modern Data Stack conf in Paris, still about DuckDB, but this time in French. Enjoy this last 2023 Data News. We're going to get to know each other.

Data 100

Data Cloud Storage Datasets Python 100

Christophe Blefari

JANUARY 7, 2023

The blog crossed the 2000 members mark (❤️) and I won the best data science newsletter award. I talked in Robin's podcast about the newsletter and my data engineering journey. And you know what, this is the first time in 7 years of teaching that more than 80% of the class wants to become data engineer.

Data Science 130

Data Science Data BI Kafka 130

Monte Carlo

MARCH 18, 2024

That’s why Monte Carlo was the first data observability company to support vector databases and GenAI reliability. However, in order to realize the potential value of AI, we’ll first have to start thinking critically about how we develop AI applications—and the role data teams play in it.

Building 64

Building Healthcare Data Database 64

Christophe Blefari

DECEMBER 9, 2022

But do we want big companies holding decision power in their own pre-trained models, leaving real data science to the big ones? It's time for the Advent of Data head's up. After an small introduction the evening started with a presentation by Clément and Steff from leboncoin data engineering team.

SQL 130

SQL Data Data Science Metadata 130

Monte Carlo

FEBRUARY 9, 2024

A lot of organizations want to talk about AI, but it’s tough to find teams that are actually leveraging it in a meaningful way. But, when you find a data leader who’s on the real AI journey first-hand (no, not Midjourney), it’s natural to have a few questions. Data asset optimization is the need of the hour 4. Interested?

Data 64

Data High Quality Data Architecture Coding 64

The Pragmatic Engineer

JANUARY 5, 2023

For most engineering teams, returning from the winter holiday usually involves gradually getting back into the swing of things. The first response has been frustration because of the chaos a breach like this causes: At a scaleup I talked with, infrastructure teams shut down all pipelines in order to replace secrets.

Pipeline-centric 130

Pipeline-centric Database-centric Coding Accessible 130

Data Engineering Podcast

JULY 17, 2022

Summary There are extensive and valuable data sets that are available outside the bounds of your organization. Whether that data is public, paid, or scraped it requires investment and upkeep to acquire and integrate it with your systems. Atlan is the metadata hub for your data ecosystem.

Data Management 130

Data Management Management Metadata MongoDB 130

François Nguyen

FEBRUARY 28, 2021

Today, we are going to apply these principles to the data pipelines. The idea is to transpose these 7 principles to data pipeline knowing that Data pipelines are 100% flexible : if you have the skills, you build the pipeline you want. In fact it is not, everyday you have in the world tons of broken data pipelines.

Data Pipeline 130

Data Pipeline Building Manufacturing BI 130

Monte Carlo

FEBRUARY 23, 2023

I’m sorry Jason, it was for the greater good. The next day the team made adjustments. While this idea isn’t completely foreign to data engineering, it can certainly be described as an extremely uncommon practice. We cannot afford to overlook data’s increasingly large role in critical operations. Data is different.

Data Engineering 98

Data Engineering Data Engineer Engineering Software Engineer 98

Knowledge Hut

APRIL 16, 2024

This is both good and bad news. Good news, for the many boons of Agile and Scrum known to all. Bad news, because you are no longer enjoying the benefits alone. Every day, every hour, more functional IT teams are making Agile work for them. Large swathes of IT organizations are embracing Agile.

Certification 52

Certification Coding Programming Engineering 52

The Pragmatic Engineer

OCTOBER 10, 2022

Executives told directors across the company that they should select at least 15% of their teams to be labeled as "needs support" in an internal review process, one of the people who spoke with Insider said.” We previously covered what is good, average and bad attrition at tech companies. The mood inside Meta.

Engineering 130

Engineering Software Engineer Software Engineering Recruitment 130

Monte Carlo

DECEMBER 22, 2023

The good news? There are some tips and tricks you can apply to make good decisions with less data – or think in bets. Check out the full session here: Table of Contents What it means to ‘think in bets’ How ‘resulting’ can actually ease decision-making processes What does a good decision-making process look like?

Data 52

Data Process Utilities Data Engineering 52

Monte Carlo

DECEMBER 22, 2023

The good news? There are some tips and tricks you can apply to make good decisions with less data – or think in bets. Check out the full session here: Table of Contents What it means to ‘think in bets’ How ‘resulting’ can actually ease decision-making processes What does a good decision-making process look like?

Data 52

Data Process Utilities Data Engineering 52

Towards Data Science

FEBRUARY 24, 2023

The Chaos Data-Engineering Manifesto Another lesson we can learn from software engineers: break stuff to make it more reliable. The next day the team made adjustments. While this idea isn’t completely foreign to data engineering, it can certainly be described as an extremely uncommon practice. Data is different.

Data Engineering 98

Data Engineering Data Engineer Engineering Software Engineer 98

Jesse Anderson

JUNE 7, 2022

In 2021 I had the pleasure to first get to know and speak with Zhamak Dheghani, Director of Emerging Technologies at ThoughtWorks, in season one of the Data Dream Team series. I interviewed Zhamak last season as more of an introduction to Data Mesh. This episode is different to others in the Data Dream Team series.

Generalist 130

Generalist Software Engineer Software Engineering Data 130

The Pragmatic Engineer

OCTOBER 31, 2023

Our engineering teams were immediately engaged and began investigating. However, in these cases we aren’t talking about a small engineering team with a few users; but the largest cloud providers in the world upon whom tens of thousands of businesses rely. Our engineering teams were immediately engaged and began investigating.

AWS 215

AWS Google Cloud Cloud Food 215

Monte Carlo

MAY 26, 2023

What is data freshness and why is it important? Data freshness, sometimes referred to as data timeliness, is the frequency in which data is updated for consumption. It is an important dimension of data quality and a pillar of data observability because recently refreshed data is more accurate, and thus more valuable.

Data Pipeline 98

Data Pipeline Data Data Warehouse Machine Learning 98

Data Engineering Podcast

JULY 10, 2022

Summary Building a data platform is a journey, not a destination. Beyond the work of assembling a set of technologies and building integrations across them, there is also the work of growing and organizing a team that can support and benefit from that platform. Atlan is the metadata hub for your data ecosystem.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

François Nguyen

FEBRUARY 8, 2021

I was part of a small team with great individuals and in fact we were an alternative to IT unable to deliver what we wanted. It is clearly a good demonstration of what can do a collective intelligence and how something can become viral. There is no magic, just good project management. So we are going to do it ourselves.

Architecture 130

Architecture Project IT Process 130

Christophe Blefari

MAY 19, 2023

In 2021, I was doing Twitch lives twice a week, every Wednesday I was doing a data news round-up. This is what made me decide to send emails containing my round-up. 😱 If you only want to read Data News you can read my selection of talks from the Data Council. At the time, only 3 people received it. We achieved that.

Data 130

Data Data Engineering Data Engineer Hadoop 130

Data Engineering Podcast

JULY 3, 2022

Summary The ecosystem for data tools has been going through rapid and constant evolution over the past several years. These technological shifts have brought about corresponding changes in data and platform architectures for managing data and analytical workflows. Atlan is the metadata hub for your data ecosystem.

Architecture 100

Architecture Metadata MongoDB MySQL 100

Monte Carlo

MAY 17, 2023

Bad pull requests may not be the root of all evil—but they’re certainly the root of some gnarly data quality incidents. The good news? With this new feature, users can: Quickly and easily correlate PRs on Github to data issues, accelerating incident resolution. GitHub PRs break data pipelines. What happens?

Data Pipeline 52

Data Pipeline Coding Data Engineering Data Engineer 52

Monte Carlo

MAY 17, 2023

Bad pull requests may not be the root of all evil—but they’re certainly the root of some gnarly data quality incidents. The good news? With this new feature, users can: Quickly and easily correlate PRs on Github to data issues, accelerating incident resolution. GitHub PRs break data pipelines. There’s a better way.

Data Pipeline 52

Data Pipeline Data Engineering Data Engineer Data 52

Monte Carlo

DECEMBER 4, 2023

The company has exacting standards for how they manufacture their products, and for how they deliver data products. These high-end appliances are also IoT connected devices that, like any modern app, emit data that can be used to provide unparalleled customer service. But for all teams data reliability is paramount.”

Manufacturing 52

Manufacturing Data Governance Government BI 52

Towards Data Science

AUGUST 22, 2023

Advice from a startup founder in the data space on how to find a startup that works for you Photo by Leeloo Thefirst from Pexels.com So you want to join a startup huh? As a founder of a VC funded startup in the data / technology space, I’ve seen a lot of things and have spoken to a lot of other founders. Sounds like fun.

Data Engineering 93

Data Engineering Data Engineer Engineering Data Pipeline 93

Monte Carlo

SEPTEMBER 27, 2023

According to our annual survey , incidents of data downtime — moments when data is inaccurate, missing, or otherwise unreliable — nearly doubled year over year. This is likely driven by the finding that time-to-resolution for data quality issues increased by 166%.

Data Governance 52

Data Governance Government Data Data Pipeline 52

Knowledge Hut

DECEMBER 22, 2023

Ethical hacking is an important tool for keeping sensitive and personal data safe. By identifying vulnerabilities in systems, ethical hackers can help to prevent data breaches and protect the sensitive information of users. Breaking Bad Breaking Bad is an ethical hacking forum that has been gaining popularity in recent years.

Education 98

Education Database Media Certification 98

Monte Carlo

JANUARY 16, 2024

They run on data powered by Fox. Factor in the advertising strategies, media production, partner programming, audience analytics…and you’re looking at an ocean of data that would fill even the deepest trench (we’d like a television show about that too, please!). So how does Fox’s data strategy support these complex data workflows?

Government 52

Government High Quality Data Data Governance Entertainment 52

Monte Carlo

JUNE 27, 2023

What about a spike in data volume for an important financial model that went unnoticed for weeks – eventually costing your company millions of dollars – because there wasn’t a noticeable change in your KPIs? The good news?

Data 52

Data Cloud Building Management 52

Databand.ai

NOVEMBER 4, 2022

Re-Imagining Data Observability Ryan Yackel 2022-11-04 10:36:35 Data observability has become one of the hottest topics of the year – and for good reason. Data observability provides an end-to-end view into exactly what’s happening with data pipelines across an organization’s data fabric.

Data 52

Data Data Pipeline Retail Metadata 52

Monte Carlo

JANUARY 10, 2024

What happens when you strip away all the noise of queries and pipelines and focus on the data itself? You get down to the intrinsic data quality. What’s the difference between intrinsic and extrinsic data quality? Intrinsic data quality is the quality of data assessed independently of its use case. Data Auditing 5.

Data Cleanse 52

Data Cleanse Data Engineering Data Engineer Engineering 52

Towards Data Science

JUNE 2, 2023

Are You a Data Ticket Taker or Decision Maker? The characteristics and value of reactive vs. proactive data teams Image courtesy of the author. Fundamentally, there are two different types of data teams in this world. This isn’t to say data teams should never resolve a ticket or field an ad-hoc request.

Data 96

Data Data Engineering Data Engineer BI 96