Precisely

MARCH 19, 2024

Les processus SAP ERP manuels et nécessitant beaucoup de données sont souvent des candidats de choix pour l’automatisation en raison de leur nature complexe. Mais comment le succès de l’automatisation des processus est-il réellement réalisé et mesuré dans la pratique ?

Technology 52

Technology Programming Management Coding 52

Start Data Engineering

JUNE 13, 2023

Introduction So you are a new data engineer (or looking for a DE job) and want to better yourself as a data engineer. Know your business 2.1.2. Money & Time 2.2. Technical skills 3. Build impactful projects 4. Conclusion 5. Further reading 1.

Data Engineering 130

Data Engineering Data Engineer Engineering Data 130

Netflix Tech

NOVEMBER 14, 2023

Our audits would detect this and alert the on-call data engineer (DE). The on-call DE would then face the daunting task of making things right! The DE would note that the data for hours 3–6 needs to be reprocessed and will retrigger four instances to be run sequentially. Now, the data in the signup fact is patched.

Data Engineering 105

Data Engineering Data Engineer Engineering Metadata 105

Christophe Blefari

AUGUST 4, 2023

At the same time the Tour de France was ongoing and I found a "way" to get Strava data for Tour athletes on Strava. Stages — le Tour de France is a 3-weeks race, it contains 21 stages, every stage is a GPS path with a few checkpoints. So I thought it was the perfect data to build a data platform. It will be 21 CSVs.

Google Cloud 225

Google Cloud MongoDB NoSQL Data 225

Towards Data Science

MARCH 5, 2024

The shift towards de-normalization In the realm of database design and management, data normalization and de-normalization are fundamental concepts aimed at optimizing data structures for efficient storage, retrieval, and manipulation. De-normalized tables reduce the need for complex joins, resulting in faster query execution times.

Bytes 74

Bytes Google Cloud Cloud Storage Utilities 74

Knowledge Hut

MAY 31, 2023

Evaluating the impact and barriers to De-risking strategies De-risking strategies are designed to minimize the potential risks associated with a project. De-risking strategies can be time-consuming to implement, which can delay the project timeline. Uncertainty can be a major barrier to de-risking strategies.

Project 98

Project Management Manufacturing Professional Services 98

Christophe Blefari

NOVEMBER 25, 2022

In the past Jesse Anderson always advocated for 2-3 DE per DA/DS in simple team and 4-5 in more complex setup. As of today I believe the a good ratio would be DE / (DA + DS) > 1. Ask your DE to talk to stakeholders GDPR—no one does it, right? I still think this is only a dream. This is in a nutshell my presentation.

Data 130

Data Java Data Engineering Data Engineer 130

Cloudera

FEBRUARY 9, 2022

This work evolved into a full-time role as Senior Program Manager, with the Diversity Equity & Inclusion (DE&I) organization. Marque says he’s proud of what he and his team accomplished during his time with DE&I. Cloudera’s DE&I programs were just starting, and it was all a green field for us.

Entertainment 117

Entertainment Media Programming Designing 117

Snowflake

MAY 4, 2023

En migrant son socle data vers la plateforme Snowflake, le créateur de mode et ses 2 000 points de vente dans le monde développent leurs usages data, en bénéficiant d’une meilleure autonomie des équipes DSI, de coûts prévisibles et justes, grâce au paiement à l’usage et d’une meilleure interopérabilité avec l’ensemble du système d’information.

Hadoop 52

Hadoop Data SQL Cloud 52

Snowflake

APRIL 5, 2023

Le leader français du e-commerce, désormais également fournisseur de services professionnels, s’équipe de la data platform Snowflake pour renforcer ses usages data en interne et avec son écosystème. Objectif : garantir la disponibilité, les performances et la cohérence des data au sein de l’ensemble de ses filiales.

Hadoop 52

Hadoop Algorithm Business Intelligence SQL 52

Christophe Blefari

JULY 8, 2023

Dans le premier épisode j'ai discuté avec Benoit Pimpaud qui a été data scientist à l'Olympique de Marseille et qui s'est reconverti plus tard chez Deezer en data engineer. PS : est-ce qu'une version française de mon contenu t'intéresse ?

Kafka 130

Kafka PostgreSQL Transportation Data 130

Cloudera

JULY 8, 2021

Here’s a look at our progress report to show the steps we are taking to accomplish Rob’s initial DE&I commitments. Last year, our leadership team formed an equality committee dedicated to our DE&I efforts. We provided new DE&I learning and development opportunities within Cloudera.

Finance 117

Finance Programming Education Datasets 117

Christophe Blefari

OCTOBER 19, 2023

cross-project dependencies ( credits ) Over the last few years, dbt has become a de facto standard enabling companies to collaborate easily on data transformations. With dbt, you can apply software engineering practices to SQL development. Managing your SQL patrimony has never been easier.

Project 264

Project Finance SQL Government 264

Christophe Blefari

JULY 15, 2023

Yesterday I found a way to get sensor data of half of the Tour de France peloton, I was sure it was a good dataset to explore new tools with. Sometimes there are Fridays when I don't find any glue between articles for the newsletter and I have an idea of something to compensate but it takes me the whole Friday of exploration.

Datasets 130

Datasets Python Machine Learning Data 130

Cloudera

AUGUST 15, 2022

Thatiane volunteers with a local organization called Casa de Caridade Inacio Daniel, which began with the goal to meet the day-to-day, foundational needs of the homeless community in Bras í lia. Core to their mission, Casa de Caridade Inacio Daniel puts love, fraternity, solidarity, and charitable ideals into practice all at once.

Food 83

Food Programming Accessible Accessibility 83

Palantir

MAY 11, 2022

(Scroll down for English translation below) Avec l’adoption des accords de Paris en 2016, les institutions du secteur public et privé ont considérablement renforcé leurs ambitions en matière de décarbonation. L’attractivité de la France passe par la numérisation de son tissu économique et de l’action de l’État.

Manufacturing 52

Manufacturing Technology Data Integration Accessible 52

Start Data Engineering

JUNE 2, 2020

I really want to get into DE. I have seen and been asked the following questions by students, backend engineers and analysts who want to get into the data engineering industry. What approach should i take to land a Data Engineering job? What can I do to learn more about it?

Data Engineering 130

Data Engineering Data Engineer Engineering Data 130

Confluent

OCTOBER 16, 2020

There are numerous features of Kafka that make it the de-facto standard for […]. Apache Kafka® is an event streaming platform used by more than 30% of the Fortune 500 today.

Kafka 145

Kafka IT 145

Data Engineering Podcast

APRIL 2, 2023

The rapid growth and proliferation of data tools helped establish the "Modern Data Stack" as a de-facto architectural paradigm. The rapid growth and proliferation of data tools helped establish the "Modern Data Stack" as a de-facto architectural paradigm.

Hadoop 130

Hadoop Machine Learning Python Architecture 130

Confluent

SEPTEMBER 16, 2020

Near-real-time insights have become a de facto requirement for Azure use cases involving scalable log analytics, time series analytics, and IoT/telemetry analytics. Azure Data Explorer (also called Kusto) is the […].

Kafka 139

Kafka Data Programming Cloud 139

Data Engineering Podcast

NOVEMBER 26, 2023

Your host is Tobias Macey and today I'll be sharing an update on my own journey of building a data platform, with a particular focus on the challenges of tool integration and maintaining a single source of truth Interview Introduction How did you get involved in the area of data management?

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Christophe Blefari

MARCH 31, 2023

As AE are, theoretically, in between DE and DA it pushes the actual roles borders further. Meaning DE will have to do more infra stuff to support analytics initiatives. This is normal and Robert adds more to the table in his blogpost. You can also check this map that explains all data roles.

Bytes 130

Bytes Data Google Cloud Education 130

Cloudera

JULY 1, 2022

I am a program success manager for Cloudera’s Diversity, Equity, and Inclusion (DE&I) organization. I work to promote Cloudera’s DE&I initiatives both internally and externally. I started looking for a DE&I role and found my current position at Cloudera, which matched my industry experience.

Recruitment 82

Recruitment Education Banking Professional Services 82

Data Engineering Podcast

SEPTEMBER 25, 2022

In this episode Mark Van de Wiel explains how they integrated CDC functionality into their existing product, discusses the nuances of different approaches to change data capture from various sources. With the increasing expecation for information to be instantly accessible, it drives the need for reliable change data capture.

Food 100

Food MongoDB Scala MySQL 100

Cloudera

JUNE 29, 2021

By introducing this new category, our goal is to encourage our customers and the industry to begin exploring data-driven DE&I initiatives in three key areas: workforce, workplace, and marketplace. We the people are the data . The People. After all, data is only as good as the decisions that come afterwards. .

Recruitment 81

Recruitment Data Programming Accessible 81

Teradata

JUNE 9, 2022

How do you take the first steps to free the power of analytics from on-premise systems whilst protecting valuable data and de-risking transformation? Find out more.

Systems 85

Systems Data 85

Lyft Engineering

JUNE 6, 2023

These issues are listed down in their severity order: Data skewness (hot shard) Large window size Interaction with low speed services Serialization & de-serialization Data Skewness (hot shard) Data skewness or hot shard is the most notorious one among all performance issues. The issue can be identified by looking at the flame graph.

Utilities 123

Utilities Coding Python Systems 123

Christophe Blefari

MAY 18, 2023

DE is often constant firefighting, a lot of (spaghetti) SQL to maintain. During the demo, Llyod does some data analysis in the browser and it's just mind-blowing 🤯 At the same time someone Google also did a Calcite presentation. Chad Sanderson did the best recap about it.

Data 130

Data BI Consulting Data Science 130

Christophe Blefari

JULY 22, 2023

For the next 5 releases it will be a bit different than usual, less curation and more original articles written in advance to allow me to take a break.

Data 130

Data Database Big Data Data Engineering 130

Towards Data Science

MAY 22, 2023

84] } iso_codes = { 'China': 'CN', 'USA': 'US', 'Germany': 'DE' } df = pd.DataFrame(data) # Add ISO code column df['ISO Code'] = df['Country'].map(iso_codes) 1 Europe Germany DE 2022 3.9 0.012819 1 Europe Germany DE 2022 3.9 0.012819 1 Europe Germany DE 2022 3.9

Data Engineering 94

Data Engineering Data Engineer Engineering Data Science 94

Engineering at Meta

DECEMBER 12, 2022

Meta has open-sourced Anonymous Credential Service (ACS) , a highly available multitenant service that allows clients to authenticate in a de-identified manner. By open-sourcing and fostering a community for ACS, we believe we can accelerate the pace of innovation in de-identified authentication.

Utilities 52

Utilities Systems Engineering Accessible 52

Cloudera

FEBRUARY 7, 2024

Thinking outside of the box Recently I read an excellent article in de Volkskrant about a gentleman in the Netherlands whose aging father suffers from mild dementia in London. I think this is just the tip of the iceberg for the future of data-driven healthcare.

Medical 98

Medical Healthcare Hospitality Insurance 98

Cloudera

JANUARY 18, 2021

Our Chief Diversity Officer, Sarah Shin, hosted Cloudera’s first Diversity, Equality, and Inclusion (DE&I) Summit in August of 2020. Members of the Cloudera Equality Committee, Employee Resource Group Leadership, and key partners from across the organization joined together to discuss how we can accelerate Cloudera’s DE&I efforts.

Food 103

Food Medical Banking Programming 103

Christophe Blefari

FEBRUARY 3, 2024

My main takeaway is that Data Analyst role is finally taking the place it should take as a full role and not a transition role before a DS or a DE role — being paid higher than other at entry for instance.

MongoDB 130

MongoDB SQL Data Data Warehouse 130

Cloudera

SEPTEMBER 27, 2021

Some of these important celebrations, include Quinceneras (the 15th year birthday event), Dia De Los Muertos (Day of the Dead), Dia Del Nino (Day of Children), Dia Del Mariachi (Celebrate Mariachis), Dia de la Independencia (Independence Day), Posadas (Christmas traditions, singing), Nochebuena (Christmas Eve celebration), and many more!”.

Management 97

Management Building IT 97

Christophe Blefari

FEBRUARY 16, 2024

Seeing a new kid on the block is good because it renew the ideas because let's be honest we will never have a de facto packaging tool. Mainly it means data is exported in Parquet and compute with DuckDB WASM in the browser. And it's for the better.

Food 130

Food Data SQL Government 130

Teradata

OCTOBER 12, 2020

In honor of World Mental Health Day this past weekend, Shehzeen Rehman writes on the importance of de-stigmatizing mental health and learning how to seek help.

98

98