Christophe Blefari

MARCH 17, 2023

At every Airflow meetup we often get questions about Airflow competition so we decided to give a voice to alternatives in order to understand how they compare with Airflow and more. How lucky you are because I will host the event, so you'll hear my awesome French accent. We will host another event soon after with others.

Data 130

Data SQL Deep Learning Kafka 130

DoorDash Engineering

APRIL 26, 2023

The company is exploring the use of Generative AI, a subset of Artificial Intelligence that generates novel content based on existing data, and how it can be implemented effectively with consideration for the privacy and security of personal information. ChatGPT, the version of GPT-3.5 So, where can DoorDash capitalize on Generative AI?

Food 98

Food Unstructured Data Deep Learning SQL 98

LinkedIn Engineering

APRIL 20, 2023

We’ve previously discussed the various systems used to create a safe and trusted experience for our members and how we keep the LinkedIn Feed relevant for our members on LinkedIn. The AI models used to detect violative content can be broadly classified into two main categories: 1) proactive defenses and 2) reactive defenses.

Machine Learning 124

Machine Learning Utilities Designing Accessible 124

Cloudera

OCTOBER 18, 2021

This year’s entrants have excelled at demonstrating how innovative data solutions can help solve real-time challenges and positively impact people around the world. . Each one demonstrates how investment in advanced technologies can better shape the future of business and make a real difference to the world we live in. . ExxonMobil .

Banking 105

Banking Transportation Government Finance 105

Knowledge Hut

FEBRUARY 28, 2024

How do top UX designers and visual designers illustrate complex information without confusing users? The ability to track multiple key performance indicators (KPIs) and metrics is critical to business success today. It is not feasible to analyze and interpret large amounts of data manually.

BI 52

BI Business Intelligence Data Data Science 52

Cloudera

DECEMBER 14, 2021

Artificial Intelligence (AI) has revolutionized how various industries operate in recent years. In 2021, the finalists under this category include the following organizations. It is also the winning solution in this category. The 2021 Data Impact Awards aim to honor organizations who have shown exemplary work in this area. .

Transportation 106

Transportation Telecommunication Banking Data Lake 106

Christophe Blefari

JANUARY 20, 2024

But right now I'm in holidays finishing a hiking week in Corsica 🥾 So I wrote this special edition about: how to learn data engineering in 2024. How do computer works? Additionally by understanding how web works — frontend & backend, deployment, etc. What is Hadoop?

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

Christophe Blefari

DECEMBER 3, 2022

Joe Reis launched his Substack — Joe is the co-author of the great The Fundamentals of Data Engineering and his blog already have 2 articles I deeply recommend: No extra credit for complexity & Groundhog Days. Felipe showcases how you can send an email from Snowflake. I'm terribly late with this newsletter.

Kafka 130

Kafka BI Finance Data 130

Cloudera

JUNE 29, 2021

There have been many points in history where society has been forced to reflect on the expectations of diversity and inclusion and as mentioned in our “ Embracing the conversation ” blog post earlier this year, the last 18 months have presented a real opportunity for change. We the people are the data . What the judges are looking for .

Recruitment 81

Recruitment Data Programming Accessible 81

Data Engineering Podcast

SEPTEMBER 4, 2022

Summary Data observability is a product category that has seen massive growth and adoption in recent years. Monte Carlo is in the vanguard of companies who have been enabling data teams to observe and understand their complex data systems. And don’t forget to thank them for their continued support of this show!

IT 100

IT Metadata MongoDB MySQL 100

Knowledge Hut

APRIL 25, 2024

In this blog post, we will discuss such technologies. Big data in information technology is used to improve operations, provide better customer service, develop customized marketing campaigns, and take other actions to increase revenue and profits. In the world of technology, things are always changing. What Are Big Data T echnologies?

Big Data 98

Big Data Technology NoSQL Hadoop 98

Knowledge Hut

MARCH 26, 2024

In this blog post, I have shared 30 carefully curated prompts catering to various industries. By offering a diverse array of prompts, this blog post aims to provide valuable resources for professionals seeking to enhance their writing skills or generate fresh ideas within their respective industries. What is ChatGPT Prompt?

Media 52

Media Finance Medical Healthcare 52

Cloudera

MAY 24, 2022

If you have followed my prior blog posts , you know that I have a keen interest in the topic of climate risk modeling and how it can help assess the economic impacts of climate change. Balance sheet management : The second category includes a firm’s external operations — their book of business and investments.

Banking 83

Banking Government Management IT 83

Cloudera

JANUARY 18, 2022

For 2021, the awards will include a new category: People First. Entrants in this category were asked to demonstrate how they have addressed the world’s “most difficult workplace and societal challenges” with solutions aimed at transforming work culture and society as a whole. Quarantines. Remote work.

Banking 91

Banking Recruitment Data Lake Data 91

Christophe Blefari

JULY 3, 2023

In the demo there is also how the SQL UI integrates LLMs generating SQL from a comment. 2 summits ( credits I cropped the image) Hey, since I said I should try to send the newsletter at a specific schedule I did not. Still here the newsletter for last week. With LLMs they will try to answer questions.

SQL 130

SQL Data Kafka AWS 130

Data Engineering Weekly

MAY 16, 2023

I won’t bore you with the importance of data quality in the blog. The industry follows two categories of data processing techniques to handle the trade-off between speed and correctness. Let’s dive into both architectural patterns and see how to adopt them in real-time and batch data processing.

Engineering 110

Engineering Kafka Data Pipeline Data Warehouse 110

Cloudera

DECEMBER 11, 2020

The Data Security and Governance category, at the annual Data Impact Awards, has never been so important. Consider for a moment, just how much 2020 brought about for businesses to deal with. Which was appropriate as we discussed a category that embodies the sudden and seismic step-change in how many of our customers are operating.

Data Lake 98

Data Lake Government Data Security Unstructured Data 98

Cloudera

JANUARY 7, 2021

And in the world of e-commerce, assigning product descriptions to the most fitting product category ensures quality control. . Very few real-world use cases have categories that are eternally set in stone. The reality is that new classes, topics, and categories will likely emerge over time as business needs evolve.

Machine Learning 104

Machine Learning Algorithm Deep Learning Designing 104

Databand.ai

AUGUST 30, 2023

Two of the most important categories are: Data validation tools: These solutions focus on verifying whether input data complies with specific criteria or rules defined by users. There are several types of data testing tools. In this article: Why are data testing tools important?

Data Cleanse 52

Data Cleanse Data Pipeline Datasets Data Validation 52

Data Engineering Weekly

MARCH 30, 2023

Throughout our discussion, we touch on how the Modern Data Stack (MDS) movement has resulted in various specialized tools in areas such as ingestion, cataloging, governance, and quality. We contemplated how tools like DBT might extend their capabilities by tackling other aspects of the data stack, such as ingestion.

Machine Learning 52

Machine Learning Government AWS Data Engineering 52

Cloudera

OCTOBER 6, 2022

CIO blog post : “Digital transformation is a foundational change in how an organization delivers value to its customers.”. Reduce compliance costs: Compliance is a cost of doing business, but how much of that cost is somewhat in your control? Let’s look at some examples for savings potential. Avoid rework wherever possible.

Data Lake 84

Data Lake Machine Learning Data Storage Cloud Computing 84

Cloudera

JANUARY 26, 2024

In this article we will explain how to implement a fine grained access control strategy using Apache Ranger by creating security policies over the metadata management assets stored in Apache Atlas. This allows the organization to comply with government regulations and internal security policies.

Metadata 72

Metadata Data Governance Government Management 72

Scott Logic

OCTOBER 18, 2023

Introduction In my previous blog post I discussed how migrating to the Cloud could help your organisation reach its Net Zero goals. I discussed how shifting your workloads away from on-premises data centres can reduce emissions by allowing you to leverage the expertise of cloud providers and their greater efficiency of scale.

Cloud 87

Cloud AWS BI Accessible 87

Knowledge Hut

JULY 21, 2023

This blog post aims to delve into the realm of data visualization charts, highlighting their significance, various types, recommended practices, and available tools to assist you in harnessing the potential of data visualization. For instance, warehouses frequently keep track of how many accidents occur on the shop floor.

Raw Data 52

Raw Data BI Data Transparency Data 52

Cloudera

FEBRUARY 15, 2023

Here we discuss his background, how he got started at Cloudera, and his recent win at the Cloudera 2022 Global Hackathon. Snatching victory from the jaws of defeat Amogh and his fellow hackathon team members felt the rush of victory after winning Cloudera’s 2022 global hackathon in the product development category.

Software Engineer 80

Software Engineer Software Engineering Engineering Recruitment 80

Cloudera

SEPTEMBER 3, 2020

I think we can all agree that it would be nice to have some good news in 2020, which is why the Data for Good category in this year’s Cloudera Impact Awards is such a pertinent one. It is a category that allows businesses of any type, size or sector, to demonstrate how data can be used to enrich lives and make a positive impact.

Consulting 95

Consulting Education Data Collection Programming 95

Cloudera

AUGUST 20, 2020

The imperative to deliver meaningful change and value through innovation is why the Data for Enterprise AI category at the Data Impact Awards has never been more of the moment than it is today. It’s been a year filled with disruption and uncertainty. One day we were all going to the office, and the next we were working from home.

Banking 120

Banking Deep Learning Data Science Machine Learning 120

Data Engineering Weekly

MARCH 26, 2023

Come and hear talks from companies like StarTree, Confluent, LinkedIn, DoorDash, Imply, and Uber on how they are advancing the state-of-the-art in user-facing analytics delivered instantly. If you follow Data Engineering Weekly, We actively talk about data contracts & how data is a collaboration problem, not just an ETL problem.

Data Engineering 52

Data Engineering Data Engineer Engineering Lambda Architecture 52

Cloudera

AUGUST 12, 2021

In my previous blog post, I shared examples of how data provides the foundation for a modern organization to understand and exceed customers’ expectations. Collecting workforce data as a tool for talent management. Streamlining operations with advanced analytics to preempt issues.

Manufacturing 107

Manufacturing Insurance Consulting Education 107

Picnic Engineering

JULY 24, 2023

Want to learn more about why and how we aim to do that utilizing fruit and festive experiments? Want to learn more about why and how we aim to do that utilizing fruit and festive experiments? For example, they might not capture the full picture of how individual products within a category are doing. Order too much?

Datasets 52

Datasets Architecture Utilities Raw Data 52

Monte Carlo

DECEMBER 27, 2022

It definitely holds true for our Data Downtime blog with these five articles driving a majority of our traffic in 2022. Table of Contents What is a Data Mesh — and How Not to Mesh it Up What is Data Observability? The Pareto Principle , which holds 80% of the results will derive from 20% of the cases, is tough to escape.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Rockset

NOVEMBER 14, 2022

In this blog, we will describe the SSB configuration, results and performance enhancements. Introduction We continuously enhance the performance of Rockset and evaluate different hardware offerings to find the one with the best price-performance for streaming ingestion and low-latency queries. The SSB is a suite of 13 analytical queries.

Metadata 52

Metadata Datasets Cloud Accessible 52

Cloudera

MARCH 4, 2024

In this article we will explain how to implement a fine grained access control strategy using Apache Ranger by creating security policies over the metadata management assets stored in Apache Atlas. This allows the organization to comply with government regulations and internal security policies.

Metadata 52

Metadata Data Governance Government Management 52

Knowledge Hut

OCTOBER 26, 2023

The projects for full-stack developers get divided into three different categories. The full-stack developer projects involve front and back-end developments. The process holds significance because it ensures the flexibility of software applications and web design features by analyzing tasks and activities from the beginning to the end.

Coding 52

Coding Project Food Portfolio 52

Cloudera

JULY 12, 2021

For Data for Good category judge Mike Barlow, Cumulus Partners, DIA finalists represent: “true commitment to the use of data science as a force for good and positive change in critical areas such as healthcare, social justice and climate change.” . Without further ado, here are a few of the insights they have graciously shared. .

Healthcare 105

Healthcare Consulting Media Big Data 105

Lyft Engineering

APRIL 3, 2023

This blog post focuses on the scope and the goals of the recommendation system, and explores some of the most recent changes the Rider team has made to better serve Lyft’s riders. This blog mostly focuses on the mode selector to explain how rankings have evolved in the past years and briefly touches on the post request cross-sells.

Systems 87

Systems Pipeline-centric Machine Learning Transportation 87

Data Engineering Weekly

NOVEMBER 27, 2022

I have a long list of thoughts on this conversation, which might need a blog post on its own. link] Airbnb: How AI Text Generation Models Are Reshaping Customer Support at Airbnb Airbnb takes customer service from a simple customer service response template to the AI text generation model. Sign up free to test out the tool today.

Data Engineering 52

Data Engineering Data Engineer Engineering SQL 52