LinkedIn Engineering

APRIL 20, 2023

On the LinkedIn platform, members from around the world share their knowledge, perspectives, and discuss topics important to them. There are rare occasions when content uploaded on our platform goes undetected by our current defense mechanisms, which may result in sharing across the platform.

Machine Learning 124

Machine Learning Utilities Designing Accessible 124

Data Engineering Podcast

MAY 7, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. What are some of the categories of attributes that need to be managed in a prototypical customer profile? When is Segment Unify the wrong choice?

Pipeline-centric 130

Pipeline-centric Data Lake Machine Learning Data Warehouse 130

Data Engineering Weekly

NOVEMBER 26, 2023

The data industry clearly understands the power of blog storage, and using S3 as a database is not a new concept either. The companies backing Apache Hudi and Iceberg write articles about comparative ACID support in both the platforms here and here. The categories are merging. Data Catalogs is no longer a standalone category.

Data Engineering 70

Data Engineering Data Engineer Engineering Kafka 70

Cloudera

DECEMBER 14, 2021

The category “Data for Enterprise AI” awards companies from around the world that have built and deployed use cases for enterprise-scale machine learning and have industrialized AI to automate, secure, and optimize data-driven decision making and/or applications. In 2021, the finalists under this category include the following organizations.

Transportation 107

Transportation Telecommunication Banking Data Lake 107

DoorDash Engineering

APRIL 26, 2023

In the wake of ChatGPT and Generative AI DoorDash is identifying ways this new technology can enhance the customer’s ordering experience on the platform. In this blog post, we’ll examine how DoorDash hopes to leverage Generative AI and revolutionize the delivery experience. ChatGPT, the version of GPT-3.5

Food 99

Food Unstructured Data Deep Learning SQL 99

Knowledge Hut

APRIL 25, 2024

In this blog post, we will discuss such technologies. Big data technologies can be categorized into four broad categories: batch processing, streaming, NoSQL databases, and data warehouses. Each category has its own strengths and weaknesses, so it's important to select the right tool for the job at hand.

Big Data 52

Big Data Technology NoSQL Hadoop 52

Data Engineering Podcast

SEPTEMBER 4, 2022

Summary Data observability is a product category that has seen massive growth and adoption in recent years. RudderStack helps you build a customer data platform on your warehouse or data lake. A few years ago, the category barely existed – what’s changed? platform design, pipeline design, data usage, etc.)

IT 100

IT Metadata MongoDB MySQL 100

Knowledge Hut

FEBRUARY 28, 2024

Visualize multiple KPIs at once Most organizations use a variety of services to track KPIs and metrics, including marketing automation platforms, email marketing platforms, CRM tools, and more. One of the axes is numerical, while the other shows the measured categories or themes. A line graph can have one or several lines.

BI 52

BI Business Intelligence Data Data Science 52

Scott Logic

MARCH 14, 2024

You can read more about its release in our blog post: Announcing the (proposed) Technology Carbon Standard. The proposed standard aims to provide a consistent approach for classifying and analysing the carbon impact of an organisation’s technology footprint. Previously published content has been relocated into these new information pages.

Technology 52

Technology Manufacturing Transportation Cloud 52

Christophe Blefari

JANUARY 27, 2023

Fun story because one year ago I had an intern working with me on the blog to whom I had given the task to write code that was able to learn from my writings to generate a Data News edition. Data people are creatives 🪄 This is a new category that will appear in the next Data News edition. One year later, different views.

Data 130

Data Algorithm Data Pipeline SQL 130

Knowledge Hut

MARCH 26, 2024

In this blog post, I have shared 30 carefully curated prompts catering to various industries. By offering a diverse array of prompts, this blog post aims to provide valuable resources for professionals seeking to enhance their writing skills or generate fresh ideas within their respective industries.

Media 52

Media Finance Medical Healthcare 52

Christophe Blefari

MARCH 17, 2023

It also means that if you have any questions that you want me to ask you can send them to me beforehand 🫠 Gen AI 🤖 I will create a specific category for generative AI. This blog shows how you can automate it with a CI and definitions in exposures. Seldon is a MLOps platform that helps you deploying models in production.

Data 130

Data SQL Deep Learning Kafka 130

Cloudera

MAY 24, 2022

If you have followed my prior blog posts , you know that I have a keen interest in the topic of climate risk modeling and how it can help assess the economic impacts of climate change. Balance sheet management : The second category includes a firm’s external operations — their book of business and investments.

Banking 85

Banking Government Management IT 85

Data Engineering Podcast

JUNE 19, 2022

Summary Metadata is the lifeblood of your data platform, providing information about what is happening in your systems. A variety of platforms have been developed to capture and analyze that information to great effect, but they are inherently limited in their utility due to their nature as storage systems. In fact, while only 3.5%

Metadata 130

Metadata MongoDB Scala MySQL 130

Cloudera

JULY 11, 2022

As Cloudera CMO David Moxey outlined in his blog , we live in a hybrid data world. We are proud to be included as one of the top six scoring vendors in the current offering category. Especially since Cloudera’s platform can be deployed not only as a data fabric; it is capable of end-to-end multi-functional analytics.

Data Architecture 104

Data Architecture Architecture Data Government 104

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. Can you describe the current architecture of your data platform?

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Netflix Tech

AUGUST 17, 2023

To improve it, we decided to invest in creating a Media Understanding Platform , which enables us to extract meaningful insights from media that we can then surface in our creative tools. These still moments are used by multiple teams across Netflix for artwork (on and off the Netflix platform), Publicity, Marketing, Social teams, and more.

Media 67

Media Algorithm Architecture Building 67

DoorDash Engineering

APRIL 23, 2024

Products from different categories are characterized by different sets of uniquely defining attributes. And attributes such as product category and size enable recommending more relevant substitutions when the original item is out of stock, giving customers a smooth fulfillment experience.

Building 52

Building Retail Manufacturing Unstructured Data 52

Cloudera

JANUARY 26, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. NOTE: The creation of the business metadata attributes is not included in the blog but the steps can be followed here. A business metadata collection called “Project.”

Metadata 73

Metadata Data Governance Government Management 73

RandomTrees

APRIL 18, 2024

However, migrating from one platform to another can be a daunting task, especially when it involves converting existing code. Understanding the Challenge: Imagine a retail giant managing thousands of products across various categories, each with its unique set of attributes.

Coding 52

Coding Retail Metadata Python 52

Christophe Blefari

DECEMBER 3, 2022

Joe Reis launched his Substack — Joe is the co-author of the great The Fundamentals of Data Engineering and his blog already have 2 articles I deeply recommend: No extra credit for complexity & Groundhog Days. Often because we are stuck between in search of engineering stability while keeping fast delivery pace to follow growth.

Kafka 130

Kafka BI Finance Data 130

Databand.ai

AUGUST 30, 2023

Two of the most important categories are: Data validation tools: These solutions focus on verifying whether input data complies with specific criteria or rules defined by users. There are several types of data testing tools. In this article: Why are data testing tools important?

Data Cleanse 52

Data Cleanse Data Pipeline Datasets Data Validation 52

Cloudera

DECEMBER 14, 2022

The company recently migrated to Cloudera Data Platform (CDP ) and CDP Machine Learning to power a number of solutions that have increased operational efficiency, enabled new revenue streams and improved risk management. OCBC also won a Cloudera Data Impact Award 2022 in the Transformation category for the project.

Banking 78

Banking IT Insurance Data Lake 78

Knowledge Hut

SEPTEMBER 25, 2023

In this blog, we will focus on the certifications offered by Amazon AWS. Overview of AWS Certification Amazon Web Services (AWS) is a cloud computing platform offered by Amazon, which provides various services like server hosting, storage, networking, computing, migration, email, mobile app development, and security solutions.

AWS 52

AWS Certification Amazon Web Services Cloud Computing 52

Cloudera

OCTOBER 6, 2022

CIO blog post : “Digital transformation is a foundational change in how an organization delivers value to its customers.”. For example, we have some customers using their data platform originally established for compliance initiatives to drive new use cases. We see this consistently in the data platform/data storage space. .

Data Lake 85

Data Lake Machine Learning Data Storage Cloud Computing 85

Cloudera

JUNE 13, 2022

Gartner Peer Insights collects anonymous customer reviews on select product categories. To date, Gartner has collected over 450,000 reviews for 18,000 products in over 425 categories. “CDP is maturing into a good platform. The post Cloudera Recognized as 2022 Gartner® Peer Insights™ appeared first on Cloudera Blog.

Hadoop 71

Hadoop Manufacturing Finance Media 71

Pinterest Engineering

OCTOBER 31, 2023

Harry Zhang, Jiajun Wang, Yi Li, Shunyao Li, Ming Zong, Haniel Martino, Cathy Lu, Quentin Miao, Hao Jiang, James Wen, David Westbrook | Cloud Runtime Team Image Source: [link] Overview Modern compute platforms are foundational to accelerating innovation and running applications more efficiently.

Architecture 95

Architecture Pipeline-centric Accessible Accessibility 95

Netflix Tech

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. Improvements have been seen across all device categories ranging from TVs to mobiles and tablets. A vital aspect of such development is subjective testing with HDR encodes in order to generate training data.

Metadata 100

Metadata Electronics Algorithm Software Engineer 100

Pinterest Engineering

OCTOBER 17, 2023

Charles Wu | Software Engineer; Isabel Tallam | Software Engineer; Kapil Bajaj | Engineering Manager Overview In this blog, we present a pragmatic way of integrating analytics, written in Python, with our distributed anomaly detection platform, written in Java. Each job is load-balanced to a node in the Warden cluster.

Algorithm 86

Algorithm Java Python Software Engineer 86

Cloudera

MARCH 4, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. NOTE: The creation of the business metadata attributes is not included in the blog but the steps can be followed here. A business metadata collection called “Project.”

Metadata 52

Metadata Data Governance Government Management 52

Data Engineering Weekly

MAY 16, 2023

I won’t bore you with the importance of data quality in the blog. The industry follows two categories of data processing techniques to handle the trade-off between speed and correctness. In the second part, we will focus on architectural patterns to implement data quality from a data contract perspective.

Engineering 110

Engineering Kafka Data Pipeline Data Warehouse 110

Monte Carlo

DECEMBER 27, 2022

It definitely holds true for our Data Downtime blog with these five articles driving a majority of our traffic in 2022. Data contracts: 7 Lessons from GoCardless’ Implementation How to Build Your Own Data Platform The common thread: The data engineering world moves pretty fast, blink and you just might miss it.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Cloudera

DECEMBER 21, 2020

One category that highlighted some fantastic examples of customers doing just that, was The Enterprise Data Cloud award. Known previously as the ‘Data Anywhere’ category, the newly titled ‘Enterprise Data Cloud’ category better represents the move that our customers are making; away from acknowledging the ability to have data ‘anywhere’.

Cloud 93

Cloud Data Data Architecture Machine Learning 93

Cloudera

DECEMBER 9, 2021

The finalists in the “Industry Transformation” category are MTN, National Payments Corporation of India (NPCI), Sberbank, and Bank Negara Indonesia (BNI). MTN leveraged a data lake powered by the EVA (Enterprise Value Analytics) platform and deployed Cloudera CDP to unify data access across its operations.

Banking 82

Banking Data Lake Retail Finance 82

Cloudera

NOVEMBER 29, 2021

The category Data Lifecycle Connection highlights organizations that work with multiple parts of the data lifecycle to collect, enrich, report, serve, and predict. . In 2021, the finalists under this category include the following organizations from around the world. …and congratulations to the winner: Carrefour Spain.

Data Lake 77

Data Lake Telecommunication Retail Data 77

Cloudera

DECEMBER 11, 2020

The Data Security and Governance category, at the annual Data Impact Awards, has never been so important. But there are organizations that are already ahead of the game when it comes to Security and Governance, and they were recognized and celebrated in our seventh category of the Awards this year. .

Data Lake 98

Data Lake Government Data Security Unstructured Data 98

Data Engineering Weekly

NOVEMBER 27, 2022

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. I have a long list of thoughts on this conversation, which might need a blog post on its own.

Data Engineering 52

Data Engineering Data Engineer Engineering SQL 52