Scott Logic

MARCH 14, 2024

You can read more about its release in our blog post: Announcing the (proposed) Technology Carbon Standard. It covers manufacturer-provided life cycle emissions data, including Life Cycle Assessments (LCAs) and Product Carbon Footprint (PCF) reports.

Technology 52

Technology Manufacturing Transportation Cloud 52

Christophe Blefari

JANUARY 27, 2023

Fun story because one year ago I had an intern working with me on the blog to whom I had given the task to write code that was able to learn from my writings to generate a Data News edition. Awesome raw ideas with sharks circling around waiting for a new productivity highness. One year later, different views. It gives ideas.

Data 130

Data Algorithm Data Pipeline SQL 130

Knowledge Hut

MARCH 26, 2024

In this blog post, I have shared 30 carefully curated prompts catering to various industries. By offering a diverse array of prompts, this blog post aims to provide valuable resources for professionals seeking to enhance their writing skills or generate fresh ideas within their respective industries.

Media 52

Media Finance Medical Healthcare 52

Data Engineering Podcast

SEPTEMBER 4, 2022

Summary Data observability is a product category that has seen massive growth and adoption in recent years. With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

IT 100

IT Metadata MongoDB MySQL 100

DoorDash Engineering

APRIL 26, 2023

In the wake of ChatGPT and Generative AI DoorDash is identifying ways this new technology can enhance the customer’s ordering experience on the platform. In this blog post, we’ll examine how DoorDash hopes to leverage Generative AI and revolutionize the delivery experience. Subscribe for weekly updates 5.

Food 99

Food Unstructured Data Deep Learning SQL 99

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. The biggest challenge with modern data systems is understanding what data you have, where it is located, and who is using it.

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Knowledge Hut

FEBRUARY 28, 2024

Visualize multiple KPIs at once Most organizations use a variety of services to track KPIs and metrics, including marketing automation platforms, email marketing platforms, CRM tools, and more. To some extent, I am saying that dashboard development is like product development. Bar charts are used to compare data along two axes.

BI 52

BI Business Intelligence Data Data Science 52

Data Engineering Podcast

JUNE 19, 2022

Summary Metadata is the lifeblood of your data platform, providing information about what is happening in your systems. A variety of platforms have been developed to capture and analyze that information to great effect, but they are inherently limited in their utility due to their nature as storage systems. In fact, while only 3.5%

Metadata 130

Metadata MongoDB Scala MySQL 130

RandomTrees

APRIL 18, 2024

However, migrating from one platform to another can be a daunting task, especially when it involves converting existing code. Understanding the Challenge: Imagine a retail giant managing thousands of products across various categories, each with its unique set of attributes.

Coding 52

Coding Retail Metadata Python 52

Knowledge Hut

APRIL 25, 2024

In this blog post, we will discuss such technologies. Big data technologies can be categorized into four broad categories: batch processing, streaming, NoSQL databases, and data warehouses. Each category has its own strengths and weaknesses, so it's important to select the right tool for the job at hand.

Big Data 64

Big Data Technology NoSQL Hadoop 64

Christophe Blefari

MARCH 17, 2023

It also means that if you have any questions that you want me to ask you can send them to me beforehand 🫠 Gen AI 🤖 I will create a specific category for generative AI. This blog shows how you can automate it with a CI and definitions in exposures. Seldon is a MLOps platform that helps you deploying models in production.

Data 130

Data SQL Deep Learning Kafka 130

Pinterest Engineering

OCTOBER 17, 2023

Charles Wu | Software Engineer; Isabel Tallam | Software Engineer; Kapil Bajaj | Engineering Manager Overview In this blog, we present a pragmatic way of integrating analytics, written in Python, with our distributed anomaly detection platform, written in Java. Each job is load-balanced to a node in the Warden cluster.

Algorithm 86

Algorithm Java Python Software Engineer 86

Cloudera

JUNE 13, 2022

Gartner Peer Insights collects anonymous customer reviews on select product categories. To date, Gartner has collected over 450,000 reviews for 18,000 products in over 425 categories. “CDP is maturing into a good platform. How does Gartner determine where vendors fall? . We take your feedback to heart.

Hadoop 71

Hadoop Manufacturing Finance Media 71

Databand.ai

AUGUST 30, 2023

Two of the most important categories are: Data validation tools: These solutions focus on verifying whether input data complies with specific criteria or rules defined by users. There are several types of data testing tools. In this article: Why are data testing tools important?

Data Cleanse 52

Data Cleanse Data Pipeline Datasets Data Validation 52

Pinterest Engineering

OCTOBER 31, 2023

Harry Zhang, Jiajun Wang, Yi Li, Shunyao Li, Ming Zong, Haniel Martino, Cathy Lu, Quentin Miao, Hao Jiang, James Wen, David Westbrook | Cloud Runtime Team Image Source: [link] Overview Modern compute platforms are foundational to accelerating innovation and running applications more efficiently.

Architecture 95

Architecture Pipeline-centric Accessible Accessibility 95

Rockset

MARCH 18, 2024

In this blog, we’ll discuss how RAG fits into the paradigm of real-time data processing and show an example product recommendation application using both Kafka and Flink on Confluent Cloud together with Rockset. As the product catalog is constantly being added to, generating new embeddings and indexing them happens in real time.

Cloud 64

Cloud Building Metadata Kafka 64

Data Engineering Weekly

MAY 16, 2023

I won’t bore you with the importance of data quality in the blog. The industry follows two categories of data processing techniques to handle the trade-off between speed and correctness. If the Audit step succeeds, the data in the staging environment gets copied to the production. Why is Data Quality Expensive?

Engineering 110

Engineering Kafka Data Pipeline Data Warehouse 110

Snowflake

MAY 8, 2023

Snowflake maintains its commitment to customers and ongoing platform improvements. Acceldata’s data observability platform empowers data teams with deep insights into compute, spend, data reliability, pipelines, and users. Some of these partner solutions build upon previously mentioned approaches to analyze queries in bulk.

Technology 105

Technology SQL BI Utilities 105

Pinterest Engineering

MAY 25, 2023

As technology becomes increasingly integrated into the daily lives of billions of people globally, it is crucial for online platforms to reflect the diverse communities they serve. Improving representation online can facilitate content discovery for a more diverse user base by reflecting their inclusion on the platform.

Utilities 82

Utilities Food Machine Learning Algorithm 82

Pinterest Engineering

SEPTEMBER 20, 2023

“Everyone” has been the north star for our Inclusive AI and Inclusive Product teams. These teams work together to ensure algorithmic fairness, inclusive design, and representation are an integral part of our platform and product experience. In 2018, Pinterest announced the skin tone signal and skin tone ranges.

Building 84

Building Pipeline-centric Machine Learning Datasets 84

Data Engineering Weekly

NOVEMBER 27, 2022

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. I have a long list of thoughts on this conversation, which might need a blog post on its own.

Data Engineering 52

Data Engineering Data Engineer Engineering SQL 52

Databand.ai

AUGUST 30, 2023

Two of the most important categories are: Data validation tools: These solutions focus on verifying whether input data complies with specific criteria or rules defined by users. There are several types of data testing tools. The post Data Testing Tools: Key Capabilities and 6 Tools You Should Know appeared first on Databand.

Data Cleanse 52

Data Cleanse Data Validation Data Pipeline Datasets 52

Cloudera

JULY 21, 2021

This is the category for Cloudera customers whose IT administration provides the agility business requires, without putting organizations at risk, and who are embracing a pattern of technology adoption that prioritizes speed. In its first three months, the investment product attracted 450,000 users.

Insurance 93

Insurance Hospitality Banking Data 93

Cloudera

MAY 24, 2022

? ?. At Cloudera we’re building the world’s only hybrid data platform that’s founded on open source and truly hybrid. Cloudera continues to innovate at pace, providing new and exciting features across Cloudera Data Platform (CDP) that many of our customers can’t wait to get their hands on. What do we mean by truly hybrid?

Designing 76

Designing Cloud Project Technology 76

Netflix Tech

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. We A/B tested HDR-DO encodes in production in Q3-Q4 2021, followed by improving the ladder generation algorithm further in early 2022. Improvements have been seen across all device categories ranging from TVs to mobiles and tablets.

Metadata 100

Metadata Electronics Algorithm Software Engineer 100

Cloudera

DECEMBER 6, 2021

As a result of their accomplishments, Cloudera has named these organizations as finalists for the 2021 Cloudera Data Impact Awards in the “Cloud Innovation” category. . A Merck subsidiary, Ares Trading SA provides medical products and personalized treatments for serious diseases. …and congratulations to the winner: ExxonMobil.

Architecture 80

Architecture Cloud Medical Electronics 80

Knowledge Hut

OCTOBER 27, 2023

In this blog, we will cover the top 5 data science projects in python you could do to elevate your skills and knowledge in this competitive Data Science market. To prepare final product from a blast furnace, we need to control certain parameters like heat loss, hot metal temperature, tensile strength, elongation, and so on.

Data Science 52

Data Science Python Project Manufacturing 52

Data Engineering Weekly

MARCH 26, 2023

71% of respondents rated data team productivity and agility positively, while data ownership ranked as a top concern for most. The blog highlights that the job is not just writing SQL but providing a strategic business solution for an organization. Analytics leaders are most concerned with stakeholder needs.

Data Engineering 52

Data Engineering Data Engineer Engineering Lambda Architecture 52

Snowflake

JANUARY 26, 2023

Recent updates to leading security products enable them to run directly on top of an enterprise’s existing cloud data platform. The economics of the modern data stack, with the cloud data platform at its core, will drive savings. Better data analytics capabilities will translate to higher fidelity insights for security teams.

Retail 61

Retail Healthcare Unstructured Data Media 61

Cloudera

AUGUST 12, 2021

In my previous blog post, I shared examples of how data provides the foundation for a modern organization to understand and exceed customers’ expectations. A 2020 retention report by the Work Institute revealed that over 42 million employees in the US left their jobs voluntarily in 2019, and this trend appeared to be increasing. Conclusion.

Manufacturing 107

Manufacturing Insurance Consulting Education 107

LinkedIn Engineering

JULY 19, 2023

As a result, data scientists, data engineers, and product engineers have to juggle multiple systems and manage tables individually. It adds toil in terms of complexity and potential inconsistencies that can serve as distractions to the developers' core product focus.

Big Data 78

Big Data Data Management Management Metadata 78

LinkedIn Engineering

OCTOBER 19, 2023

Authors: Bingfeng Xia and Xinyu Liu Background At LinkedIn, Apache Beam plays a pivotal role in stream processing infrastructures that process over 4 trillion events daily through more than 3,000 pipelines across multiple production data centers. More details about this use case can be found on LinkedIn’s engineering blog.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Cloudera

OCTOBER 13, 2020

Recently, my colleague published a blog build on your investment by Migrating or Upgrading to CDP Data Center , which articulates great CDP Private Cloud Base features. This blog focuses on the process to accelerate your CDP journey to CDP Private Cloud Base for both professional services engagements and self-service upgrades.

Professional Services 109

Professional Services Cloud Relational Database Utilities 109

Monte Carlo

JULY 19, 2023

Here’s what data leaders say are the 5 must-have layers of your data platform to drive data adoption – and ROI – across your business. Its powerful selection of tooling components combine to create a single synchronized and extensible data platform with each layer serving a unique function of the data pipeline.

Building 96

Building Business Intelligence Cloud Storage BI 96

Data Engineering Weekly

APRIL 9, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make collecting data from every application, website, and SaaS platform easy, then activating it in your warehouse and business tools. Chinese citizens are among those who feel the most positively about AI products and services.

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Cloudera

NOVEMBER 24, 2020

This year, OVO has done just that, setting itself apart to win the Data Champions category at our 2020 Data Impact Awards. This category recognizes organizations whose IT administration provides the agility a business requires, without putting the business at risk, and embraces a pattern of technology adoption that prioritizes speed.

Banking 72

Banking Insurance Finance Data 72

Edureka

MARCH 14, 2023

In this blog, we will complete an overview of the topic metaverse and start by understanding the following topics. Attending virtual concerts or athletic events, exploring virtual worlds, or even having business meetings in virtual boardrooms might all fall under this category. What is the Metaverse? Is it a new concept?

Entertainment 94

Entertainment Education Media Cloud Computing 94