Pinterest Engineering

OCTOBER 31, 2023

In this article, we discuss the PinCompute primitives, architecture, control plane and data plane capabilities, and showcase the value that PinCompute has delivered for innovation and efficiency at Pinterest. Architecture PinCompute is a regional Platform-as-a-Service (PaaS) that builds on top of Kubernetes.

Architecture 96

Architecture Pipeline-centric Accessible Accessibility 96

Data Engineering Weekly

JANUARY 21, 2024

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Interesting article on the impact of search engine optimization (SEO) on the quality of search engine results. Visit rudderstack.com to learn more.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Databand.ai

AUGUST 30, 2023

DataOps is a collaborative approach to data management that combines the agility of DevOps with the power of data analytics. It aims to streamline data ingestion, processing, and analytics by automating and integrating various data workflows. As a result, they can be slow, inefficient, and prone to errors.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

Databand.ai

MAY 30, 2023

6 Pillars of Data Quality and How to Improve Your Data Eric Jones May 30, 2023 What Is Data Quality? Data quality refers to the degree of accuracy, consistency, completeness, reliability, and relevance of the data collected, stored, and used within an organization or a specific context.

Data Cleanse 85

Data Cleanse Datasets Data Governance Data Validation 85

Snowflake

AUGUST 16, 2023

Read our Summit recap blog for highlights across industries or watch Summit sessions now on-demand. Applications Snowflake Native App Framework now available in AWS – public preview Snowflake Native Apps are an entirely new way to put data to work. If you missed out, not to worry! Learn more here. Learn more here.

Scala 52

Scala Transportation Kafka Data Lake 52

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. What is a Data Mesh and how does it work? With Striim’s enterprise-grade platform, companies can deploy and manage their data mesh with ease.

Architecture 52

Architecture Generalist Government Datasets 52

Databand.ai

DECEMBER 13, 2022

The Top 25 Data Engineering Influencers and Content Creators on LinkedIn Ryan Yackel 2022-12-13 10:23:19 Interested in data engineering? LinkedIn is full of influencers sharing new ideas and sparking conversations on all kinds of topics, and data engineering is no exception. You’ve come to the right place.

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Cloudera

JANUARY 20, 2021

Most of what is written though has to do with the enabling technology platforms (cloud or edge or point solutions like data warehouses) or use cases that are driving these benefits (predictive analytics applied to preventive maintenance, financial institution’s fraud detection, or predictive health monitoring as examples) not the underlying data.

Manufacturing 105

Manufacturing Data Warehouse Kafka Retail 105

Cloudera

JULY 29, 2021

Securely protecting healthcare data is critical for your organization’s success, whether data is ingested, streamed and stored in a data platform that runs in the public, private or hybrid cloud. Public, private, hybrid or on-premise data management platform. Be The Change.

Healthcare 100

Healthcare Unstructured Data Government Machine Learning 100

Cloudera

DECEMBER 17, 2021

As a Principal Solutions Engineer, he says his core responsibility is “to take Cloudera’s latest and greatest technology and meet a customer’s complex business requirements, across the data lifecycle, on any cloud or the datacenter.”. He shares a sentiment we hear time and time again.

Engineering 91

Engineering Telecommunication Big Data Machine Learning 91

Workfall

JANUARY 24, 2023

Reading Time: 6 minutes With reference to the previous blog on state management with React and Redux , we will look at state management in an Angular 15 application using the NgRx store in this blog. In this blog, we will cover: What is RxJS? Analogy What is NgRx Store? Hands-on Conclusion What is RxJS? What is NgRx Store?

Coding 52

Coding Utilities Project Programming 52

Data Engineering Weekly

APRIL 23, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make collecting data from every application, website, and SaaS platform easy, then activating it in your warehouse and business tools. 🍒 We'll send exclusive The Data Stack Show swag just for participating!

Data Engineering 52

Data Engineering Data Engineer Engineering Data Pipeline 52

Monte Carlo

AUGUST 31, 2023

Data is a priority for your CEO, as it often is for digital-first companies, and she is fluent in the latest and greatest business intelligence tools. But what happens when the data is wrong? What about a frantic email from your CTO about “duplicate data” in a business intelligence dashboard? The root of data downtime?

Data Lake 52

Data Lake Data Pipeline Unstructured Data Data Warehouse 52

Snowflake

MARCH 21, 2023

In February, Snowflake launched new features around streaming data ingestion and data governance and improved SQL experience and performance, with enhancements to Search Optimization Service and more. Read on to learn about everything new announced in February. Learn more here.

Retail 72

Retail Healthcare Data Ingestion Consulting 72

DoorDash Engineering

OCTOBER 17, 2023

Yet as powerful as experimentation is, its integrity can be compromised by overlooked details and unforeseen challenges. SRM represents one of the most egregious data quality issues in A/B tests because it fundamentally compromises the basic assumption of random assignment. At DoorDash, we constantly innovate and experiment.To

Education 87

Education Kafka Algorithm Data Warehouse 87

DataKitchen

JANUARY 3, 2022

Their business unit colleagues ask an endless stream of urgent questions that require analytic insights. Data tables from IT and other data sources require a large amount of repetitive, manual work to be used in analytics. The data analytics function in large enterprises is generally distributed across departments and roles.

Business Analyst 98

Business Analyst Data Lake Consulting Data Analytics 98

Cloudera

AUGUST 31, 2021

Cloudera and Accenture demonstrate strength in their relationship with an accelerator called the Smart Data Transition Toolkit for migration of legacy data warehouses into Cloudera Data Platform. Accenture’s Smart Data Transition Toolkit . Are you looking for your data warehouse to support the hybrid multi-cloud?

Data Warehouse 80

Data Warehouse Database-centric Metadata Cloud 80

Big Data Tools

MAY 19, 2022

I’ll offer my impressions of recent developments in the data engineering space and highlight new ideas from the wider community. Here’s what’s happening in the world of data engineering right now. Apache Hudi 1.11.0 – This release of the well-known data lake has added many interesting changes. RocketMQ Streams 1.0.1

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Big Data Tools

MAY 19, 2022

I’ll offer my impressions of recent developments in the data engineering space and highlight new ideas from the wider community. Here’s what’s happening in the world of data engineering right now. Apache Hudi 1.11.0 – This release of the well-known data lake has added many interesting changes. RocketMQ Streams 1.0.1

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Maxime Beauchemin

JANUARY 20, 2017

By the time I left in 2013, I was a data engineer. We were data engineers! Data Engineering? Data science as a discipline was going through its adolescence of self-affirming and defining itself. At the same time, data engineering was the slightly younger sibling, but it was going through something similar.

Data Engineering 130

Data Engineering Data Engineer Engineering ETL Tools 130

DareData

NOVEMBER 28, 2023

In today's data-driven world, machine learning has emerged as a transformative force, empowering organizations to extract valuable insights from vast amounts of data. As the scope of the models and the data continues to scale, the role of a Data Scientist has evolved accordingly in the last years. But that is not all!

Data Science 52

Data Science Medical Machine Learning Data 52

DoorDash Engineering

AUGUST 1, 2023

Just when we most needed observability data, the system would leave us in the lurch. StatsD clients send data over UDP, which provides no guarantee of delivery at the transport layer making proxy outages transparent to downstream servers. We’ll briefly introduce StatD’s history before diving into those specific issues.

AWS 82

AWS Transportation Programming Language Government 82

Cloudera

APRIL 27, 2021

All of these businesses are awash with data. They are using that data to optimize operations, troubleshoot operational and customer problems, and understand as much as they can about their customers’ consumption, buying patterns and preferences. The impact of siloed data. Can they interpret what they’re seeing?

Telecommunication 65

Telecommunication Entertainment Media Government 65

DataKitchen

JUNE 7, 2021

When we started sharing the “ Seven Steps of DataOps ” a few years ago, our intent was (and still is) to evangelize DataOps as a free and open methodology. This is a common question that we hear from our conversations with data scientists, engineers and analysts. What can you do? How can one get started given these limitations?

Coding 52

Coding IT Data Pipeline Data Analytics 52

Knowledge Hut

JUNE 30, 2023

The demand for experienced data engineers continuously expands in today's data-driven environment. Books on data engineering serve as essential resources to guide you through the vast terrain of data engineering. What is Data Engineering? Who are Data Engineers? Who are Data Engineers?

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

Edureka

JULY 18, 2023

In this blog, we delve into the fascinating sphere of AI and its practical implications, showcasing how this revolutionary technology has quietly permeated the fabric of our existence. This blog will show you the Top 8 artificial intelligence examples.

Entertainment 40

Entertainment Algorithm Media Utilities 40

ProjectPro

DECEMBER 7, 2021

Data pipelines are a significant part of the big data domain, and every professional working or willing to work in this field must have extensive knowledge of them. As data is expanding exponentially, organizations struggle to harness digital information's power for different business use cases. What is a Big Data Pipeline?

Data Pipeline 52

Data Pipeline Architecture Kafka AWS 52

DataKitchen

MARCH 16, 2023

How to measure your data analytics team? So it’s Monday, and you lead a data analytics team of perhaps 30 people. Like most leaders of data analytic teams, you have been doing very little to quantify your team’s success. What should be in that report about your data team? Introduction. You’ve got a new boss.

Data Analytics 52

Data Analytics Manufacturing Data Process 52

Rockset

APRIL 18, 2023

In real-time ML, the freshness of the features, the serving latency, and the uptime and availability of the data pipeline and model matter. To better serve real-time machine learning, Rockset integrates with the Feast Feature Store which acts as a centralized platform for deploying, monitoring and managing production ML features.

Machine Learning 52

Machine Learning Datasets Database Data Pipeline 52

Cloudera

NOVEMBER 15, 2021

The word “data” is ubiquitous in narratives of the modern world. And data, the thing itself, is vital to the functioning of that world. This blog discusses quantifications, types, and implications of data. Quantifications of data. Quantifications of data. So data is big and growing.

Unstructured Data 86

Unstructured Data Pipeline-centric Database-centric Entertainment 86

Knowledge Hut

OCTOBER 29, 2023

From machine learning algorithms to data mining techniques, these ideas are sure to challenge and engage you. Till then, pick a topic from this blog and get started on your next great computer science project. Investigating the security risks associated with hospital data. Creating a database to store patient information.

Computer Science 111

Computer Science Coding Project Hospitality 111

Data Engineering Weekly

OCTOBER 23, 2022

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. Hello Data Friends, Welcome to another edition of Data Engineering Weekly.

Data Engineering 52

Data Engineering Data Engineer Engineering Deep Learning 52

Cloudera

MARCH 13, 2019

The Data Heroes initiative is one of the ways that we recognize customers who achieve outstanding results with Cloudera technologies. The Data Visionary, Data Scientist, Data Architect, and HCC Community Champion awards are given out to organizations transforming their businesses through Big Data.

Data Architect 68

Data Architect Banking Utilities Deep Learning 68

AltexSoft

FEBRUARY 11, 2023

Data is now one of the most valuable assets for any kind of business. The 11th annual survey of Chief Data Officers (CDOs) and Chief Data and Analytics Officers reveals 82 percent of organizations are planning to increase their investments in data modernization in 2023. What is a data architect?

Data Architect 87

Data Architect Certification Generalist Big Data 87

Edureka

FEBRUARY 18, 2023

In today’s fast-paced business world, data is essential to gain a competitive edge. BI can help organizations turn raw data into meaningful insights, enabling better decision-making, optimizing operations, enhancing customer experiences, and providing a strategic advantage. How BI Processes Data?

Business Intelligence 52

Business Intelligence BI SQL Data Analysis 52

Monte Carlo

FEBRUARY 16, 2023

Many of these structures have been adopted and adapted by data engineering teams in their eternal quest to build more reliable data systems. Data reliability is important for us to meet those commitments as well as financial regulations,” said Dan Lameyer, a member of the Mercari DRE team.

Engineering 52

Engineering Data Pipeline Datasets Google Cloud 52

Big Data Tools

OCTOBER 5, 2021

As data engineers, let’s follow their lead and learn something new, too! Here’s what’s happening in data engineering right now. Zingg 0.3.0 – MDM (Master Data Management) is tricky. You have multiple sources of data and you have to define what is true and what is not. Are Tim Burton, Timothy Burton, and T.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52