phData: Data Engineering

FEBRUARY 15, 2024

With the advent of cloud data warehouses and the ability to (seemingly) infinitely scale analytics on an organization’s data, centralizing and using that data to discover what drives customer engagement has become a top priority for executives across all industries and verticals. What Are the Challenges With Fan 360?

Entertainment 52

Entertainment Media Data Warehouse Data Collection 52

Snowflake

DECEMBER 14, 2023

Whereas the existing portfolio of AI tools had targeted the more technically minded like data scientists and engineers, new tools like ChatGPT handed the keys to the kingdom to anyone who could type a question. Gen AI has literally democratized not the data itself but the insights and information derived from it.

Pharmaceutical 96

Pharmaceutical Food Government Transportation 96

Cloudera

OCTOBER 26, 2023

We’ve all heard that data helps businesses make better decisions. This isn’t just speculation: research shows that companies who use data to drive decision making increase revenues by an average of more than 8%, are 23 times more likely to attract new customers, and are 19 times more likely to be profitable as a result. The good news?

Building 78

Building Data Media Data Science 78

Robinhood

FEBRUARY 20, 2024

In this blog, I’ll dive into one of our most recent marketing campaigns to share what it looks like under the hood when our team works on designing, producing, and shipping a large campaign from start to finish. A few key data points for the nerds reading this: Gold customers earn a high APY on their uninvested cash (4.9%

Banking 68

Banking Designing Insurance Programming 68

LinkedIn Engineering

DECEMBER 20, 2023

This blog post delves into the AutoML framework for LinkedIn’s content abuse detection platform and its role in improving and fortifying content moderation systems at LinkedIn. What is AutoML? It was originally conceived as a way to democratize machine learning for non-ML specialists.

Machine Learning 90

Machine Learning Datasets Algorithm Architecture 90

Cloudera

MARCH 27, 2023

The best description of untrusted data I’ve ever heard is, “We all attend the QBR – Sales, Marketing, Finance – and present quarterly results, except the Sales reports and numbers don’t match Marketing numbers and neither match Finance reports. If your numbers don’t conform to his data definitions, you’re up the QBR without a shovel.

Finance 76

Finance Datasets Data Governance Government 76

Cloudera

MAY 3, 2021

We have an even more simple view that to achieve these solid and high return on investment outputs, you need to focus on data – as business insights, decisions, prescriptive and preventative recommendations start and end with data. . data is generated – at the Edge. Benefits of Streaming Data for Business Owners.

Scala 102

Scala Retail Java Data Lake 102

Data Engineering Weekly

JULY 23, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles, so you can quickly ship actionable, enriched data to every downstream team. Source: [link] But what features are important if you want to buy a new GPU?

Data Engineering 52

Data Engineering Data Engineer Engineering Deep Learning 52

Cloudera

JULY 12, 2022

Cloudera has appointed Remus Lim as vice president of Asia Pacific and Japan, to drive adoption of the hybrid data platform across the region and support customers in their journey to become more data-driven. What drew you to the tech space and attracted you to the roles you’ve held? Was it any different after I started?

Cloud 105

Cloud Business Intelligence Data Architecture Machine Learning 105

Data Engineering Weekly

MAY 7, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make collecting data from every application, website, and SaaS platform easy, then activating it in your warehouse and business tools. However, Data Contract is a productivity software. Not all data is valuable.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52

Data Engineering Weekly

SEPTEMBER 3, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. 🎤 And guess what? See how it works today. or "Don't reinvent the wheel.".

Data Engineering 73

Data Engineering Data Engineer Engineering Data 73

Cloudera

OCTOBER 12, 2020

Eventador, based in Austin, TX, was founded by Erik Beebe and Kenny Gorman in 2016 to address a fundamental business problem – make it simpler to build streaming applications built on real-time data. Eventador simplifies the process by allowing users to use SQL to query streams of real-time data without implementing complex code.

Cloud 131

Cloud Process Scala Kafka 131

RandomTrees

APRIL 30, 2024

In this ever-changing world of healthcare, technological innovations are continuously changing the definition of what is possible. They can also foresee disease advancement according to imaging data. Generative AI technologies enable remote patient monitoring systems that continuously collect and analyze health data.

Medical 52

Medical Healthcare Algorithm Electronics 52

Cloudera

OCTOBER 7, 2021

In this blog, I will demonstrate the value of Cloudera DataFlow (CDF) , the edge-to-cloud streaming data platform available on the Cloudera Data Platform (CDP) , as a Data integration and Democratization fabric. Introduction to the Data Mesh Architecture and its Required Capabilities. Introduction.

Architecture 125

Architecture Metadata Government Kafka 125

RandomTrees

APRIL 29, 2024

Maximizing Efficiency Through Data Insights: At the core of energy protection lies the idea of the smart grid – a smart power network that proficiently screens and controls the flow of power. To find innovative solutions to preserve energy has become more critical than ever.

Utilities 52

Utilities Algorithm Machine Learning Programming 52

Cloudera

JUNE 16, 2022

The ability to perform analytics on data as it is created and collected (a.k.a. real-time data streams) and generate immediate insights for faster decision making provides a competitive edge for organizations. . CSP was recently recognized as a leader in the 2022 GigaOm Radar for Streaming Data Platforms report.

Kafka 88

Kafka Manufacturing Data Lake SQL 88

Data Engineering Weekly

JULY 9, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork, and SQL grunt work out of building complete customer profiles, so you can quickly ship actionable, enriched data to every downstream team. Andrew Jones: Data Contracts - the book. See how it works today.

Data Engineering 52

Data Engineering Data Engineer Engineering Lambda Architecture 52

Robinhood

MARCH 28, 2023

Our Robinhoodies are helping to democratize finance and give people the tools they need to achieve their financial goals. We are constantly exploring new ideas and pushing the boundaries of what’s possible to make a real impact on people’s lives — truly transforming the future of finance.

Building 76

Building Banking Finance Consulting 76

Cloudera

MARCH 29, 2021

Their flagship product, SQL Stream Builder, made access to real-time data streams easily possible with just SQL (Structured Query Language). Cloudera’s customers were struggling to solve the same challenge – to query high-volumes of real-time data streams with something as simple as SQL. What is SQL Stream Builder?

SQL 113

SQL Scala Manufacturing Java 113

Cloudera

JULY 20, 2021

But what would you say to your shareholders when they found out your competitors’ market capitalization grew 35%? Technology drives the ability to use enterprise data to make choices, decisions and investments – which then produce competitive advantage.

Retail 105

Retail Telecommunication Manufacturing Insurance 105

Monte Carlo

SEPTEMBER 12, 2023

Now, imagine all the data powering that platform. We had to know how their data team made it happen, especially in such a short span of time, so we recently sat down with Engineering Director Emmanuel Fuentes to learn more. They were among Whatnot’s earliest employees and together built the data foundation for the company.

Machine Learning 52

Machine Learning Data Entertainment SQL 52

Data Engineering Weekly

APRIL 13, 2023

DBT Reimagined by Pedram Navid Pedram's Data Based dbt Reimagined It was late one night, and I couldn’t sleep, so I started falling into a fantasy where constraints weren’t real and anything was possible. I started to think to myself: what would a future dbt look like? Let’s explore the fantasy together.

Programming Language 52

Programming Language BI SQL Banking 52

Cloudera

JANUARY 25, 2022

The start of a new year is a perfect time to reflect on what was accomplished and look forward, re-evaluate what we can do better. Dashboards often look in the rearview mirror, focusing on historical data and not on future insights – ie, predictive analytics. . Change, although difficult at first, can also be very rewarding.

Datasets 91

Datasets Machine Learning Accessible Accessibility 91

Data Engineering Weekly

AUGUST 27, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork, and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. 🎤 And guess what? Does that will data teams shrink in size?

Data Engineering 52

Data Engineering Data Engineer Engineering Machine Learning 52

Cloudera

MAY 25, 2021

Data and analytics have become second nature to most businesses, but merely having access to the vast volumes of data from these devices will no longer suffice. Leading enterprises realize that the speed of data presents a new frontier for competitive differentiation.

SQL 73

SQL Insurance Electronics Scala 73

Cloudera

MARCH 2, 2021

However, in the typical enterprise, only a small team has the core skills needed to gain access and create value from streams of data. However, in the typical enterprise, only a small team has the core skills needed to gain access and create value from streams of data. What do you mean by democratizing? A rare breed.

SQL 114

SQL Data Lake Java Scala 114

Data Engineering Weekly

APRIL 9, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make collecting data from every application, website, and SaaS platform easy, then activating it in your warehouse and business tools. The blog also discusses two burning questions everyone is debating. Americans.not so much.

Data Engineering 52

Data Engineering Data Engineer Engineering AWS 52

Snowflake

APRIL 20, 2023

In March, Snowflake released a number of exciting new capabilities including Python Worksheets, the Snowflake Connector for ServiceNow, and expanded support for geospatial data. Snowflake Connectors Snowflake Connector for ServiceNow – public preview Ingest data from ServiceNow into Snowflake automatically. Learn more.

Medical 56

Medical Retail Python Pharmaceutical 56

Robinhood

MARCH 28, 2023

Our Robinhoodies are helping to democratize finance and give people the tools they need to achieve their financial goals. We are constantly exploring new ideas and pushing the boundaries of what’s possible to make a real impact on people’s lives — truly transforming the future of finance.

Building 52

Building Banking Finance Consulting 52

LinkedIn Engineering

DECEMBER 13, 2022

In this blog post, we share more details on how LinkedIn performs observational causal inference at scale using our Ocelot platform. What is observational causal inference? The tables show sample data for the control and treatment groups respectively. We cannot randomize who is impacted by the change and who is not.

Data Preparation 55

Data Preparation Data Science Designing Data Pipeline 55

Cloudera

OCTOBER 6, 2020

This is a guest blog post, authored by John Zantey, Director and Co-founder, Qabsu. I know of companies that have been perpetually “doing cloud” for 10 years, but very few that have “done cloud” in a way that democratises and makes data accessible, with minimal pain points. We know companies are gathering more data than ever.

Bytes 66

Bytes Education Cloud Data 66

Monte Carlo

MAY 19, 2022

In his seminal 2017 blog post, The Downfall of the Data Engineer , Maxime Beauchemin wrote that the data engineer had the worst seat at the table. So, if the data engineer no longer has the worst seat at the table, who then on the data team has inherited this unfortunate title? Quite the opposite in fact.

Generalist 52

Generalist Data Governance Government Metadata 52

DataKitchen

APRIL 26, 2021

In early April 2021, DataKItchen sat down with Jonathan Hodges, VP Data Management & Analytics, at Workiva ; Chuck Smith, VP of R&D Data Strategy at GlaxoSmithKline (GSK) ; and Chris Bergh, CEO and Head Chef at DataKitchen, to find out about their enterprise DataOps transformation journey, including key successes and lessons learned.

Software Engineer 98

Software Engineer Software Engineering Machine Learning Education 98

Rockset

NOVEMBER 23, 2021

We put our users first and obsess about helping our users achieve speed, scale and simplicity in their modern real-time data stack (some of which I discuss in depth below). In general, the way vendors conduct themselves during benchmarking is a good signal of how they operate and what their values are. Change data capture streams.

MongoDB 59

MongoDB Data Ingestion PostgreSQL SQL 59

Databand.ai

JANUARY 24, 2023

What is DataOps? The Ultimate Guide for Data Teams Eric Jones 2023-01-24 12:21:38 If you find yourself hearing a lot about DataOps and then subsequently asking, “ What is DataOps? This guide details everything you need to know about DataOps, including: What is DataOps? What has led to the rise of DataOps?

Retail 52

Retail Banking Government Manufacturing 52

DataKitchen

JUNE 24, 2021

In May 2021 at the CDO & Data Leaders Global Summit, DataKitchen sat down with the following data leaders to learn how to use DataOps to drive agility and business value. Kurt Zimmer, Head of Data Engineering for Data Enablement at AstraZeneca. Jim Tyo, Chief Data Officer, Invesco. Data takes a long journey.

Pipeline-centric 84

Pipeline-centric Manufacturing Education Data Cleanse 84

Monte Carlo

MARCH 23, 2022

When I talk to data teams about the benefits of data observability and data quality, it’s often framed in the context of preventing the negative impacts of bad data : poor decision making, lost revenue, and even the erosion of customer trust. With Gartner predicting that poor data quality costs organizations $12.9M

IT 52

IT Machine Learning High Quality Data Data 52