Data Engineering Podcast

OCTOBER 22, 2023

Summary The primary application of data has moved beyond analytics. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. Can you describe what is encompassed by the idea of a data product strategy? With Materialize, you can! When is a data product strategy overkill?

BI 162

BI SQL Machine Learning Programming Language 162

Christophe Blefari

APRIL 12, 2024

In the same conference a lot of other talks took place here a few selection you should check out: How to pivot your data team from a service team to a value-generator — Very often data teams struggle in delivering value or in finding what's their real identity. Which I have already condensed in a post a few weeks ago (in English).

BI 130

BI SQL Data Coding 130

Precisely

DECEMBER 28, 2023

The concept of streaming data was born of necessity. More than ever, advanced analytics, ML, and AI are providing the foundation for innovation, efficiency, and profitability. That’s where streaming data pipelines come into play. What is a streaming data pipeline? How do streaming data pipelines work?

Data Pipeline 91

Data Pipeline Building Kafka Big Data 91

Data Engineering Podcast

SEPTEMBER 3, 2023

It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. Whether it’s real-time dashboarding and analytics, personalization and segmentation or automation and alerting, Materialize gives you the ability to work with fresh, correct, and scalable results — all in a familiar SQL interface.

Data Integration 162

Data Integration BI SQL Python 162

Data Engineering Podcast

OCTOBER 8, 2023

It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. Whether it’s real-time dashboarding and analytics, personalization and segmentation or automation and alerting, Materialize gives you the ability to work with fresh, correct, and scalable results — all in a familiar SQL interface.

Insurance 162

Insurance BI SQL Machine Learning 162

Data Engineering Podcast

OCTOBER 1, 2023

It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. Whether it’s real-time dashboarding and analytics, personalization and segmentation or automation and alerting, Materialize gives you the ability to work with fresh, correct, and scalable results — all in a familiar SQL interface.

Building 162

Building BI SQL Machine Learning 162

Christophe Blefari

FEBRUARY 24, 2023

In any case, I need your honest feedback, what would make you consider paying for the content I create? But if you want to continue using the underlying tools here an overlook of Flink architecture or a few techniques you should know as a Kafka streams developer. First Bucky gave his thoughts about the state of infra in 2023.

Kafka 130

Kafka Data Lake Data Storage Data 130

Data Engineering Podcast

AUGUST 27, 2023

In the era of the cloud most developers rely on hosted services to manage their databases, but what if you are a cloud service? It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. What are the different methods that you have used for managing database instances?

Database 130

Database Building PostgreSQL BI 130

Knowledge Hut

APRIL 24, 2024

In today's market, the demand for commerce career options and commerce stream jobs is at an all-time high. Top 15 Highest-paying Jobs for Commerce Students in India The following is an in-depth commerce stream jobs list with salaries for students thinking of pursuing commerce but don't know what to expect.

Retail 98

Retail Finance Certification Banking 98

Knowledge Hut

APRIL 25, 2024

Most businesses today understand how to gather the terabytes of data that constantly pour into their operations and utilize analytics to transform them into insightful information. Given its advantages, big data and analytics are crucial for any business trying to maximize its commercial potential. What is Big Data?

Big Data 97

Big Data Entertainment Transportation Banking 97

Data Engineering Podcast

JULY 9, 2023

Summary For business analytics the way that you model the data in your warehouse has a lasting impact on what types of questions can be answered quickly and easily. Can you describe what entity-centric modeling (ECM) is and the story behind it? What is the impact on the underlying compute engine on the modeling strategies used?

Database-centric 130

Database-centric Machine Learning SQL Data Engineering 130

Data Engineering Podcast

AUGUST 20, 2023

It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. Whether it’s real-time dashboarding and analytics, personalization and segmentation or automation and alerting, Materialize gives you the ability to work with fresh, correct, and scalable results — all in a familiar SQL interface.

Education 130

Education BI SQL Database 130

Christophe Blefari

JANUARY 20, 2024

What is Hadoop? A quick overview of what everyone used for years (and still using it for some of us). Learn data engineering, all the references ( credits ) This is a special edition of the Data News. The aim of this post is to create a repository of important links and concepts we should care about when we do data engineering.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

Christophe Blefari

FEBRUARY 3, 2024

But what problem are we trying to solve? From my own little experiments in this field here what I can say a generating layer can behave like an analyst but will be way more stupid than an analyst. hey ( credits ) Hello here, this is Christophe from Amsterdam. I hope you're doing good. 2 weeks ago TextQL raised $4.1m conference.

MongoDB 130

MongoDB SQL Data Data Warehouse 130

Knowledge Hut

MAY 2, 2024

As per Apache, “ Apache Spark is a unified analytics engine for large-scale data processing ” Spark is a cluster computing framework, somewhat similar to MapReduce but has a lot more capabilities, features, speed and provides APIs for developers in many languages like Scala, Python, Java and R. billion (2019 - 2022).

Scala 52

Scala Hospitality Healthcare Retail 52

Cloudera

OCTOBER 4, 2023

Every organization has some data that happens in real time, whether it is understanding what our users are doing on our websites or watching our systems and equipment as they perform mission critical tasks for us. Without real-time analytics we won’t catch the threats until after they’ve caused significant damage.

Telecommunication 90

Telecommunication Data Warehouse Java Manufacturing 90

Confluent

NOVEMBER 30, 2022

What is stream processing, or complex event processing (CEP), and how does it work? Learn about real-time data and event stream analytics in this tutorial.

Process 125

Process Data IT 125

Cloudera

MARCH 2, 2023

Recently, we announced enhanced multi-function analytics support in Cloudera Data Platform (CDP) with Apache Iceberg. Iceberg is a high-performance open table format for huge analytic data sets. This enables you to maximize utilization of streaming data at scale. Currently, Iceberg support in CSP is in technical preview mode.

Process 116

Process SQL Kafka Database 116

Snowflake

MAY 1, 2024

One of their customers, a major data supplier, used the solution to stream near real-time visualizations of a massive 150 million polygon data set at sub-second speeds, surpassing the capabilities of competing solutions. Her passion for AI and its role in enhancing data services also aligns with what we do at BigGeo.”

Media 104

Media Building Data Warehouse Technology 104

Knowledge Hut

APRIL 23, 2024

With the help of big data analytics, we can gain insights from large datasets and reveal previously concealed patterns, trends, and correlations. What is Big Data? What are the 4 V’s of Big Data? It represents the vast quantity of data involved in big data analytics and the sheer scale of data being produced.

Big Data 52

Big Data Media Datasets Unstructured Data 52

Data Engineering Weekly

FEBRUARY 4, 2024

Joe Reis: Definition of Data Modeling & What Data Modeling Is not Joe raised a very fundamental question in data engineering. What is Data Modeling, and what is not? What is Data Modeling, and what is not? Visit rudderstack.com to learn more.

Data Engineering 62

Data Engineering Data Engineer Engineering PostgreSQL 62

Knowledge Hut

DECEMBER 22, 2023

What is Power BI? Microsoft developed it and combines business analytics, data visualization, and best practices. For example, an answer to a question like what was the total sales last year? Stream Analytics Stream Analytics helps to assist in real-time analytics to make timely decisions.

BI 98

BI Business Intelligence Machine Learning SQL 98

Knowledge Hut

JUNE 26, 2023

What are Data Engineering Projects? Before working on these initiatives, you should be conversant with topics and technologies. Companies are constantly seeking experienced data engineers who can create innovative data engineering initiatives. The first step in hiring data engineers is reviewing a candidate's résumé.

Data Engineering 98

Data Engineering Data Engineer Coding Project 98

Cloudera

JUNE 7, 2021

Cloudera has been named as a Strong Performer in the Forrester Wave for Streaming Analytics, Q2 2021. We are excited to be recognized in this wave at, what we consider to be, such a strong position. We are proud to have been named as one of “ The 14 providers that matter most ” in streaming analytics.

Kafka 103

Kafka Data Ingestion Architecture Cloud 103

Rockset

SEPTEMBER 26, 2023

In this post, we’ll discuss why Confluent Cloud ’s data streaming platform and Rockset’s vector search capabilities work so well to enable real-time AI app development and explore how an e-commerce innovator is using this pattern. For the best results, these models must be informed by relevant data.

Metadata 64

Metadata Kafka Cloud Database 64

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. What is a Data Mesh and how does it work? What are the four principles of a Data Mesh, and what problems do they solve?

Architecture 52

Architecture Generalist Government Datasets 52

Cloudera

FEBRUARY 21, 2023

SQL Stream Builder (SSB) is a versatile platform for data analytics using SQL as a part of Cloudera Streaming Analytics, built on top of Apache Flink. It enables users to easily write, run, and manage real-time continuous SQL queries on stream data and a smooth user experience. What is a data transformation?

SQL 113

SQL Kafka Raw Data Data 113

Lyft Engineering

NOVEMBER 29, 2023

Introduction At Lyft, we have used systems like Apache ClickHouse and Apache Druid for near real-time and sub-second analytics. For our customers, this means faster analytics on near real-time data and decision making. ClickHouse at Lyft What is ClickHouse? This was our main form of ingestion.

Kafka 104

Kafka Data Ingestion Datasets Architecture 104

Lyft Engineering

JUNE 28, 2023

However, streaming data was not supported as a first-class citizen across many of the platform’s systems — such as training, complex monitoring, and others. While several teams were using streaming data in their Machine Learning (ML) workflows, doing so was a laborious process, sometimes requiring weeks or months of engineering effort.

Machine Learning 115

Machine Learning Building Metadata Kafka 115

Cloudera

FEBRUARY 22, 2023

Cloudera’s SQL Stream Builder (SSB) is a versatile platform for data analytics using SQL. As apart of Cloudera Streaming Analytics it enables users to easily write, run, and manage real-time SQL queries on streams with a smooth user experience, while it attempts to expose the full power of Apache Flink.

SQL 86

SQL Raw Data Programming Language Kafka 86

Monte Carlo

JANUARY 5, 2024

You know what they always say: data lakehouse architecture is like an onion. …ok, This architecture format consists of several key layers that are essential to helping an organization run fast analytics on structured and unstructured data. Table of Contents What is data lakehouse architecture? ok, so maybe they don’t say that.

Architecture 52

Architecture Data Lake Metadata Unstructured Data 52

Monte Carlo

JANUARY 5, 2024

You know what they always say: data lakehouse architecture is like an onion. …ok, This architecture format consists of several key layers that are essential to helping an organization run fast analytics on structured and unstructured data. Table of Contents What is data lakehouse architecture? ok, so maybe they don’t say that.

Architecture 52

Architecture Data Lake Metadata Unstructured Data 52

Snowflake

MAY 9, 2024

From its start with efficient batch processing with data warehouses for descriptive analytics, and the inclusion of streaming data in real time to build recommendations, we find ourselves at the forefront of a new stage of evolution: generative AI (gen AI). This blog highlights three key gen AI trends the two AI leaders see emerging.

Unstructured Data 93

Unstructured Data Manufacturing Retail Data Warehouse 93

Snowflake

DECEMBER 21, 2023

What inspired you to start Patch? What problem does Patch aim to solve, and what makes you confident that you and your team are the right people to solve it? What’s the coolest thing you’re doing with data? You’ll also find out why “identifying a villain” is part of Patch’s success strategy.

Software Engineer 89

Software Engineer Software Engineering Database Data Pipeline 89

Towards Data Science

APRIL 3, 2023

Building a Mental Model for Engineers and Anyone in Between Stream Processing can be handled gently and with care, or wildly, and almost out of control! You be the judge of what future you’d rather embrace. How you transition from a batch mindset to a streaming mindset although can also be tricky, so let’s start small and build.

Process 88

Process Data Lake Systems Bytes 88

LinkedIn Engineering

DECEMBER 12, 2023

Post analytics helps creators measure their post performance overall and with specific viewer demographics, so they can better understand what resonates and refine their content strategies. Content creators post on LinkedIn with the goal of reaching and engaging specific audiences.

Algorithm 77

Algorithm Metadata SQL Datasets 77

Workfall

JUNE 12, 2023

Timely analytics, the secret sauce that empowers companies to gain a competitive edge, are in high demand. With CDC by their side, organisations unlock the power of informed decision-making, safeguard data integrity, and enable lightning-fast analytics. In this blog, we will cover: What Is CDC and Its Benefits?

Telecommunication 80

Telecommunication Metadata Healthcare Finance 80