Precisely

DECEMBER 28, 2023

The concept of streaming data was born of necessity. But insights derived from day-old data don’t cut it. Business success is based on how we use continuously changing data. That’s where streaming data pipelines come into play. What is a streaming data pipeline? Now, information is dynamic.

Data Pipeline 91

Data Pipeline Building Kafka Big Data 91

Confluent

MARCH 12, 2024

Leverage Confluent Data Streaming Platform to bring real time to your smart warehouse, powering greater IoT automation, efficiency and cost savings.

Data 83

Data 83

Towards Data Science

DECEMBER 11, 2023

Streaming data pipelines and real-time analytics Continue reading on Towards Data Science »

Data Engineering 81

Data Engineering Data Engineer Engineering Data Pipeline 81

Confluent

APRIL 23, 2024

Smart city applications rely on the availability of sensor data from a range of sources in real time. Learn how data streaming with Confluent enables this.

Data 67

Data 67

Confluent

MARCH 21, 2024

won the 2024 Data Streaming Startup Challenge. Explore this blog post to see what set them apart and their creative use of data streaming. TwinLabs.ai

Data 57

Data 57

Confluent

JANUARY 23, 2024

Telemedicine services need a reliable, secure, and scalable data infrastructure in order to serve patients. Learn how data streaming with Confluent helps to ensure this.

Data 67

Data 67

Yelp Engineering

MARCH 7, 2024

Yelp relies heavily on streaming to synchronize enormous volumes of data in real time. This is facilitated by Yelp’s underlying data pipeline infrastructure, which manages the real-time flow of millions of messages originating from a plethora of services.

Building 59

Building AWS Data Pipeline Data 59

Confluent

OCTOBER 4, 2022

Confluent’s new Stream Designer is the industry’s first visual interface for rapidly building, testing, and deploying streaming data pipelines natively on Apache Kafka.

Data Pipeline 104

Data Pipeline Designing Kafka Data 104

Confluent

DECEMBER 4, 2023

Learn how to build and launch streaming apps faster with Data Portal, the developer-friendly, self-service UI to find, understand, and enrich all of your data streams.

Government 67

Government Data Building 67

Confluent

APRIL 18, 2024

Siemens and Brose revolutionized global manufacturing operations with Confluent’s data streaming, increasing its IoT integration and the future of Industry 4.0.

Manufacturing 57

Manufacturing Data IT 57

Confluent

AUGUST 22, 2023

How real-time data streaming is powering peer-to-peer trading of renewable energy with ever-increasing data volumes.

Data 98

Data 98

Confluent

MARCH 28, 2023

The future of data is real time and enriched by machine learning. How can we overcome socio-technical blockers and unite the ML and data streaming markets?

Machine Learning 132

Machine Learning Data 132

Start Data Engineering

SEPTEMBER 26, 2020

Table of Contents Table of Contents Introduction Project description and requirements Infrastructure overview Apache Flink Apache Kafka Design Detect fraudulent accounts Log account actions Prerequisites Code Defining dependencies Inheritance Server logs generator Defining data flow in Apache Flink Create a streaming environment Creating a consumer (..)

Data Engineering 130

Data Engineering Data Engineer Project Engineering 130

KDnuggets

SEPTEMBER 5, 2023

Build a streaming data pipeline using Formula 1 data, Python, Kafka, RisingWave as the streaming database, and visualize all the real-time data in Grafana.

Data Pipeline 99

Data Pipeline Kafka Building Python 99

Confluent

APRIL 4, 2024

Our latest Confluent Champion post explores how Technical Architect Bergur Ziska helps customers win with data streaming.

Data 62

Data 62

Confluent

MARCH 21, 2024

See the highlights from Kafka Summit London 2024, and learn about how data streaming platforms, Gen AI, and Apache Flink® are driving innovation in the data streaming community.

Kafka 70

Kafka Data 70

Confluent

FEBRUARY 22, 2024

The 2024 Data Streaming Startup Challenge Finalists will compete for the grand prize on stage at Kafka Summit London.

Kafka 67

Kafka Data 67

Data Engineering Podcast

OCTOBER 28, 2021

Summary Streaming data systems have been growing more capable and flexible over the past few years. Despite this, it is still challenging to build reliable pipelines for stream processing. Missing data? Start trusting your data with Monte Carlo today! Struggling with broken pipelines? Stale dashboards?

Data Pipeline 100

Data Pipeline SQL Data Warehouse Data Lake 100

Confluent

APRIL 5, 2023

All the best data streaming resources, tips, and guides to help you learn introductory concepts, streaming architecture basics, common tools and technologies, and more.

Architecture 104

Architecture Data Technology 104

Confluent

JANUARY 30, 2024

The finalists and winner of the Data Streaming Startup Challenge will be announced at Kafka Summit London.

Kafka 73

Kafka Data 73

Confluent

FEBRUARY 13, 2024

Confluent Migration Accelerator, a new program in partnership with the Confluent partner ecosystem to jump-start organizations' data streaming journeys.

Programming 78

Programming Data 78

Data Engineering Podcast

AUGUST 3, 2021

Summary Data lake architectures have largely been biased toward batch processing workflows due to the volume of data that they are designed for. With more real-time requirements and the increasing use of streaming data there has been a struggle to merge fast, incremental updates with large, historical analysis.

Data Lake 130

Data Lake Data Warehouse Hadoop Architecture 130

Confluent

MARCH 4, 2024

Explore how data streaming platforms revolutionize GenAI adoptions, streamlining operations, and enhancing customer experiences with real-time insights.

Data 52

Data 52

Confluent

APRIL 4, 2023

Machine learning and data streaming are a perfect match, but have diverging tech stacks. How can we overcome the pitfalls of SQL and the gulf between languages?

Machine Learning 104

Machine Learning SQL Data 104

Confluent

SEPTEMBER 20, 2023

Explore the intersection of AI and data streaming with essential resources for developers. Discover recorded talks, blog posts, and upcoming events to boost your knowledge.

Data 70

Data 70

Team Data Science

MARCH 31, 2020

I built a serverless architecture for my simulated credit card complaints stream using, AWS S3 AWS Lambda AWS Kinesis the above picture gives a high-level view of the data flow. Stream Processing: Analyzing real-time data requires a different approach. Consumer: A consumer process the data records.

Process 130

Process AWS Python Architecture 130

Confluent

OCTOBER 12, 2023

Learn about the key capabilities of a data streaming platform and what factors to consider when choosing a stream processing engine like Apache Flink® to fuel use cases with real-time data.

Process 62

Process Engineering Data 62

Confluent

SEPTEMBER 12, 2023

Startups using data streaming can submit an application to win an investment from Confluent.

Data 76

Data 76

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. What is a Data Mesh and how does it work? The Data Mesh architecture is based on four core principles: scalability, resilience, elasticity, and autonomy.

Architecture 52

Architecture Generalist Government Datasets 52

Confluent

OCTOBER 10, 2023

Learn how data streaming enables you to accurately predict future customer demands while delivering the right products in the right quantities to satisfy customer demand without creating a surplus.

Data 70

Data 70

Confluent

SEPTEMBER 26, 2023

Today, Confluent is announcing our “Data Streaming for AI'' initiative where we are expanding our ecosystem in the AI space and committing to a roadmap of product enhancement to help you build AI apps faster.

Data 73

Data Building 73

Confluent

NOVEMBER 9, 2023

Experience Confluent's cloud-native, data streaming platform at AWS re:Invent 2023. Learn how to stream, connect, process, and share data, unlocking its full potential.

AWS 76

AWS Cloud Data Process 76

Hevo

JANUARY 27, 2023

Organizations must constantly monitor and analyze real-time data through data streaming systems. Data streaming technology helps organizations in processing and analyze real-time data with ease. It is primarily used in situations where dynamic data is generated regularly.

Architecture 52

Architecture Media Data Technology 52

Confluent

SEPTEMBER 6, 2023

Explore how Confluent and Apache Kafka are reshaping the data streaming landscape in FinTech. Learn how these powerful tools are fostering efficiency and scalability, featuring customers like Kredivo Holdings.

Kafka 57

Kafka Data 57

Data Engineering Podcast

NOVEMBER 30, 2020

Summary The first stage of every good pipeline is to perform data integration. With the increasing pace of change and the need for up to date analytics the need to integrate that data in near real time is growing. If you hand a book to a new data engineer, what wisdom would you add to it?

Data Integration 100

Data Integration Coding BI Kafka 100

Analytics Vidhya

FEBRUARY 28, 2024

Introduction Data is fuel for the IT industry and the Data Science Project in today’s online world. IT industries rely heavily on real-time insights derived from streaming data sources. Handling and processing the streaming data is the hardest work for Data Analysis.

MongoDB 217

MongoDB Data Pipeline Kafka Building 217