Data Engineering Podcast

APRIL 19, 2021

Summary Most of the time when you think about a data pipeline or ETL job what comes to mind is a purely mechanistic progression of functions that move data from point A to point B. Modern Data teams are dealing with a lot of complexity in their data pipelines and analytical code.

Data Pipeline 100

Data Pipeline Machine Learning Data Warehouse Datasets 100

Data Engineering Podcast

DECEMBER 17, 2017

Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data infrastructure When you’re ready to launch your next project you’ll need somewhere to deploy it. Enterprise add-ons and professional support are available for added peace of mind. What was the inspiration for the name?

Database 100

Database Data Pipeline Data Engineering Data Engineer 100

AltexSoft

JANUARY 18, 2023

Models then use the patterns they learn from this training data to predict the next word in a sentence or generate new text that is grammatically correct and semantically coherent. In 2020, a remarkable AI took Silicon Valley by storm. GPT-3 has a spin-off called ChatGPT that is specifically fine-tuned for conversational tasks.

Datasets 64

Datasets Architecture Deep Learning SQL 64

Confluent

MARCH 20, 2019

You get to focus on the logic of your data processing pipeline. Whether Streams emits every single update or groups updates is irrelevant to the semantics of a data processing application. The continuous-refinement-with-operational-parameters model is a very simple and powerful design for a data processing system.

Kafka 106

Kafka Programming Process Designing 106

AltexSoft

OCTOBER 21, 2022

Similar to Google in web browsing and Photoshop in image processing, it became a gold standard in data streaming, preferred by 70 percent of Fortune 500 companies. Apache Kafka is an open-source, distributed streaming platform for messaging, storing, processing, and integrating large data volumes in real time. What is Kafka?

Kafka 93

Kafka Hadoop ETL Tools Big Data 93