Data Engineering Weekly

DECEMBER 3, 2023

Github writes an excellent blog to capture the current state of the LLM integration architecture. The blog is an excellent read to understand late-arriving data, backfilling, and incremental processing complications. Move Flink SQL to ClickHouse—certain Flink transformations can be directly done in the destination in ClickHouse.

Data Engineering 70

Data Engineering Data Engineer Engineering Bytes 70

Data Engineering Podcast

APRIL 19, 2020

In this episode Eventador Founder and CEO Kenny Gorman describes how the platform is architected, the challenges inherent to managing reliable streams of data, the simplicity offered by a SQL interface, and the interesting projects that his customers have built on top of it. How does it fit into an application architecture?

Building 100

Building PostgreSQL MongoDB SQL 100

Data Engineering Podcast

DECEMBER 9, 2018

How does it compare to some of the other streaming frameworks such as Flink, Kafka, or Storm? Contact Info @jgperrin on Twitter Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? What are some of the problems that Spark is uniquely suited to address?

Scala 100

Scala MySQL Kafka Hadoop 100

Data Engineering Podcast

DECEMBER 22, 2019

In the list of features, you highlight full support for ANSI SQL 92. A majority of SQL oriented platforms define custom extensions or built-in functions that are specific to their problem domain. For someone who is unfamiliar with the semantics of streaming SQL, what are some of the conceptual shifts that they should be aware of?

SQL 100

SQL Building Engineering Java 100

Cloudera

OCTOBER 13, 2020

CDP Machine Learning: a kubernetes-based service that allows data scientists to deploy collaborative workspaces with secure, self-service access to enterprise data. CDP Operational Database (2) – an autonomous, multimodal, autoscaling database environment supporting both NoSQL and SQL. 1) Currently available on AWS only. (2)

Cloud 90

Cloud Data Warehouse AWS NoSQL 90

Cloudera

MARCH 1, 2023

For Cloudera’s SQL Stream Builder (SSB), we did not miss this chance. SSB was built to give analysts the power of Flink in a no-code interface,” wrote a colleague as a great summary. API generation To load resources and manage our Flink jobs, the SSB front end calls back end endpoints. No surprise so far.

SQL 71

SQL Kafka Coding Project 71