Data Engineering Podcast

JULY 27, 2021

Datastax has recently introduced a new managed offering for Pulsar workloads in the form of Astra Streaming that lowers those barriers and make stremaing workloads accessible to a wider audience. Can you describe the architecture and automation of your hosted platform for Pulsar?

Building 100

Building Management Kafka Data Warehouse 100

Data Engineering Podcast

JULY 6, 2020

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Redis and Pulsar)? Redis and Pulsar)? Go to dataengineeringpodcast.com/linode today and get a $60 credit to try out a Kubernetes cluster of your own.

Systems 100

Systems Kafka SQL Government 100

Data Engineering Podcast

APRIL 19, 2020

How do the capabilities and developer experience of Eventador compare to other streaming SQL engines such as ksqlDB, Pulsar SQL, or Materialize? How do the capabilities and developer experience of Eventador compare to other streaming SQL engines such as ksqlDB, Pulsar SQL, or Materialize?

Building 100

Building PostgreSQL MongoDB SQL 100

Data Engineering Podcast

MARCH 27, 2022

Privacera is an enterprise grade solution for cloud and hybrid data governance built on top of the robust and battle tested Apache Ranger project. With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm.

Data Governance 130

Data Governance Government Cloud Building 130

Data Engineering Podcast

JANUARY 5, 2020

Pulsar, Bookkeeper, Pravega)? Pulsar, Bookkeeper, Pravega)? Can you describe the systems architecture of Debezium and how it has evolved since it was first created? How has the tight coupling with Kafka impacted the direction and capabilities of Debezium? What, if any, other substrates does Debezium support (e.g.

Database 100

Database Kafka PostgreSQL MySQL 100

Data Engineering Podcast

JUNE 15, 2020

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Machine Learning 100

Machine Learning Google Cloud Kafka Data Engineering 100

Data Engineering Podcast

FEBRUARY 20, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Prophecy provides an easy-to-use visual interface to design & deploy data pipelines on Apache Spark & Apache Airflow. How does it work?

Systems 100

Systems Software Engineer Software Engineering Data Warehouse 100

Data Engineering Podcast

DECEMBER 11, 2021

In order to make it easier for developers to build customer profiles in a way that respects their privacy Serge Huber helped to create the Apache Unomi framework as an open source customer data platform. Unfortunately many sites and applications take that to the extreme and collect too much information.

Data Warehouse 100

Data Warehouse Raw Data Data Lake BI 100

Data Engineering Podcast

NOVEMBER 18, 2018

Apache Flink is a true stream processing engine with an impressive set of capabilities for stateful computation at scale. How does Flink compare to other streaming engines such as Spark, Kafka, Pulsar, and Storm? Apache Flink is a true stream processing engine with an impressive set of capabilities for stateful computation at scale.

Process 100

Process Scala Google Cloud Kafka 100

Data Engineering Podcast

JANUARY 23, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Prophecy provides an easy-to-use visual interface to design & deploy data pipelines on Apache Spark & Apache Airflow. How does it work?

Building 100

Building Management Data Pipeline Metadata 100

Data Engineering Podcast

AUGUST 3, 2021

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Lake 130

Data Lake Data Warehouse Hadoop Architecture 130

Data Engineering Podcast

AUGUST 20, 2021

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Building 100

Building Data Lake Data Warehouse SQL 100

Data Engineering Podcast

JANUARY 7, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Prophecy provides an easy-to-use visual interface to design & deploy data pipelines on Apache Spark & Apache Airflow. How does it work?

BI 100

BI Data Warehouse Metadata SQL 100

Data Engineering Podcast

NOVEMBER 10, 2021

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Chief Data Scientist, founder of the Data Mesh, Creator of Apache Airflow, and more data pioneers spearheading some of the biggest movements in data.

Metadata 100

Metadata Data Warehouse Data Lake BI 100

Data Engineering Podcast

MARCH 2, 2020

How do the capabilities and design of ksqlDB compare to other solutions for querying streaming data with SQL such as Pulsar SQL, PipelineDB, or Materialize? How do the capabilities and design of ksqlDB compare to other solutions for querying streaming data with SQL such as Pulsar SQL, PipelineDB, or Materialize?

Kafka 100

Kafka Process PostgreSQL MySQL 100

Big Data Tools

JUNE 8, 2022

I’ve had some experience with Apache Atlas, and even with the help of my colleagues, I wasn’t able to make it do what I wanted it to. This new release brings exciting features like support for Apache Iceberg! Pulsar Manager 0.3.0 – Lots of enterprise systems lack a nice management interface. There are several solutions.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Big Data Tools

JUNE 8, 2022

I’ve had some experience with Apache Atlas, and even with the help of my colleagues, I wasn’t able to make it do what I wanted it to. This new release brings exciting features like support for Apache Iceberg! Pulsar Manager 0.3.0 – Lots of enterprise systems lack a nice management interface. There are several solutions.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Big Data Tools

MAY 19, 2022

Apache Hudi 1.11.0 – This release of the well-known data lake has added many interesting changes. Kyuubi 1.5.1 – Kyuubi is a JDBC server built over Apache Spark, but as of version 1.5.0, Apache Pulsar 2.0.10 – No fewer than 14 PIPs (Pulsar Improvement Proposals) were implemented in this version!

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Big Data Tools

MAY 19, 2022

Apache Hudi 1.11.0 – This release of the well-known data lake has added many interesting changes. Kyuubi 1.5.1 – Kyuubi is a JDBC server built over Apache Spark, but as of version 1.5.0, Apache Pulsar 2.0.10 – No fewer than 14 PIPs (Pulsar Improvement Proposals) were implemented in this version!

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Data Engineering Podcast

FEBRUARY 13, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Prophecy provides an easy-to-use visual interface to design & deploy data pipelines on Apache Spark & Apache Airflow. How does it work?

Building 100

Building Hadoop Data Pipeline Metadata 100

Data Engineering Podcast

FEBRUARY 6, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Prophecy provides an easy-to-use visual interface to design & deploy data pipelines on Apache Spark & Apache Airflow. How does it work?

Data Pipeline 100

Data Pipeline Data Metadata Software Engineer 100

Data Engineering Podcast

JANUARY 30, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Prophecy provides an easy-to-use visual interface to design & deploy data pipelines on Apache Spark & Apache Airflow. How does it work?

Data Engineering 100

Data Engineering Data Engineer Engineering Python 100

Data Engineering Podcast

MAY 1, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Warehouse 100

Data Warehouse Data Lake Architecture Data 100

Data Engineering Podcast

MAY 22, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. That’s why Kyligence has built on top of the leading open source OLAP engine for data lakes, Apache Kylin.

Machine Learning 130

Machine Learning Data Engineering Data Engineer Cloud 130

Data Engineering Podcast

APRIL 26, 2021

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Business Intelligence 100

Business Intelligence Data Warehouse Hadoop Data Pipeline 100

Big Data Tools

DECEMBER 7, 2021

Apache Arrow 6.0.1 – Apache Arrow presents itself as a cross-language development platform for in-memory analytics. release of Apache Arrow brings much better support for the Go language! Apache Geode – Was anyone even thinking about data engineering 19 years ago, back when Apache Geode first came on the scene?

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Big Data Tools

DECEMBER 7, 2021

Apache Arrow 6.0.1 – Apache Arrow presents itself as a cross-language development platform for in-memory analytics. release of Apache Arrow brings much better support for the Go language! Apache Geode – Was anyone even thinking about data engineering 19 years ago, back when Apache Geode first came on the scene?

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Data Engineering Podcast

AUGUST 24, 2020

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Metadata 100

Metadata Management Kafka Data Engineering 100

Data Engineering Podcast

APRIL 3, 2022

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Designing 100

Designing Data Warehouse Data Engineering Data Engineer 100

Data Engineering Podcast

OCTOBER 28, 2021

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. Chief Data Scientist, founder of the Data Mesh, Creator of Apache Airflow, and more data pioneers spearheading some of the biggest movements in data.

Data Pipeline 100

Data Pipeline SQL Data Warehouse Data Lake 100

Data Engineering Podcast

SEPTEMBER 28, 2020

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Kafka 100

Kafka BI Big Data Data Engineering 100

Data Engineering Podcast

FEBRUARY 17, 2020

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Links Snowplow Analytics Podcast Episode Terraform Consul Nomad Meltdown Vulnerability Spectre Vulnerability AWS Kinesis Elasticsearch SnowflakeDB Indicative S3 (..)

AWS 100

AWS Google Cloud Kafka Media 100

Big Data Tools

AUGUST 3, 2021

Kotlin API for Apache Spark – A year after showing you the first preview, we released version 1.0. Apache Spark already has two official APIs for JVM – Scala and Java – but we’re hoping the Kotlin API will be useful as well, as we’ve introduced several unique features. Here’s what’s happening in data engineering right now.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Big Data Tools

AUGUST 3, 2021

Kotlin API for Apache Spark – A year after showing you the first preview, we released version 1.0. Apache Spark already has two official APIs for JVM – Scala and Java – but we’re hoping the Kotlin API will be useful as well, as we’ve introduced several unique features. Here’s what’s happening in data engineering right now.

Data Engineering 52

Data Engineering Data Engineer Engineering Big Data Tools 52

Data Engineering Podcast

OCTOBER 15, 2021

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Metadata 100

Metadata BI Data Warehouse Government 100

Data Engineering Podcast

SEPTEMBER 21, 2020

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Engineering 100

Data Engineering Data Engineer Engineering AWS 100

Data Engineering Podcast

SEPTEMBER 7, 2020

With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Architecture 100

Architecture Data Architecture SQL Engineering 100