Remove learn csv-to-bigquery
article thumbnail

How to learn data engineering

Christophe Blefari

Learn data engineering, all the references ( credits ) This is a special edition of the Data News. But right now I'm in holidays finishing a hiking week in Corsica 🥾 So I wrote this special edition about: how to learn data engineering in 2024. The idea is to create a living reference about Data Engineering.

article thumbnail

Data News — Week 23.27

Christophe Blefari

Read dbt metrics documentation As an extension I've seen 2 things this week that I feel makes sense here: VulcanSQL — A data API framework for DuckDB, Snowflake, BigQuery, PostgreSQL. CSV exports, Excel, Sheets, etc.) Having some kind of simulated real-time data would be the best. But it requires to write a simulation.

Kafka 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Build Trust In Your Data By Understanding Where It Comes From And How It Is Used With Stemma

Data Engineering Podcast

It builds your customer data warehouse and your identity graph on your data warehouse, with support for Snowflake, Google BigQuery, Amazon Redshift, and more. Send a CSV via email? With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

IT 130
article thumbnail

Charting A Path For Streaming Data To Fill Your Data Lake With Hudi

Data Engineering Podcast

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management You listen to this show to learn about all of the latest tools, patterns, and practices that power data engineering projects across every domain. Vinoth Chandar helped to create the Hudi project while at Uber to address this challenge.

Data Lake 130
article thumbnail

Make Database Performance Optimization A Playful Experience With OtterTune

Data Engineering Podcast

It builds your customer data warehouse and your identity graph on your data warehouse, with support for Snowflake, Google BigQuery, Amazon Redshift, and more. Send a CSV via email? We spend countless hours designing the data model, updating engine versions, and tuning performance. Then what do you do? Today, there is a better way.

Database 100
article thumbnail

Accelerating ML Training And Delivery With In-Database Machine Learning

Data Engineering Podcast

Summary When you build a machine learning model, the first step is always to load your data. In this episode Paige Roberts explains the benefits of pushing the machine learning processing into the database layer and the approach that Vertica has taken for their implementation. Send a CSV via email? Then what do you do?

article thumbnail

Make Sure Your Records Are Reliable With The BookKeeper Distributed Storage Layer

Data Engineering Podcast

It builds your customer data warehouse and your identity graph on your data warehouse, with support for Snowflake, Google BigQuery, Amazon Redshift, and more. Send a CSV via email? Summary The way to build maintainable software and systems is through composition of individual pieces. Then what do you do? Today, there is a better way.