Data Engineering Podcast

NOVEMBER 13, 2022

Summary CreditKarma builds data products that help consumers take advantage of their credit and financial capabilities. In this episode Vishnu Venkataraman shares the journey that he and his team have taken to build and evolve their systems and improve the product offerings that they are able to support.

MongoDB 100

MongoDB Scala MySQL Google Cloud 100

Data Engineering Podcast

JULY 10, 2022

Summary Building a data platform is a journey, not a destination. Beyond the work of assembling a set of technologies and building integrations across them, there is also the work of growing and organizing a team that can support and benefit from that platform. Tired of deploying bad data?

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

Data Engineering Podcast

JULY 3, 2022

She also discusses her views on the role of the data lakehouse as a building block for these architectures and the ongoing influence that it will have as the technology matures. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Tired of deploying bad data?

Architecture 100

Architecture Metadata MongoDB MySQL 100

Data Engineering Podcast

JUNE 5, 2022

The team at Skyflow decided that the second best way is to build a storage system dedicated to securely managing your sensitive information and making it easy to integrate with your applications and data systems. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code.

Data Security 100

Data Security Metadata MongoDB Scala 100

Data Engineering Podcast

JUNE 12, 2022

Summary Building a well rounded and effective data team is an iterative process, and the first hire can set the stage for future success or failure. Trupti Natu has been the first data hire multiple times and gone through the process of building teams across the different stages of growth.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Knowledge Hut

DECEMBER 28, 2023

Besides, most servers offer multi-format flexibility – that is, they allow you to view queries in colour-coded formats and export them to HTML, Excel, or PDF – which makes it simple for both technical and non-technical persons to use the tool. Link and administer MariaDB/MySQL servers through SSH tunnels.

SQL 52

SQL MySQL PostgreSQL Database 52

Rockset

OCTOBER 20, 2021

Introducing dbt Core + Rockset Back in July, we introduced our dbt-Rockset adapter for the first time which brought real-time analytics to dbt , an immensely popular open-source data transformation tool that lets teams quickly and collaboratively deploy analytics code to ship higher quality data sets. PostgreSQL or MySQL).

SQL 52

SQL PostgreSQL MongoDB NoSQL 52

ProjectPro

JANUARY 19, 2022

It involves building pipelines that can fetch data from the source, transform it into a usable form, and analyze variables present in the data. Build an Awesome Job Winning Data Engineering Projects Portfoli o Data Engineer: Job Growth in Future The demand for data engineers has been on a sharp rise since 2016.

Data Engineering 52

Data Engineering Data Engineer Engineering Amazon Web Services 52

Knowledge Hut

JULY 7, 2023

In our case, we will use MySQL database examples. To understand more about the basics of relational databases, SQL, and MySQL to perform thorough data analytics through live, interactive sessions, quizzes, assignments, and hands-on projects, you can check out this online SQL course. Source Code 2. Source Code 3.

SQL 52

SQL Coding Project Hospitality 52

Data Engineering Podcast

DECEMBER 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Data Engineering Podcast

DECEMBER 25, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode.

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Workfall

JANUARY 17, 2024

FastAPI is a modern, high-performance web framework for building APIs with Python based on standard type hints. Fast to code : It allows for significant increases in development speed. Short : It minimizes code duplication. Robust : It provides production-ready code with automatic interactive documentation.

Python 76

Python MySQL Coding Database 76

Data Engineering Podcast

NOVEMBER 20, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 130

Data Lake Data Ingestion MongoDB Scala 130

Data Engineering Podcast

JUNE 26, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Data Engineering Podcast

DECEMBER 18, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode. Upsolver]([link] Build Real-Time Pipelines.

Data Lake 100

Data Lake Data Warehouse Data Pipeline MongoDB 100

Data Engineering Podcast

NOVEMBER 27, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. RudderStack also supports real-time use cases.

Data Lake 100

Data Lake Data Warehouse MongoDB Data Pipeline 100

Data Engineering Podcast

JULY 8, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. At CluedIn they call it “eventual connectivity”.

Data Warehouse 100

Data Warehouse MySQL Data Lake Hadoop 100

AltexSoft

NOVEMBER 7, 2022

It sticks to the workflow as code philosophy which makes the platform unsuitable for non-developers. Each DAG is essentially a Python script that represents workflow as code. For production purposes, choose from PostgreSQL 10+, MySQL 8+, and MsSQL. Everything as code: flexibility and total control of the logic.

PostgreSQL 52

PostgreSQL Metadata Python MySQL 52

AltexSoft

OCTOBER 8, 2021

For this purpose, you will have to build a 360-degree customer picture. While data integration is attractive and fruitful in many ways, building such a solution in-house is a complex, time-consuming task that would require a lot of resources. To make a more informed decision, enquire about demos and do your own in-depth research.

Data Integration 52

Data Integration Hadoop Data Warehouse Data Lake 52

Cloudera

MARCH 15, 2023

In this post I am going to set up a demo environment with a Spring Boot microservice and a streaming cluster using Cloudera Public Cloud. Implementation based on Cloudera Public Cloud and Debezium The source code of the demo application is available on github.

PostgreSQL 90

PostgreSQL Kafka Database Data 90

Confluent

APRIL 4, 2019

This is the simplest way a microservice can subscribe to a stream of events: Within the microservice application, use the Kafka Streams library to build a stream from the data in a Kafka topic, using the method StreamsBuilder#stream(). The application creates a table from it with a unique entry per customer ID.

Kafka 108

Kafka Data Cleanse Retail Finance 108