Data Engineering Podcast

JULY 27, 2020

In this episode he shares his approach to testing complex systems, the common challenges that are faced by engineers who build them, and why it is important to understand their limitations. Go to dataengineeringpodcast.com/conferences to check out the upcoming events being offered by our partners and get registered today!

Systems 100

Systems Building Scala Java 100

Data Engineering Podcast

DECEMBER 30, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Process 100

Process Building Hadoop Java 100

Data Engineering Podcast

DECEMBER 22, 2019

To address that need more completely the team at Materialize has created an engine that allows for building queryable views of your data as it is continually updated from the stream of changes being generated by your applications. Between those use cases there are varying levels of support for fast reads on quickly changing data.

SQL 100

SQL Building Engineering Java 100

Striim

MARCH 22, 2023

Before we set up our environment and start building and deploying the image, let’s go through the definitions of both tools. Hashicorp Packer is an open-source Infrastructure-as-Code (IaC) tool that enables you to quickly build and deploy custom images for cloud and on-premises environments. and Java JDK (V1.8.0) What is Striim?

Google Cloud 52

Google Cloud Cloud Amazon Web Services Building 52

Data Engineering Podcast

OCTOBER 22, 2023

In this episode Ranjith Raghunath shares his thoughts on how to build a strategy for the development, delivery, and evolution of data products. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.

BI 162

BI SQL Machine Learning Programming Language 162

Data Engineering Podcast

OCTOBER 8, 2023

Max Cho found that fact frustrating enough that he decided to build a business of making policy selection more navigable. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. Materialize : ![Materialize]([link]

Insurance 162

Insurance BI SQL Machine Learning 162

Knowledge Hut

JUNE 26, 2023

This article is mainly focused on explaining different backend projects for beginners or students, intermediate learners, or those who have mid enough software development experience building large scalable projects. It's good to have some understanding of programming languages like, Java, Python or Node.js.

Portfolio 98

Portfolio Project Food Media 98

Christophe Blefari

JANUARY 20, 2024

Zuckerberg teased 2024 Meta AI strategy — In a selfie video on Facebook / Instagram Zucky explained that Llama 3 is coming and that Meta is building a massive 600k H100 NVidia GPU infrastructure. Far from trends and the lights, it's actually time to build tools. in pre-seed to build GenAI monitoring applications.

Data 130

Data Google Cloud Python Algorithm 130

LinkedIn Engineering

SEPTEMBER 20, 2023

When I started my role here, I had to shift to using a different tech stack: Java for the backend and JavaScript framework for the frontend. When I first started out, I came from a biology background, so I was not aware of programming languages and how to translate them into building a technical resume.

Engineering 89

Engineering Programming Language Java Media 89

Zalando Engineering

JUNE 21, 2016

Java programming roles need to cover a lot of ground when it comes to knowledge and processes. We’ve put together a list of essential points that developers should be familiar with when applying for a Java development position. You’ll want to use functional idioms, but don’t overuse them: Java is not a functional language.

Java 40

Java NoSQL Programming Language Kafka 40

Christophe Blefari

MARCH 24, 2023

I really liked the presentations from Mage and Kestra and even if I was focus on hosting the event it was great to see 2 other visions about the future of orchestration. Tommy, Mage's CEO, said that for the moment they will focus on building the best open-source data pipelines tool. They got enough funding for the next 2 years.

Lambda Architecture 130

Lambda Architecture Data Pipeline Data SQL 130

Rockset

MAY 31, 2019

Live dashboards can help organizations make sense of their event data and understand what's happening in their businesses in real time. In many situations, it is important to be able to take immediate action based on real-time event data, as in the case of limited-time sales in e-commerce or managing contact center service levels.

BI 40

BI Java Data SQL 40

Knowledge Hut

OCTOBER 5, 2023

Both applications AWS Functions and AWS Lambda effectively act as event-driven platforms that enable users to write programs in a variety of programming languages. HTTP requests, timers, data changes within Azure services, and even bespoke events from outside sources fall under this category. source for significant occurrences.

AWS 52

AWS Amazon Web Services Cloud Computing Programming Language 52

Data Engineering Podcast

APRIL 24, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Machine Learning 100

Machine Learning Systems Data Lake Metadata 100

Data Engineering Podcast

NOVEMBER 6, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

MongoDB 130

MongoDB Scala MySQL Data Lake 130

Data Engineering Podcast

JUNE 12, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Unstructured Data 130

Unstructured Data MongoDB Scala MySQL 130

Data Engineering Podcast

SEPTEMBER 25, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Food 100

Food MongoDB Scala MySQL 100

Knowledge Hut

DECEMBER 19, 2023

Java, as the language of digital technology, is one of the most popular and robust of all software programming languages. Java, like Python or JavaScript, is a coding language that is highly in demand. Java, like Python or JavaScript, is a coding language that is highly in demand. Who is a Java Full Stack Developer?

Java 98

Java Programming Language Architecture Database 98

Data Engineering Podcast

JULY 24, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. You’re releasing the stable 1.0

MongoDB 100

MongoDB Scala MySQL Data Lake 100

Data Engineering Podcast

NOVEMBER 13, 2022

Summary CreditKarma builds data products that help consumers take advantage of their credit and financial capabilities. In this episode Vishnu Venkataraman shares the journey that he and his team have taken to build and evolve their systems and improve the product offerings that they are able to support.

MongoDB 100

MongoDB Scala MySQL Google Cloud 100

Netflix Tech

MARCH 10, 2023

This platform has evolved from supporting studio applications to data science applications, machine-learning applications to discover the assets metadata, and build various data facts. We build the data pipeline to persist the assets data in the iceberg in parallel with cassandra and elasticsearch DB.

Management 94

Management Kafka Metadata Media 94

Data Engineering Podcast

OCTOBER 30, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Can you describe what Optimus is?

Engineering 100

Engineering MongoDB Scala MySQL 100

Rockset

SEPTEMBER 2, 2022

Raghavendra Prabhu (RVP) is Head of Engineering and Research at Covariant , a Series C startup building an universal AI platform for robotics starting in the logistics industry. Nikhil Garg is CEO and co-founder of Fennel AI , a startup working on building the future of real-time machine learning infrastructure.

Systems 52

Systems Building Machine Learning NoSQL 52

Knowledge Hut

MAY 2, 2024

As per Apache, “ Apache Spark is a unified analytics engine for large-scale data processing ” Spark is a cluster computing framework, somewhat similar to MapReduce but has a lot more capabilities, features, speed and provides APIs for developers in many languages like Scala, Python, Java and R.

Scala 52

Scala Hospitality Healthcare Retail 52

Data Engineering Podcast

JULY 17, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Data Engineering Podcast

OCTOBER 16, 2022

In this episode Jason Hughes explains what it means for a lakehouse to be "open" and describes the different components that the Dremio team build and contribute to. RudderStack helps you build a customer data platform on your warehouse or data lake. Go to dataengineeringpodcast.com/ascend and sign up for a free trial.

Data Lake 100

Data Lake Food MongoDB Scala 100

Knowledge Hut

NOVEMBER 30, 2023

Build a Solid Data Science Foundation If you’re willing to secure a job as a data scientist without any prior experience and get hired in data science openings for freshers , ensure to build a solid data science foundation. Build a data science portfolio to highlight your work and learn from others' work as you progress.

Data Science 98

Data Science Portfolio Programming Language Programming 98

Data Engineering Podcast

JULY 10, 2022

Summary Building and maintaining reliable data assets is the prime directive for data engineers. In this episode Chris Riccomini shares his experiences building and scaling data operations at WePay and LinkedIn, as well as the lessons he has learned working with other teams as they automated their own systems.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Data Engineering Podcast

MARCH 2, 2020

Summary Building applications on top of unbounded event streams is a complex endeavor, requiring careful integration of multiple disparate systems that were engineered in isolation. The ksqlDB project was created to address this state of affairs by building a unified layer on top of the Kafka ecosystem for stream processing.

Kafka 100

Kafka Process PostgreSQL MySQL 100

Data Engineering Podcast

OCTOBER 23, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Database 100

Database MySQL Cloud MongoDB 100

Snowflake

AUGUST 16, 2023

Developers can now start building and testing Snowflake Native Apps in their accounts in AWS. Build your own pricing strategy for your Snowflake Native Apps – public preview Snowflake offers a range of monetization options, from subscription-based models to usage-based models priced per month or per query. Learn more here.

Scala 52

Scala Transportation Kafka Data Lake 52

Data Engineering Weekly

FEBRUARY 4, 2024

It includes features for collaborative event definitions, violation management, real-time schema fixes, and monitoring and alerting. The author takes the Snowpipe Java streaming SDK and deep-dives into various stages of how it works internally. It's an excellent read if you're a snowflake user. The goal is to deliver, not detour.

Data Engineering 62

Data Engineering Data Engineer Engineering PostgreSQL 62

Data Engineering Podcast

SEPTEMBER 18, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Hospitality 100

Hospitality Food MongoDB Scala 100

Knowledge Hut

NOVEMBER 27, 2023

At the forefront of cloud technology is the Google Cloud Platform (GCP), a robust and versatile suite of tools and services designed to enable businesses to build, deploy, and scale their applications with ease and efficiency. A strong grasp of programming languages such as Python, Java, Go, and Node.js

Google Cloud 52

Google Cloud Cloud Cloud Computing Pipeline-centric 52

Data Engineering Podcast

JULY 3, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Integration 100

Data Integration MongoDB Scala MySQL 100

Data Engineering Podcast

FEBRUARY 22, 2021

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. field constraints, valid enums, etc.)

Data Integration 100

Data Integration Data Warehouse Data Pipeline BI 100

Data Engineering Podcast

OCTOBER 9, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Food 100

Food MongoDB Scala MySQL 100