Data Engineering Podcast

AUGUST 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Building 100

Building MongoDB Scala MySQL 100

Data Engineering Podcast

JULY 27, 2020

In this episode he shares his approach to testing complex systems, the common challenges that are faced by engineers who build them, and why it is important to understand their limitations. I’m working with O’Reilly on a project to collect the 97 things that every data engineer should know, and I need your help.

Systems 100

Systems Building Scala Java 100

Knowledge Hut

OCTOBER 26, 2023

The full-stack developer projects involve front and back-end developments. But what are these full-stack projects? This article will talk more about full stack development projects, their significance, and other dos and don’ts for beginners. What is Full Stack Development Project? What are the technologies used in them?

Coding 52

Coding Project Food Portfolio 52

Knowledge Hut

DECEMBER 28, 2023

In this blog, we'll talk about intriguing and real-time sample Hadoop projects with source codes that can help you take your data analysis to the next level. Why Are Hadoop Projects So Important? Competitive Advantage: Utilizing Hadoop projects can give organizations a competitive edge through data-driven insights.

Hadoop 52

Hadoop Project Datasets Big Data 52

Cloudera

JANUARY 6, 2021

Python is used extensively among Data Engineers and Data Scientists to solve all sorts of problems from ETL/ELT pipelines to building machine learning models. For data professionals that want to make use of data stored in HBase the recent upstream project “hbase-connectors” can be used with PySpark for basic operations.

Machine Learning 134

Machine Learning Data Science Database Building 134

Edureka

APRIL 17, 2023

As a data analytics professional, building a strong portfolio of projects is essential to showcase your skills and expertise to potential employers. This article will discuss nine data analytics project ideas for your portfolio. Lest discuss about data analytics projects ideas in next section.

Portfolio 40

Portfolio Data Analytics Project Data Mining 40

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode she shares the story behind the project, the details of how it is implemented, and how you can use it for your own data projects. RudderStack helps you build a customer data platform on your warehouse or data lake. How has that informed your efforts in the development and release of the project?

MongoDB 130

MongoDB Scala MySQL Machine Learning 130

Zalando Engineering

APRIL 12, 2023

Some teams use tools like dependabot , scala-steward that create pull requests in repositories when new library versions are available. Other teams update dependencies regularly in bulk, supported by build system plugins (e.g. Some projects, like openssl, preannounce security updates allowing for more preparation time.

Java 98

Java Scala Python Metadata 98

Knowledge Hut

JANUARY 18, 2024

Maybe there's an open-source project that interests you, or maybe a company in your area offers classes for aspiring data scientists. For example, if you're comfortable building simple linear regression models or natural language processing data science, try tackling logistic regression instead or maybe even deep neural networks!

Programming Language 98

Programming Language Data Science Programming Scala 98

Data Engineering Podcast

OCTOBER 30, 2022

To help simplify the adoption and management of dbt projects Nandam Karthik helped create Optimus. RudderStack helps you build a customer data platform on your warehouse or data lake. Can you describe what Sigmoid is and the types of projects that you are involved in? Can you describe what Optimus is?

Engineering 100

Engineering MongoDB Scala MySQL 100

Data Engineering Podcast

JUNE 12, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Unstructured Data 130

Unstructured Data MongoDB Scala MySQL 130

Zalando Engineering

NOVEMBER 19, 2023

Origami builds on top of Elasticsearch and our internal/Zalando-specific suite of APIs. The application is written in Scala and using a Java High Level REST Client, which got deprecated in Elasticsearch 7.15.0 As always after a big project, we had a retrospective, and the team was pretty happy with the results.

Scala 85

Scala Java Coding IT 85

Knowledge Hut

DECEMBER 22, 2023

Collaboration: Learn to work effectively in teams, as data science often involves collaborative projects with diverse stakeholders. Python R SQL Java Julia Scala C/C++ JavaScript Swift Go MATLAB SAS Data Manipulation and Analysis: Develop skills in data wrangling, data cleaning, and data preprocessing.

Portfolio 98

Portfolio Data Science Programming Language Scala 98

ProjectPro

FEBRUARY 21, 2023

Apache Spark Developer is a software developer or a big data developer who specializes in building large data-processing applications or solutions using Apache Spark big data framework. Python, Java, and Scala knowledge are essential for Apache Spark developers. Creating Spark/Scala jobs to aggregate and transform data.

Scala 52

Scala Programming Language Java Hadoop 52

Data Engineering Podcast

OCTOBER 16, 2022

In this episode Jason Hughes explains what it means for a lakehouse to be "open" and describes the different components that the Dremio team build and contribute to. RudderStack helps you build a customer data platform on your warehouse or data lake. How are those projects/investments being used in the commercial offering?

Data Lake 100

Data Lake Food MongoDB Scala 100

Rock the JVM

SEPTEMBER 17, 2023

Lucas’ story is shared by lots of beginner Scala developers, which is why I wanted to post it here on the blog. I’ve watched thousands of developers learn Scala from scratch, and, like Lucas, they love it! If you want to learn Scala well and fast, take a look at my Scala Essentials course at Rock the JVM. sum > 8 ).

Scala 142

Scala Programming Coding Java 142

Data Engineering Podcast

OCTOBER 23, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Database 100

Database MySQL Cloud MongoDB 100

Data Engineering Podcast

OCTOBER 9, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. When is a C360 project the wrong choice?

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

NOVEMBER 13, 2022

Summary CreditKarma builds data products that help consumers take advantage of their credit and financial capabilities. In this episode Vishnu Venkataraman shares the journey that he and his team have taken to build and evolve their systems and improve the product offerings that they are able to support.

MongoDB 100

MongoDB Scala MySQL Google Cloud 100

Knowledge Hut

MAY 2, 2024

As per Apache, “ Apache Spark is a unified analytics engine for large-scale data processing ” Spark is a cluster computing framework, somewhat similar to MapReduce but has a lot more capabilities, features, speed and provides APIs for developers in many languages like Scala, Python, Java and R.

Scala 52

Scala Hospitality Healthcare Retail 52

Data Engineering Podcast

JULY 17, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Knowledge Hut

DECEMBER 26, 2023

After reading this book thoroughly, you can build real applications in a week or two maximum. Some of the integral topics that this book covers are MapReduce, mining data streams, link analysis, building recommendation systems, dimensionality reduction, and many more. The book might be fast-paced but is easy to understand and simple.

Data Science 52

Data Science Scala Programming Language R (Programming) 52

Data Engineering Podcast

JULY 3, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Integration 100

Data Integration MongoDB Scala MySQL 100

Knowledge Hut

MARCH 13, 2024

While the exact AI engineer responsibilities depend on where you work and what you work on, some fundamental ones include Working on the application backend with programming languages like Python, Lisp, JavaScript, Scala, etc. Hence, they must know how to use tools like Kubernetes and Docker to manage configurations, build containers, etc.

Engineering 52

Engineering Programming Language Scala Algorithm 52

Data Engineering Podcast

JULY 24, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

MongoDB 100

MongoDB Scala MySQL Data Lake 100

Data Engineering Podcast

JULY 10, 2022

Summary Building and maintaining reliable data assets is the prime directive for data engineers. In this episode Chris Riccomini shares his experiences building and scaling data operations at WePay and LinkedIn, as well as the lessons he has learned working with other teams as they automated their own systems.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Ascend.io

SEPTEMBER 5, 2023

Snowpark’s key benefit is its ability to support coding in languages other than SQL—such as Scala, Java, and Python—without moving data out of Snowflake and, therefore , take full advantage of its powerful capabilities through code. This paves the way for new interactions and capabilities.

IT 59

IT Scala Java Programming Language 59

Knowledge Hut

NOVEMBER 28, 2023

Data engineers need to work with large amounts of data and maintain the architectures used in various data science projects. If you imbibe these skills in your work and portray them lucratively in your data engineer skills, resume, you increase your chances of grabbing the best job opportunity and building a strong career path.

Data Engineering 52

Data Engineering Data Engineer Engineering Generalist 52

Data Engineering Podcast

SEPTEMBER 25, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

SEPTEMBER 18, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Hospitality 100

Hospitality Food MongoDB Scala 100

Data Engineering Podcast

AUGUST 6, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. What are the goals of the project?

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Data Engineering Podcast

AUGUST 13, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Metadata 100

Metadata MongoDB Scala MySQL 100

Rock the JVM

JULY 9, 2023

Setup Let’s go thr 132 - kotlin context receivers.mp4 ough the setup steps to harness the power of context receivers in your Kotlin project. If you want to try generating the project you own, just type gradle init on a command line, and answer the questions you’ll be asked. Make sure you have Kotlin version 1.8.22

Scala 52

Scala Java Software Engineer Software Engineering 52

Data Engineering Podcast

AUGUST 21, 2022

In this episode Shruti Bhat gives her view on the state of the ecosystem for real-time data and the work that she and her team at Rockset is doing to make it easier for engineers to build those experiences. The Ascend Data Automation Cloud provides a unified platform for data ingestion, transformation, orchestration, and observability.

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Knowledge Hut

DECEMBER 27, 2023

Even though some of these tasks can now be completed by new AI programs, testing is still an expensive and time-consuming aspect of any software development project, so a software engineer with basic skills can benefit from becoming proficient in these areas. even in the age of automation, is knowing how to test and debug software.

Software Engineer 98

Software Engineer Software Engineering Engineering Programming Language 98

Edureka

AUGUST 2, 2023

With R, data scientists can efficiently clean and preprocess data, perform advanced statistical analyses, build predictive models, and generate insightful visualizations. Scala Scala, a statically typed language, is often used in conjunction with Apache Spark, a big data processing framework.

Programming Language 52

Programming Language Programming Scala Pharmaceutical 52

Data Engineering Podcast

JUNE 26, 2022

Master Data Management (MDM) is the process of building consensus around what the information actually means in the context of the business and then shaping the data to match those semantics. RudderStack helps you build a customer data platform on your warehouse or data lake. Email hosts@dataengineeringpodcast.com ) with your story.

Data Management 100

Data Management Management MongoDB Scala 100