Seattle Data Guy

JANUARY 17, 2023

Are data engineers all learning Rust? Our team is putting together an all day event focused on helping answer some… Read more The post What Is The State Of Data Engineering And Infrastructure In 2023 appeared first on Seattle Data Guy. Are Snowflake and Databricks still fighting over total cost of ownership?

Data Engineering 211

Data Engineering Data Engineer Engineering Data 211

Jesse Anderson

DECEMBER 12, 2022

Big data projects were given to data scientists and data warehouse teams, where the projects subsequently failed. As clearly evident as that sounds now, my writing about needing data engineering went heavily against the grain of everything that was written at the time.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

Confessions of a Data Guy

MARCH 20, 2023

For a lot of my Data Engineering career I didn’t really think about or use AWS lambdas, I just saw them as little annoying flies […] The post AWS Lambdas. Useful for Data Engineering? appeared first on Confessions of a Data Guy.

Data Engineering 130

Data Engineering Data Engineer AWS Engineering 130

Simon Späti

OCTOBER 19, 2022

Will Rust kill Python for Data Engineers? But then again, you have to ask: was Python made for Data Engineering in the first place? Rust may not replace Python outright, but it has consumed more and more of JavaScript tooling and there are increasingly many projects trying to do the same with Python/Data Engineering.

Data Engineering 130

Data Engineering Data Engineer Engineering Python 130

Simon Späti

OCTOBER 19, 2022

Will Rust kill Python for Data Engineers? But then again, you have to ask: was Python made for Data Engineering in the first place? Rust may not replace Python outright, but it has consumed more and more of JavaScript tooling and there are increasingly many projects trying to do the same with Python/Data Engineering.

Data Engineering 130

Data Engineering Data Engineer Engineering Python 130

KDnuggets

MAY 24, 2023

Generative AI has just started to capture the imagination of data engineers, so the impact thus far has been just a fraction of what it will be a year or two from now.

Data Engineering 102

Data Engineering Data Engineer Engineering Data 102

Towards Data Science

MAY 22, 2023

Solving data preparation tasks with ChatGPT Photo by Ricardo Gomez Angel on Unsplash Data engineering makes up a large part of the data science process. In CRISP-DM this process stage is called “data preparation”. It comprises tasks such as data ingestion, data transformation and data quality assurance.

Data Engineering 89

Data Engineering Data Engineer Engineering Data 89

Medium Data Engineering

MAY 22, 2023

In this series I’m introducing several important concepts that new Data Engineers should be aware of. The other topics I talked so far: ✅… Continue reading on Medium »

Data Engineering 98

Data Engineering Data Engineer Data Architecture Engineering 98

Medium Data Engineering

MAY 18, 2023

In this series I’m introducing several important concepts that new Data Engineers should be aware of. The other topics I talked so far: ✅… Continue reading on Medium »

Data Engineering 98

Data Engineering Data Engineer Engineering Data 98

Data Engineering Weekly

MAY 28, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make collecting data from every application, website, and SaaS platform easy, then activating it in your warehouse and business tools. or does it have the real potential to bring architectural changes to the data warehouse?

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Knowledge Hut

MAY 3, 2023

With companies increasingly relying on data-driven insights to make informed decisions, there has never been a greater need for skilled specialists who can manage and evaluate vast amounts of data. The roles of data analyst and data engineer have emerged as two of the most in-demand professions in today's job market.

Data Engineering 98

Data Engineering Data Engineer Engineering Data 98

Medium Data Engineering

MAY 25, 2023

Data Engineering is a crucial field within the realm of data science and analytics that focuses on the development, deployment, and… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MARCH 17, 2023

Data engineering refers to the process of developing and creating the infrastructure to manage, store, process and analyze massive amounts… Continue reading on Medium »

Data Engineering 98

Data Engineering Data Engineer Engineering Data 98

Medium Data Engineering

MAY 13, 2023

Good data sometimes produces good results, but bad data always produces bad results Continue reading on Data Engineer Things »

Data Engineering 98

Data Engineering Data Engineer Engineering Data 98

KDnuggets

NOVEMBER 2, 2022

A data engineer is a fast-growing profession with amazing challenges and rewards. Which skills do you need to become a data engineer? In this post, we’ll take a look at both hard and soft skills.

Data Engineering 142

Data Engineering Data Engineer Engineering Data 142

Towards Data Science

FEBRUARY 24, 2023

The Chaos Data-Engineering Manifesto Another lesson we can learn from software engineers: break stuff to make it more reliable. While this idea isn’t completely foreign to data engineering, it can certainly be described as an extremely uncommon practice. Data is different. It’s terrifying. I’m afraid so.

Data Engineering 95

Data Engineering Data Engineer Engineering Data 95

Medium Data Engineering

APRIL 12, 2023

If you’re a data engineer, think of exciting projects as your own personal amusement park! Just like how a rollercoaster or a water slide… Continue reading on Medium »

Data Engineering 92

Data Engineering Data Engineer Engineering Project 92

Medium Data Engineering

MAY 16, 2023

In the world of data engineering, backups are essential for ensuring the safety and integrity of your data. Without proper backups, your… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 28, 2023

If you’re a data engineer looking to expand your skill set into the realm of machine learning (ML), you’ve come to the right place… Continue reading on Medium »

Machine Learning 52

Machine Learning Data Engineering Data Engineer Engineering 52

Medium Data Engineering

MAY 20, 2023

Data engineering has emerged as a critical discipline in the age of data-driven decision-making. To effectively manage and analyze massive… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 28, 2023

Breaking the Cycle — Moving Forward in Data Engineering Projects Continue reading on Data Engineer Things »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

APRIL 30, 2023

As a data engineer and software developer at GYTWorkz, I recently had the opportunity to attend the Data Engineering Summit 2023 organized… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

KDnuggets

FEBRUARY 7, 2023

Kickstart your Data Engineering career with these curated GitHub repositories.

Data Engineering 145

Data Engineering Data Engineer Engineering Data 145

Medium Data Engineering

MAY 29, 2023

As a data engineer, understanding various data architectures is crucial for designing and managing efficient data systems. These… Continue reading on Medium »

Data Architecture 52

Data Architecture Data Engineering Data Engineer Architecture 52

Medium Data Engineering

MAY 18, 2023

Data engineering interviews are designed to assess candidates’ technical expertise and theoretical knowledge in the field of data… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 6, 2023

In 2023, data engineering has been listed as one of the most in-demand and lucrative tech careers, with an estimated growth rate of 11%… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 21, 2023

Data engineering is a rapidly growing field, and cloud computing is one of the most in-demand areas of data engineering. If you’re… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 28, 2023

Data is the lifeblood of any business, and data engineers are the people responsible for collecting, storing, and processing that data. In… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 31, 2023

Introduction: Data engineering is a dynamic field that combines technical expertise, creativity, and problem-solving skills to transform… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 4, 2023

This is a free preview of my newsletter, where I distill data engineering concepts so you can learn new things or refresh your… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

KDnuggets

MAY 30, 2022

Get into the highly in-demand world of data engineering for free and earn 6 figures salary.

Data Engineering 145

Data Engineering Data Engineer Engineering Data 145

KDnuggets

FEBRUARY 24, 2023

This article will discuss SQL visualization, its role in augmenting the modern-day data engineer, and five categories of SQL visualization tools.

Data Engineering 98

Data Engineering Data Engineer SQL Engineering 98

Medium Data Engineering

MAY 26, 2023

Data engineering is a rapidly growing field that requires a diverse skill set to effectively manage and process large amounts of data. Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 31, 2023

หลังจากที่เรียนจบ Road To Data Engineer 2.0 จากเพจ Data TH.com — Data Science ชิลชิล เราก็จะได้ (..)

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 7, 2023

As data continues to play an increasingly important role in businesses, the role of a data engineer has become more crucial than ever. Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 29, 2023

As it’s a holiday today in Berlin, I decided to play around ChatGPT and let it write an article about data engineering with some detective… Continue reading on Medium »

Data Engineering 52

Data Engineering Data Engineer Engineering Data 52

Medium Data Engineering

MAY 13, 2023

In this era of rapid AI evolution, Data engineering plays a crucial role as it is responsible for preparing, processing, and managing the… Continue reading on Medium »

Data Engineering 98

Data Engineering Data Engineer Engineering Data 98