The Pragmatic Engineer

NOVEMBER 29, 2024

The last 12 months, The Pragmatic Engineer covered a variety of deepdives, revealing previously unshared details like: * What Stripe's engineering culture is like * The architecture evolution of Bluesky * How the ChatGPT scaled to meet demand * How Anthropic builds products * How and why hardware startup Oxide built two new computers from

Engineering 141

Engineering Architecture Building Computer Science 141

RandomTrees

NOVEMBER 29, 2024

Considering how most industries have rapidly evolved thanks to technology, upgrading grids has been of utmost importance for utility companies out there. With the increasing demand for energy and renewable energy transition progressing forward, the older grid systems fall behind because they cannot meet the efficiency, reliability, and sustainability targets.

Utilities 52

Utilities Big Data Algorithm Finance 52

KDnuggets

NOVEMBER 29, 2024

Working with large datasets is common but challenging. Here are some tips to make working with such large datasets in Python simpler.

Datasets 132

Datasets Python 132

Hevo

NOVEMBER 29, 2024

Databricks is a well-known cloud-based data engineering, processing, and analytics platform. One of its key functions is DATEDIFF(date_diff()) used by data professionals widely. The DATEDIFF function in Databricks is very helpful in analyzing time-based data. Using this function helps the user do complex operations like finding time differences between two date values.

Data Engineering 40

Data Engineering Data Engineer Cloud Engineering 40

Speaker: Jason Chester, Director, Product Management

In today’s manufacturing landscape, staying competitive means moving beyond reactive quality checks and toward real-time, data-driven process control. But what does true manufacturing process optimization look like—and why is it more urgent now than ever? Join Jason Chester in this new, thought-provoking session on how modern manufacturers are rethinking quality operations from the ground up.

Manufacturing

KDnuggets

NOVEMBER 29, 2024

Black Friday is finally here, and so are huge savings for your machine learning journey!

Machine Learning 118

Machine Learning 118

Hevo

NOVEMBER 29, 2024

Data is everywhere. We make huge amounts of data every day from our social media interactions to the things we buy online. According to expert predictions, data will globally surpass 175 zettabytes by 2025, a figure that is nearly unfathomable.

Data Analysis 40

Data Analysis Data Analytics Media Data 40

Confessions of a Data Guy

NOVEMBER 29, 2024

Well, another turkey day has come upon us all. I trust you are getting at least a day or two off from your overlords from writing code and taking names. While the rest of you will be slicing up that turkey with your friends and family, clinking your glasses and giving toasts to each other, […] The post Turkey Day Is Here – Black Friday Sale – %50 Off appeared first on Confessions of a Data Guy.

Coding 100

Coding Data 100

Hevo

NOVEMBER 29, 2024

With so many data integration tools available these days, it can become very overwhelming to choose one that best suits your needs. Here in this blog post, I have broken down an all-comprehensive comparison of two leading platforms: Airbyte VS Stitch.  So, let’s get into the main discussion.

Data Integration 52

Data Integration Data Pipeline IT Data 52

Hevo

NOVEMBER 29, 2024

When searching for a reliable data integration platform, many options might cross your mind. However, Hevo Data stands out as a no-code, fully managed solution. Recognized in G2’s Fall 2021 report, Hevo delivers unmatched ease of use, setup simplicity, and comprehensive support.

Data Engineering 40

Data Engineering Data Engineer Engineering Data Integration 40

Hevo

NOVEMBER 29, 2024

An ETL tool, which has become the critical choice for any organization today, is tied directly to the ever-growing importance of data integration. However, both Matillion and Talend are among the most used ETL tools, providing different functionalities suited to different business needs.

ETL Tools 40

ETL Tools Data Integration IT Data 40

Speaker: Kenten Danas, Senior Manager, Developer Relations

ETL and ELT are some of the most common data engineering use cases, but can come with challenges like scaling, connectivity to other systems, and dynamically adapting to changing data sources. Airflow is specifically designed for moving and transforming data in ETL/ELT pipelines, and new features in Airflow 3.0 like assets, backfills, and event-driven scheduling make orchestrating ETL/ELT pipelines easier than ever!

Data Engineering