KDnuggets

MAY 14, 2025

Add these 4 data analytic-based projects to your resume to land your next job.

Data Analytics 86

Data Analytics Project Data 86

Scott Logic

MAY 14, 2025

Note: A version of this article was originally shared on LinkedIn in February 2025. As the capabilities and accessibility of AI continue to advanceincluding more sophisticated reasoning capabilitiesseveral questions and risk areas emerge that deserve our attention. This is particularly relevant in light of the publication of Gradual Disempowerment, a framework that explores how humans may unwittingly cede agency to AI systems.

Electronics 52

Electronics Media Cloud Computing Architecture 52

Precisely

MAY 12, 2025

Better decision-making, innovation, and compliance all hinge on one common factor: trusted data. And today, were working with more data than ever. But heres a fundamental challenge that many organizations face and one Ive encountered in countless conversations with customers: they dont fully understand what data they have, let alone whether they can trust it.

Government 64

Government Metadata Data Governance Data 64

The Pragmatic Engineer

MAY 15, 2025

Originally published in The Pragmatic Engineer Newsletter. The volume of questions asked on Stack Overflow has nearly dried up, new data shows: Questions have slumped to levels last seen when Stack Overflow launched in 2009. Source: Stack Overflow Data Explorer (SEDE) / Marc Gravell  on X This graph  was shared  by  Marc Gravell , a top 10 all-time contributor to Stack Overflow.

Coding 351

Coding Engineering IT Data 351

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

databricks

MAY 14, 2025

Today were announcing the launch of Data Intelligence for Marketing, combining the Databricks Data Intelligence Platform with out-of-the-box integrations to an ecosystem of leading marketing

Data 84

Data 84

Picnic Engineering

MAY 15, 2025

In the fast-paced world of online grocery delivery, making data-driven decisions quickly can be the difference between delighting customers and losing them to a competitor. Therefore, at Picnic, real-time monitoring is essential, especially in our order fulfilment operations. For example, warehouse operators need real-time data to make sure orders are ready for on-time delivery.

Building 59

Building Transportation Kafka Raw Data 59

KDnuggets

MAY 14, 2025

This guide introduces data streaming from a data science perspective. Well explain what it is, why it matters, and how to use tools like Apache Kafka, Apache Flink, and PyFlink to build real-time pipelines.

Kafka 93

Kafka Data Data Science Building 93

databricks

MAY 12, 2025

Driving business transformation with data and AI takes more than the right tools it needs the right strategy.

Data 64

Data IT 64

Retail Insight

MAY 15, 2025

Customers vote with their feet. And this is becoming an increasing problem for grocery retailers. Especially when it comes to on-shelf availability.

Retail 52

Retail IT Data 52

ArcGIS

MAY 14, 2025

Simplify CAD and BIM integration in ArcGIS Pro 3.5 for model federation and sharing workflows. Bring content into context for analysis and collaboration.

Transportation 92

Transportation Cloud 92

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data Workflow

KDnuggets

MAY 13, 2025

Are you eager to enhance your artificial intelligence skills? We've curated a fantastic selection of free AI books to aid your learning journey!

139

139

databricks

MAY 14, 2025

Today, we are excited to announce that we have agreed to acquire Neon, a developer-first, serverless Postgres company.

126

126

WeCloudData

MAY 14, 2025

Building strong models or innovative solutions is only half the battle in today’s data-driven world; the other half is effectively kubernetes deployment, scaling, and maintaining these applications. Whether you’re a data scientist moving your machine learning model from notebook to production, an AI engineer making sure models handle thousands of real-time queries, or a DevOps […] The post Kubernates appeared first on WeCloudData.

Machine Learning 52

Machine Learning Engineering Building Data 52

ArcGIS

MAY 14, 2025

Learn more about exciting new functionality and improvements made to ArcGIS Utility Network with the 2025 Network Management Release.

Utilities 97

Utilities Management 97

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

KDnuggets

MAY 14, 2025

In this article, you'll master 10 essential Linux file system commands. This guide provides helpful examples to make working with files easier.

Systems 110

Systems Data Management Management Data 110

databricks

MAY 16, 2025

Azure Databricks is a first-party Microsoft service, natively integrated with the Azure ecosystem to unify data and AI with high-performance analytics and deep tooling support.

Data 87

Data 87

Data Engineering Weekly

MAY 11, 2025

Dagster Running Dagster: Our Open Platform We’re pulling back the curtain. Join us on May 13 for a live deep dive into how Dagster Labs runs Dagster in production. One of our lead data engineers will walk through our real-world implementation, architecture decisions, and the lessons we've learned scaling the platform. Register now Editor’s Note: OpenXData Conference - 2025 - A Free Virtual Event A free virtual event on open data architectures - Iceberg, Hudi, lakehouses, query engine

Data Engineering 52

Data Engineering Data Engineer Engineering Data Ingestion 52

ArcGIS

MAY 14, 2025

Learn about the new VectorTileSharingDraft class in the arcpy.sharing module.

Python 62

Python 62

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

KDnuggets

MAY 12, 2025

Master LLMs through books, courses, tutorials, exercises, projects, and comprehensive guides that cover everything from foundational concepts to advanced techniques.

Project 136

Project 136

databricks

MAY 12, 2025

The oil and gas industry relies heavily on seismic data to explore and extract hydrocarbons safely and efficiently.

Data Pipeline 52

Data Pipeline Data Process 52

Teradata

MAY 16, 2025

Skip to main content Support Global Global Deutschland France 日本 대한민국 Why Teradata Our platform Getting started Insights About us search Try for free Contact us search Join us at Possible 2025. Register now Join us at Possible 2025. Register now Home Insights Artificial Intelligence Article Meeting Customer Expectation in a World of Instant Gratification: The Rise of AI-Native Customer Experience Today’s customers operate in a world shaped by instant gra

Telecommunication 52

Telecommunication Consulting Media Data Architecture 52

ArcGIS

MAY 14, 2025

Stay updated: Use UpdateTargetVersion to get patch notifications for your version of ArcGIS Pro even when it isn't the latest version!

IT 70

IT 70

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineer

KDnuggets

MAY 16, 2025

Discover the what, why, and how of serverless machine learning with the interactive course GitHub repository.

Machine Learning 100

Machine Learning 100

databricks

MAY 15, 2025

Partnerships are essential to helping our customers unlock the full value of the Databricks Data Intelligence Platform.

Data 65

Data 65

Seattle Data Guy

MAY 13, 2025

Maybe youre luckier than me. Maybe youve never opened a.sql file or anAirflow DAG only to be greeted by a 5,000+ line query…a true monster of a script that leaves you wondering where to begin. Ive seen plenty of these, and every time, I ask myself:Why in the world do these exist? And, more… Read more The post How To Write Better SQL – Simplifying Complex SQL appeared first on Seattle Data Guy.

SQL 173

SQL Data Pipeline Data Big Data 173

ArcGIS

MAY 12, 2025

ArcGIS Pro on Windows 365 GPU-enabled Cloud PCs

Cloud 62

Cloud 62

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

KDnuggets

MAY 16, 2025

This article guides you throughout a demo project to set up and run an instance of this powerful multi-modal model in a Python script or notebook.

Project 83

Project Python 83

databricks

MAY 12, 2025

Our customers frequently highlight a critical challenge to AI adoption: ensuring sensitive data remains consistently governed and secured as it moves across data platforms, applications,

Government 59

Government Data Governance Data IT 59

Engineering at Meta

MAY 15, 2025

Today we are announcing an alpha version of Pyrefly , an open source Python type checker and IDE extension crafted in Rust. Pyrefly is a static typechecker that analyzes Python code to ensure type consistency and help you catch errors throughout your codebase before your code runs. It also supports IDE integration and CLI usage to give you flexibility in how you incorporate it into your workflow.

Python 124

Python Coding Programming Project 124

ArcGIS

MAY 13, 2025

In ArcGIS Pro 3.5, we have just launched the first of a new toolset of cartogram generating tools, Generate Contiguous Cartogram.

126

126

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

Software Engineer