KDnuggets

FEBRUARY 27, 2025

Looking to build your AI engineer toolkit in 2025? Here are Python libraries and frameworks you cant miss!

Python 144

Python Engineering Building 144

Monte Carlo

FEBRUARY 26, 2025

By now, most data leaders know that developing useful AI applications takes more than RAG pipelines and fine-tuned models it takes accurate, reliable, AI-ready data that you can trust in real-time. To borrow a well-worn idiom, when you put garbage data into your AI model, you get garbage results out of it. Of course, some level of data quality issues is an inevitabilityso, how bad is “bad” when it comes to data feeding your AI and ML models?

Banking 52

Banking Datasets Data Machine Learning 52

Confessions of a Data Guy

FEBRUARY 25, 2025

Maybe I’m the only one who thinks about it, not sure. The Lake House has become the new Data Warehouse, yet when I ask this question “What makes a health Lake House?” no one is sure what the answer is, or you get different answers. It seems like a pretty important question considering that Lake […] The post What is a Healthy Lake House?

Data Warehouse 100

Data Warehouse IT Data Big Data 100

Precisely

FEBRUARY 26, 2025

Key Takeaways: New AI-powered innovations in the Precisely Data Integrity Suite help you boost efficiency, maximize the ROI of data investments, and make confident, data-driven decisions. These enhancements improve data accessibility, enable business-friendly governance, and automate manual processes. The Suite ensures that your business remains data-driven and competitive in a rapidly evolving landscape.

Data Integration 64

Data Integration Data Management Management Data Governance 64

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

If AI agents are going to deliver ROI, they need to move beyond chat and actually do things. But, turning a model into a reliable, secure workflow agent isn’t as simple as plugging in an API. In this new webinar, Alex Salazar and Nate Barbettini will break down the emerging AI architecture that makes action possible, and how it differs from traditional integration approaches.

Systems

Cloudyard

FEBRUARY 24, 2025

Read Time: 2 Minute, 39 Second Snowflake Dynamic Tables offer a powerful way to automate data transformations, ensuring that tables remain fresh and up to date. However, refresh failures can occur due to various reasons such as query errors, or resource constraints. To proactively monitor and respond to such failures, we can leverage Snowflake Alerts to send email notifications whenever a refresh fails.

Designing 52

Designing Systems IT Data 52

Hevo

FEBRUARY 23, 2025

Organizations generate tons of data every second, yet 80% of enterprise data remains unstructured and unleveraged (Unstructured Data). Organizations need data ingestion and integration to realize the complete value of their data assets.

Data Ingestion 40

Data Ingestion Data Integration Unstructured Data Raw Data 40

WeCloudData

FEBRUARY 27, 2025

In the era of data-driven decision-making, terms like Business Intelligence (BI), Data Science (DS), and Data Engineering (DE) often surface in conversations. While all three play a crucial role in utilizing data to drive business outcomes, their functions, tools, and objectives differ significantly. Let’s break them down. Data Engineering (DE): Building the Data Infrastructure Objective: […] The post Business Intelligence (BI) vs Data Science (DS) vs Data Engineering (DE): What are

Business Intelligence 52

Business Intelligence BI Data Science Data Engineering 52

WeCloudData

FEBRUARY 28, 2025

AI or Artificial Intelligence agents are software programs that can interact with their environment, collect data, perceive, learn, and perform actions based on their environment. AI agents have practical applications in multiple domains, they can be virtual assistants like Google Assistant, Chatgpt and Siri, or complex simulations in healthcare. They enhanced the power of generative […] The post AI Agents: Types, Role, and Use Cases appeared first on WeCloudData.

Healthcare 52

Healthcare Programming Data Data Science 52

Hevo

FEBRUARY 23, 2025

You often find yourself caught in data complexity issues like data complexity, communication breakdowns, and data quality issues, making it tough for your teams to handle data modeling. Data modeling best practices creates a clear visual representation of how data is organized and how different pieces of information connect within a system.

Data 40

Data Systems IT Data Engineer 40

Snowflake

FEBRUARY 27, 2025

Established in 2023, Snowflakes Startup Accelerator offers early-stage startups unparalleled growth opportunities through hands-on support, extensive ecosystem access and resources that surpass what other platforms provide. To further meet the needs of early-stage startups, Snowflake is expanding the Startup Accelerator to now include up to a $200 million investment in startups building industry-specific solutions and growing their businesses on the Snowflake AI Data Cloud.

Cloud 93

Cloud IT Amazon Web Services AWS 93

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

Waitingforcode

FEBRUARY 26, 2025

Is there an easier way to address the insertInto position-based data writing in Apache Spark SQL? Totally, if you use a column-based method such as saveAsTable with append mode.

SQL 130

SQL Data 130

Data Engineering Weekly

FEBRUARY 23, 2025

Automate Airflow deploys with built-in CI/CD. Streamline code deployment, enhance collaboration, and ensure DevOps best practices with Astro's robust CI/CD capabilities. Try Astro Free → Editor’s Note: Data Council 2025, Apr 22-24, Oakland, CA Data Council has always been one of my favorite events to connect with and learn from the data engineering community.

Data Engineering 63

Data Engineering Data Engineer Engineering Kafka 63

KDnuggets

FEBRUARY 28, 2025

Learn how to build, test, deploy, and monitor machine learning models in the cloud with the BentoML ecosystem.

Machine Learning 125

Machine Learning Cloud Building 125

databricks

FEBRUARY 24, 2025

Introduction Stateful stream processing refers to processing a continuous stream of events in real-time while maintaining state based on the events seen so far. This.

Process 120

Process 120

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineering

ArcGIS

FEBRUARY 28, 2025

Accurately predicting agricultural harvest with ArcGIS Pro using satellite imagery, historic yield, climate variables, field data.

Machine Learning 112

Machine Learning Data 112

WeCloudData

FEBRUARY 26, 2025

Has this thought ever crossed your mind about how ChatGPT, Gemini, DeepSeek, or Microsoft Copilot can understand and respond to you like a human? You may have questions and curiosity about how these tools work and the driving force that makes it possible to mimic human intelligence. To satisfy your curiosity we will give you […] The post What is Natural Language Processing(NLP)?

Process 52

Process IT Consulting Data Science 52

KDnuggets

FEBRUARY 26, 2025

Tired of the job portal grind? Dont just applymake them come to you! Check out 7 powerful strategies to land top-paying tech jobs in 2025.

124

124

databricks

FEBRUARY 27, 2025

Introduction AI/BI Dashboards and Genie are evolving at a breakneck pace. In this roundup, well highlight the most impactful updates from the past three months.

BI 106

BI 106

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

ArcGIS

FEBRUARY 28, 2025

Learn how to use the new Migration toolset to make your utility network migration even easier.

Utilities 104

Utilities Data Management Management Data 104

Striim

FEBRUARY 26, 2025

As businesses increasingly rely on SaaS solutions like Stripe for payment processing, Striim’s integration makes it easier to move, analyze, and leverage payment data in real time. This connector helps streamline data workflows, allowing customers to consolidate their payment data and gain valuable insights faster than ever before. What Does the Stripe Reader Do?

Data Consolidation 40

Data Consolidation Data Workflow Data Pipeline Data 40

KDnuggets

FEBRUARY 25, 2025

Directions to become "upgraded" data scientists prepared to fully leverage generative AI technologies in the year ahead.

Data 120

Data Technology 120

databricks

FEBRUARY 26, 2025

Building an end-to-end AI or ML platform often requires multiple technological layers for storage, analytics, business intelligence (BI) tools, and ML models in order to.

Machine Learning 86

Machine Learning BI Business Intelligence Technology 86

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

Software Engineer

ArcGIS

FEBRUARY 26, 2025

Here is an outright hack to give a line a gradient along its path rather than across it. Maybe it will come in handy?

IT 87

IT 87

Striim

FEBRUARY 26, 2025

Customer engagement is crucial for businesses to thrive, and platforms like Intercom have made it easier than ever to connect with users through messaging tools for sales, marketing, and customer care. Striim 5.0s new Intercom Reader makes it even easier by enabling seamless real-time data integration from the Intercom platform into your analytics systems.

Data Integration 40

Data Integration Data Collection Data Security Cloud 40

KDnuggets

FEBRUARY 26, 2025

Build, test, and deploy a complete application in minutes — just by chatting with OpenHands.

Building 119

Building 119

Hevo

FEBRUARY 23, 2025

Organizations generate tons of data every second, yet 80% of enterprise data remains unstructured and unleveraged (Unstructured Data). Organizations need data ingestion and integration to realize the complete value of their data assets.

Data Ingestion 40

Data Ingestion Data Integration Unstructured Data Raw Data 40

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

databricks

FEBRUARY 25, 2025

In today's fast-paced business environment, the ability to quickly access and analyze data is crucial for maintaining a competitive edge. As North America's largest book.

Data Analytics 83

Data Analytics SQL Data Accessible 83

Striim

FEBRUARY 26, 2025

Striims suite of connectors for Salesforce applications helps organizations streamline this process by enabling seamless, real-time data movement between Salesforce and other systems. Whether you’re working with Salesforce CRM, Pardot, or Salesforce Marketing Cloud, Striim simplifies the data integration experience. What Does It Do? Striim provides both read and write connectors for Salesforce applications, enabling real-time data movement across multiple Salesforce environments.

BI 40

BI Cloud Data Pipeline Data Integration 40

KDnuggets

FEBRUARY 25, 2025

Tired of 'it works on my machine' problems? Learn the top 10 Docker commands every data engineer needs to build, deploy, and scale projects like a pro!

Data Engineering 113

Data Engineering Data Engineer Engineering Data 113

ArcGIS

FEBRUARY 25, 2025

UC Louvain analysts used ArcGIS CityEngine for a Python-automated visibility analyses to determine suitable locations for urban wind turbines.

Python 82

Python Designing 82

Advertisement

Apache Airflow® is the open-source standard to manage workflows as code. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries. Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.

Datasets