KDnuggets

DECEMBER 4, 2024

Learn to build, run, and manage data engineering pipelines both locally and in the cloud using popular tools.

Data Engineer 144

Data Engineer Data Engineering Engineering Project 144

ArcGIS

DECEMBER 4, 2024

Sample tool to add attachment date taken to an output table. Date taken data can be used in pop-up windows of an active map.

Data 96

Data Data Management Management 96

KDnuggets

DECEMBER 4, 2024

Here are five free resources in diverse formats and difficulty levels to acquaint with deep learning models at no cost.

Deep Learning 111

Deep Learning 111

databricks

DECEMBER 4, 2024

In recent years, artificial intelligence has transformed from an aspirational technology to a driver of manufacturing innovation and efficiency. Understanding both the current.

Manufacturing 95

Manufacturing Technology Data 95

Advertisement

With over 30 million monthly downloads, Apache Airflow is the tool of choice for programmatically authoring, scheduling, and monitoring data pipelines. Airflow enables you to define workflows as Python code, allowing for dynamic and scalable pipelines suitable to any use case from ETL/ELT to running ML/AI operations in production. This introductory tutorial provides a crash course for writing and deploying your first Airflow pipeline.

Cloud

KDnuggets

DECEMBER 4, 2024

MongoDB is a database that’s great for handling large amounts of diverse data. This article walks you through installing MongoDB and using the MongoDB Shell to manage your data easily.

MongoDB 103

MongoDB Database Management Data 103

Cloudera

DECEMBER 4, 2024

For more than a decade, Cloudera has been an ardent supporter and committee member of Apache NiFi, long recognizing its power and versatility for data ingestion, transformation, and delivery. Our customers rely on NiFi as well as the associated sub-projects (Apache MiNiFi and Registry) to connect to structured, unstructured, and multi-modal data from a variety of data sources – from edge devices to SaaS tools to server logs and change data capture streams.

Data Pipeline 92

Data Pipeline Data Ingestion Data Preparation Architecture 92

Cloudera

DECEMBER 4, 2024

Today enterprises can leverage the combination of Cloudera and Snowflake—two best-of-breed tools for ingestion, processing and consumption of data—for a single source of truth across all data, analytics, and AI workloads. But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. All this by making it easier for customers to connect their workloads with Snowflake, Cloudera, and unique AWS services such as Amazon Simple Storage Service

AWS 89

AWS Raw Data Relational Database Government 89

databricks

DECEMBER 4, 2024

Established in 2020, EVPassport aims to transform the electric vehicle charging experience. Specializing in multi-family residences, hospitality, retail, workplaces, and commercial parking environments.

Hospitality 66

Hospitality Retail 66

Cloudera

DECEMBER 4, 2024

Welcome to the first installment of a series of posts discussing the recently announced Cloudera AI Inference service. Today, Artificial Intelligence (AI) and Machine Learning (ML) are more crucial than ever for organizations to turn data into a competitive advantage. To unlock the full potential of AI, however, businesses need to deploy models and AI applications at scale, in real-time, and with low latency and high throughput.

Architecture 72

Architecture BI Machine Learning Deep Learning 72

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Confluent

DECEMBER 4, 2024

Tableflow easily integrates with Amazon SageMaker Lakehouse, enabling you to quickly materialize your Apache Kafka topics into Iceberg tables stored in S3.

Kafka 64

Kafka Data Process 64

Elder Research

DECEMBER 4, 2024

Take a break from the usual routine and join thousands of data professionals for Advent of Code. It's a great way to sharpen your skills!

Coding 59

Coding Data IT 59

Confluent

DECEMBER 4, 2024

The recent release of mutual TLS (mTLS) on Confluent Cloud and Amazon Redshift has enabled the streaming of Confluent topics to Amazon Redshift materialized views.

Cloud 59

Cloud 59

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Towards Data Science

DECEMBER 4, 2024

Options, options…In this article, you’ll learn what the possibilities are for bringing your on-prem SQL Server data to Microsoft Fabric Continue reading on Towards Data Science »

SQL 56

SQL Data Science Data Data Engineering 56

databricks

DECEMBER 4, 2024

Databricks launches two new self-paced trainings to enhance SQL and AI-powered analytics skills The "Get Started with SQL analytics and BI" course covers how to use Databricks SQL for data analysis and Databricks AI/BI Dashboards and Genie spaces Additional courses being developed include "Databricks AI/BI for self-service analytics" and a deep dive for data analysts on building AI/BI Dashboards and Genie Spaces

BI 57

BI SQL Data Analysis Building 57

RandomTrees

DECEMBER 4, 2024

As one of the most important sectors of the global economy, the food and beverage (F&B) industry works in highly volatile conditions and ensures its success by reducing waste and managing inventories. Managing production and consumption, meeting deadlines, cutting waste, and being environmentally friendly are always a challenge. Old and traditional approaches often fail or become inefficient and unresponsive in real time.

Food 52

Food Management Manufacturing Machine Learning 52

Precisely

DECEMBER 4, 2024

At Precisely, we celebrate the women in our organization because we know that while more women are joining the technology industry, there’s still a gender gap. Supporting and advocating for women in technology is a top priority, which is why the Precisely Women in Technology (PWIT) program was established. Every month, a different woman from the program is featured in this Q&A to share her experience working in tech.

Professional Services 59

Professional Services Technology Education Programming 59

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Edureka

DECEMBER 4, 2024

It was a regular workday. IT worker Divya was halfway through her coffee when a colleague sent her an important email. The subject line read, WARNING: Critical Virus Detected! According to the email, if she didn’t remove a particular file right away, a new virus would cause her operating system to fail. Divya got scared and immediately tried to safeguard her system.

Media 52

Media Certification Systems Designing 52