KDnuggets

DECEMBER 4, 2024

Learn to build, run, and manage data engineering pipelines both locally and in the cloud using popular tools.

Data Engineering 145

Data Engineering Data Engineer Engineering Project 145

Engineering at Meta

DECEMBER 3, 2024

Meta releases a Request for Proposals (RFP) to identify nuclear energy developers to support AI innovation and clean and renewable energy goals.

Engineering 145

Engineering Data 145

databricks

DECEMBER 1, 2024

We are excited to announce the Public Preview of Cross-Platform View Sharing. Available today, it allows data providers to share views across different.

IT 107

IT Data 107

ArcGIS

DECEMBER 3, 2024

This blog shows usability and accessibility improvements introduced in the Versioning contextual tab with the release of ArcGIS Pro 3.4.

Accessible 98

Accessible Accessibility Data Management Management 98

Advertisement

With over 30 million monthly downloads, Apache Airflow is the tool of choice for programmatically authoring, scheduling, and monitoring data pipelines. Airflow enables you to define workflows as Python code, allowing for dynamic and scalable pipelines suitable to any use case from ETL/ELT to running ML/AI operations in production. This introductory tutorial provides a crash course for writing and deploying your first Airflow pipeline.

Cloud

KDnuggets

DECEMBER 2, 2024

Learn reinforcement learning using free resources, including books, frameworks, courses, tutorials, example code, and projects.

Coding 136

Coding Project 136

Confessions of a Data Guy

DECEMBER 6, 2024

Well, everyone is abuzz with the recently announced S3 Tables that came out of AWS reinvent this year. I’m going to call fools gold on this one right out of the gate. I tried them out, in real life that is, not just some marketing buzz, and it will leave most people, not all, be […] The post AWS S3 Tables. Technical Introduction. appeared first on Confessions of a Data Guy.

AWS 130

AWS Data IT Big Data 130

ArcGIS

DECEMBER 4, 2024

Sample tool to add attachment date taken to an output table. Date taken data can be used in pop-up windows of an active map.

Data 96

Data Data Management Management 96

KDnuggets

DECEMBER 2, 2024

In this article, we’ll go over Python libraries for tasks like logging, unit testing, data handling, and more — each with features that can simplify your application development.

Python 126

Python Data 126

Seattle Data Guy

DECEMBER 3, 2024

When I broke into the data world, everyone wanted to hire data scientists that would let their companies become more data driven. There were statistics about the exabytes of data that we were creating and the value it would provide. However, a few years into my career, the data world started to make a pivot… Read more The post Preparing Your Data Infrastructure for 2025: Lessons from the Past, Strategies for the Future appeared first on Seattle Data Guy.

Data 130

Data IT 130

databricks

DECEMBER 4, 2024

In recent years, artificial intelligence has transformed from an aspirational technology to a driver of manufacturing innovation and efficiency. Understanding both the current.

Manufacturing 95

Manufacturing Technology Data 95

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Cloudera

DECEMBER 4, 2024

For more than a decade, Cloudera has been an ardent supporter and committee member of Apache NiFi, long recognizing its power and versatility for data ingestion, transformation, and delivery. Our customers rely on NiFi as well as the associated sub-projects (Apache MiNiFi and Registry) to connect to structured, unstructured, and multi-modal data from a variety of data sources – from edge devices to SaaS tools to server logs and change data capture streams.

Data Pipeline 92

Data Pipeline Data Ingestion Data Preparation Architecture 92

KDnuggets

DECEMBER 4, 2024

Here are five free resources in diverse formats and difficulty levels to acquaint with deep learning models at no cost.

Deep Learning 112

Deep Learning 112

Engineering at Meta

DECEMBER 2, 2024

Andromeda is Meta’s proprietary machine learning (ML) system design for retrieval in ad recommendation focused on delivering a step-function improvement in value to our advertisers and people. This system pushes the boundary of cutting edge AI for retrieval with NVIDIA Grace Hopper Superchip and Meta Training and Inference Accelerator (MTIA) hardware through innovations in ML model architecture, feature representation, learning algorithm, indexing, and inference paradigm.

Engineering 87

Engineering Algorithm Utilities Machine Learning 87

databricks

DECEMBER 3, 2024

The world of artificial intelligence (AI) and data analytics is about to get a significant boost, thanks to Databricks’ collaboration with NVIDIA. This.

Data Analytics 95

Data Analytics Data 95

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Cloudera

DECEMBER 4, 2024

Today enterprises can leverage the combination of Cloudera and Snowflake—two best-of-breed tools for ingestion, processing and consumption of data—for a single source of truth across all data, analytics, and AI workloads. But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. All this by making it easier for customers to connect their workloads with Snowflake, Cloudera, and unique AWS services such as Amazon Simple Storage Service

AWS 89

AWS Raw Data Relational Database Government 89

KDnuggets

DECEMBER 4, 2024

MongoDB is a database that’s great for handling large amounts of diverse data. This article walks you through installing MongoDB and using the MongoDB Shell to manage your data easily.

MongoDB 105

MongoDB Database Management Data 105

Snowflake

DECEMBER 4, 2024

Snowflake leaders offer insight on AI, open source and cybersecurity development — and the fundamental leadership skills required — in the years ahead. As we come to the end of a calendar year, it’s natural to contemplate what the new year will hold for us. It’s an understatement to say that the future is very hard to predict, but it’s possible to both prepare for the likeliest outcomes and stay ready to adapt to the unexpected.

Unstructured Data 75

Unstructured Data Data Lake Deep Learning Structured Data 75

databricks

DECEMBER 2, 2024

Predictive Optimization (PO) enhances the performance of Unity Catalog managed tables by intelligently optimizing data layouts, leading to significant improvements in query performance.

Management 88

Management Data 88

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Cloudera

DECEMBER 6, 2024

Artificial Intelligence promises to transform lives and business as we know it. But what does that future look like? The AI Forecast: Data and AI in the Cloud Era , sponsored by Cloudera, aims to take an objective look at the impact of AI on business, industry, and the world at large. Hosted weekly by Paul Muller, The AI Forecast speaks to experts in the space to understand the ins and outs of AI in the enterprise, the kinds of data architectures and infrastructures that support it, the guardrai

Manufacturing 82

Manufacturing Retail Finance Metadata 82

KDnuggets

DECEMBER 3, 2024

Check out these key concepts, tools, jargon, and tips for integrating ML models into existing software systems.

Machine Learning 102

Machine Learning Systems 102

ArcGIS

DECEMBER 5, 2024

Learn how to analyze uncertainty in your data using spatial statistics tools. Explore patterns of housing burden and make informed decisions with ArcGIS Pro 3.4.

Government 68

Government Data 68

databricks

DECEMBER 5, 2024

At Databricks, AutoML is our low-code/no-code model training API that empowers customers to create quality machine learning (ML) models with their data on.

Machine Learning 86

Machine Learning Coding Data 86

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Cloudera

DECEMBER 4, 2024

Welcome to the first installment of a series of posts discussing the recently announced Cloudera AI Inference service. Today, Artificial Intelligence (AI) and Machine Learning (ML) are more crucial than ever for organizations to turn data into a competitive advantage. To unlock the full potential of AI, however, businesses need to deploy models and AI applications at scale, in real-time, and with low latency and high throughput.

Architecture 72

Architecture BI Machine Learning Deep Learning 72

KDnuggets

DECEMBER 5, 2024

Learn how to bring the power of AI right to your Android phone—no cloud, no internet, just pure on-device intelligence!

Cloud 97

Cloud 97

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

databricks

DECEMBER 3, 2024

We’re thrilled to announce that Databricks has been recognized as a winner in multiple categories at the 2024 AWS Partner of the Year.

AWS 86

AWS 86

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Cloudera

DECEMBER 3, 2024

Many enterprises have heterogeneous data platforms and technology stacks across different business units or data domains. For decades, they have been struggling with scale, speed, and correctness required to derive timely, meaningful, and actionable insights from vast and diverse big data environments. Despite various architectural patterns and paradigms, they still end up with perpetual “data puddles” and silos in many non-interoperable data formats.

Metadata 84

Metadata SQL Database Data Warehouse 84

KDnuggets

DECEMBER 5, 2024

Let’s take a look at a concise roadmap to building a lasting and effective machine learning career.

Machine Learning 95

Machine Learning Building Computer Science Technology 95

Confluent

DECEMBER 4, 2024

Tableflow easily integrates with Amazon SageMaker Lakehouse, enabling you to quickly materialize your Apache Kafka topics into Iceberg tables stored in S3.

Kafka 64

Kafka Data Process 64

databricks

DECEMBER 2, 2024

Executive Summary In this blog post we explore how private equity (PE) firms can leverage data intelligence to enhance portfolio returns. We highlight.

Portfolio 83

Portfolio Data 83

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud