KDnuggets

MAY 8, 2024

Want to build cool AI applications? Start learning AI today with these free courses from NVIDIA.

Building 156

Building 156

Data Engineering Podcast

MAY 5, 2024

Summary Artificial intelligence has dominated the headlines for several months due to the successes of large language models. This has prompted numerous debates about the possibility of, and timeline for, artificial general intelligence (AGI). Peter Voss has dedicated decades of his life to the pursuit of truly intelligent software through the approach of cognitive AI.

Building 147

Building Data Lake High Quality Data Machine Learning 147

ArcGIS

MAY 7, 2024

Discover the exciting new features of ArcGIS Pro 3.3. From water flow modeling to direct PDF support, this release has it all. Read our blog to learn more.

IT 144

IT 144

Snowflake

MAY 7, 2024

Snowflake Cortex is a fully-managed service that enables access to industry-leading large language models (LLMs) is now generally available. You can use these LLMs in select regions directly via LLM Functions on Cortex so you can bring generative AI securely to your governed data. Your team can focus on building AI applications, while we handle model optimization and GPU infrastructure to deliver cost-effective performance.

Government 131

Government SQL Data Security Accessible 131

Speaker: Jason Chester, Director, Product Management

In today’s manufacturing landscape, staying competitive means moving beyond reactive quality checks and toward real-time, data-driven process control. But what does true manufacturing process optimization look like—and why is it more urgent now than ever? Join Jason Chester in this new, thought-provoking session on how modern manufacturers are rethinking quality operations from the ground up.

Manufacturing

KDnuggets

MAY 9, 2024

Learn how to generate super fast responses in Jan AI and VSCode using Groq LPU Inference Engine.

Engineering 142

Engineering 142

Start Data Engineering

MAY 9, 2024

1. Introduction 2. Snowflake pricing and settings inheritance model 3. Strategies to reduce Snowflake cost 3.1. Quick wins by changing settings 3.1.1. Update warehouse settings 3.2. Analyze usage and optimize table data storage 3.2.1. Identify expensive queries and optimize them 3.2.1.1. Identify expensive queries with query_history 3.2.1.2. Optimize expensive queries 3.2.2.

Data Storage 130

Data Storage Accessible Accessibility Management 130

Seattle Data Guy

MAY 7, 2024

Getting data out of source systems and into a data warehouse or data lake is one of the first steps in making it usable by analysts and data scientists. The question is how will your team do that? Will they write custom data connectors, pay for a data connector out of the box or perhaps… Read more The post 4 ELT Alternatives To Airbyte – How To Ingest Your Data appeared first on Seattle Data Guy.

Data Lake 130

Data Lake Data Warehouse Data Systems 130

KDnuggets

MAY 10, 2024

Master AI with these free courses from Harvard, Google, AWS, and more.

AWS 141

AWS 141

Robinhood

MAY 6, 2024

Robinhood Markets,Inc.(Nasdaq:HOOD) today announced that RHC has received a Wells Notice from the SEC Staff Earlier today we announced Robinhood Crypto (RHC) has received a Wells Notice from the U.S. Securities and Exchange Commission staff indicating they will recommend that the Commission file an enforcement action. “After years of good faith attempts to work with the SEC for regulatory clarity including our well-known attempt to ‘come in and register,’ we are disappointed that the agency has

129

129

Waitingforcode

MAY 7, 2024

I wrote a blog post about OutputModes 6 (yes!) years ago and after reading it a few times, I realized it was not good enough to be a quick refresher. For that reason you can read about OutputModes for the second time here. Hopefully, this one will be a good try!

IT 130

IT 130

Speaker: Kenten Danas, Senior Manager, Developer Relations

ETL and ELT are some of the most common data engineering use cases, but can come with challenges like scaling, connectivity to other systems, and dynamically adapting to changing data sources. Airflow is specifically designed for moving and transforming data in ETL/ELT pipelines, and new features in Airflow 3.0 like assets, backfills, and event-driven scheduling make orchestrating ETL/ELT pipelines easier than ever!

Data Engineering

ArcGIS

MAY 8, 2024

Read a summary of the newest features, enhancements, and improvements in the ArcGIS Business Analyst Pro May Release.

Business Analyst 122

Business Analyst Designing 122

KDnuggets

MAY 7, 2024

Want to run large language models on your machine? Learn how to do so using Ollama in this quick tutorial.

Machine Learning 140

Machine Learning 140

Snowflake

MAY 9, 2024

From its start with efficient batch processing with data warehouses for descriptive analytics, and the inclusion of streaming data in real time to build recommendations, we find ourselves at the forefront of a new stage of evolution: generative AI (gen AI). This generative powerhouse has fueled vertical integration, giving rise to industry-specific solutions that harness the full potential of generative capabilities and unlocked the imagination of many.

Unstructured Data 120

Unstructured Data Manufacturing Retail Data Warehouse 120

databricks

MAY 8, 2024

In December, we announced a new suite of tools to get Generative AI applications to production using Retrieval Augmented Generation (RAG). Since then.

Data Science 117

Data Science Data 117

Advertisement

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data Workflow

ArcGIS

MAY 9, 2024

ArcGIS's capabilities for visualizing and analyzing EMIT hyperspectral imagery bridge the gap between NASA's science data and GIS users.

Data 113

Data 113

KDnuggets

MAY 8, 2024

The goal of this article is to help demystify the process of selecting the proper machine learning algorithm, concentrating on "traditional" algorithms and offering some guidelines for choosing the best one for your application.

Machine Learning 136

Machine Learning Algorithm Process 136

Snowflake

MAY 6, 2024

Snowflake is dedicated to providing customers with intuitive solutions that streamline their operations and drive success. As part of our ongoing commitment to helping customers in this way, we’re introducing updates to the Cost Management Interface to make managing Snowflake spend easier at an organization level and accessible to more roles. Snowsight: Your Centralized Console for Cost Management The Cost Management Interface in Snowsight (Snowflake’s web interface) is the centralized con

Management 112

Management Finance Accessible Accessibility 112

databricks

MAY 6, 2024

Discover the vital role of data governance in the communications, media, and entertainment industry. Learn how robust data governance enables personalized experiences, ensures AI transparency, and mitigates compliance risks. Explore how leading companies like Barilla and Anker are accelerating innovation through effective data governance strategies powered by Databricks' Unity Catalog.

Entertainment 110

Entertainment Media Data Governance Government 110

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

ArcGIS

MAY 9, 2024

Watch this short video to learn how to choose color schemes that work well with light or dark basemaps.

Designing 111

Designing 111

KDnuggets

MAY 6, 2024

Want to learn more about Artificial Intelligence? These five courses from Stanford will help you kickstart that journey.

131

131

Snowflake

MAY 8, 2024

There are more than 25,000 SnowPros in the Snowflake Certification community today. Earning and maintaining a SnowPro Certification shows a strategic commitment to expand your Snowflake knowledge and skills, and advance your career. As Snowflake continues to grow, the demand for Snowflake experience and expertise is also rapidly increasing. A recent survey of certified SnowPros indicated that: 68% received positive recognition for achieving the certification. 61% noted a greater demand for their

Programming 111

Programming Certification Data Engineering Data Engineer 111

databricks

MAY 9, 2024

Last year, we launched foundation model support in Databricks Model Serving to enable enterprises to build secure and custom GenAI apps on a.

Building 105

Building Machine Learning Data Science Data 105

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

ArcGIS

MAY 9, 2024

ArcGIS Pro 3.3 boosts Image Analyst's AI power! Dive into the new GeoAI features for smarter image analysis.

109

109

KDnuggets

MAY 6, 2024

Data analyst tools encompass programming languages, spreadsheets, BI, and big data tools. Here are 9ish tools that cover all the tasks of data analysts well.

Programming Language 127

Programming Language Big Data Tools BI Big Data 127

Snowflake

MAY 7, 2024

Accelerate Healthcare and Life Sciences is a one-day virtual event, featuring technology and business leaders from Elevance Health, Ginkgo Bioworks, Datavant and more, to discover executive priorities, best practices and potential data and AI challenges that are top of mind for 2024. Why Attend Accelerate Healthcare and Life Sciences? Accelerate Healthcare and Life Sciences is on May 16, 2024, starting at 11 a.m.

Healthcare 105

Healthcare Cloud Technology Data 105

databricks

MAY 7, 2024

The Data Team Awards celebrates enterprise data teams' essential role in helping businesses across sectors face their most pressing challenges. With more than.

Data 105

Data 105

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data Workflow

Cloudera

MAY 10, 2024

Apache Iceberg is vital to the work we do and the experience that the Cloudera platform delivers to our customers. Iceberg, a high-performance open-source format for huge analytic tables, delivers the reliability and simplicity of SQL tables to big data while allowing for multiple engines like Spark, Flink, Trino, Presto, Hive, and Impala to work with the same tables, all at the same time.

Government 103

Government Data Governance Data Pipeline Data Architecture 103

KDnuggets

MAY 6, 2024

Check out these 3 courses that have just landed, from front-end web development to project management.

Project 118

Project Management 118

Knowledge Hut

MAY 10, 2024

As of the beginning of January 2022, India has recognized more than 61,000 startups, thus having the 3rd largest startup ecosystem after the US and China. The government of India has an initiative called Startup India, whose sole purpose is to bring about startup culture and build an ecosystem for entrepreneurship and innovation. As a result, the startup ecosystem in India has emerged as a major growth engine for the country in the past few years and aims to become a global tech powerhouse.

Insurance 98

Insurance Medical Food Retail 98

databricks

MAY 6, 2024

Introduction Organizations aiming to become AI and data-driven often need to provide their internal teams with high-quality and trusted data products. Building.

Building 105

Building Data 105

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline