Mon.Nov 25, 2024

article thumbnail

5 Tips for Building Scalable Data Pipelines

KDnuggets

Building data pipelines is a very important skill that you should learn as a data engineer. A data pipeline is just a series of procedures that transport data from one location to another, frequently changing it along the way.

article thumbnail

Deep Dive into Handling Consumer Fetch Requests: Kafka Producer and Consumer Internals, Part 4

Confluent

In the final article of this four-part series on Kafka producer and consumer internals, observe the inner workings of brokers as they attempt to serve data up to consumers.

Kafka 98
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

PSPO Study Guide: The Best Plan to Crack PSPO Exam 2025

Knowledge Hut

Scrum is a quality-driven process for producing excellent business outcomes. Organizations are looking for professional product owners that grasp this notion and can use it in the real world. Employers use many credentialing services to certify levels of comprehension and application by level, which are referred to as belts. Scrum training sessions, along with resources like a PSPO study guide, assist you in learning PSPO I principles, studying efficiently and effectively to pass your exam, adva

article thumbnail

Share and Monetize AI Models Securely on the AI Data Cloud

Snowflake

The rise of generative AI models are spurring organizations to incorporate AI and large language models (LLMs) into their business strategy. After all, these models open up new opportunities to extract greater value from a company’s data and IP and make it accessible to a wider audience across the organization. One key to successfully leveraging gen AI models is the ability to share data.

Cloud 88
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Build a Data Science App with Python in 10 Easy Steps

KDnuggets

Learn how to build a data science app with Python, using Scikit-Learn and FastAPI, one step at a time.

article thumbnail

Tealium and Databricks: Providing Real-Time Insights and AI-Driven Customer Experiences

databricks

In today's rapidly changing digital world, consumer data protection and privacy regulations are reshaping how businesses interact with their customers. These changes can.

More Trending

article thumbnail

Booting Databricks VMs 7x Faster for Serverless Compute

databricks

The Databricks Serverless compute infrastructure launches and manages millions of virtual machines (VMs) each day across three major cloud providers, and it is.

Cloud 86
article thumbnail

Data for Good: Ending the Data Disparity Deepening Global Inequality

Snowflake

The Horn of Africa is experiencing a catastrophic drought. Five rainy seasons in a row have failed — and experts predict a sixth. Millions of desperate people in Ethiopia, Kenya and Somalia have abandoned their homes in search of water and pasture. This crisis is a huge challenge for already taxed government organizations. Where should limited resources be deployed?

article thumbnail

Xcel Energy: Developing a RAG-based Chatbot on Databricks

databricks

"We are delving deeper into the capabilities of MLFlow tracing. This functionality will be instrumental in diagnosing performance issues and enhancing the quality.

83
article thumbnail

Generative AI and Its Role in Innovation for Telecom Services

RandomTrees

The telecommunication industry is transforming greatly in this modern time and age because of changes in the digital revolution. The scope of telecom services is growing in size and complexity, owing to technologies such as 5G, the Internet of Things (IoT), and cloud technology. And one technology that has potential to transform the telecom sector is Generative AI , or GAI, which lies in the focus of creating new things, be it content, ideas or solutions.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Empowering Business Users with Self-Service Data Intelligence

databricks

Introduction Data is power. According to McKinsey, "Banks own more customer data than companies in most other industries, but they are behind many.

Banking 82
article thumbnail

4 Tips To Become A Better Scrum Product Owner

Knowledge Hut

A Scrum Product Owner is a person whose role in the project is to coordinate between the customer and the development team in the company. He/she needs to ensure that all the requirements mentioned by the stakeholder are implemented in the final product. An efficient Scrum Product Owner may or may not be proficient in the business aspects of the project but, he/she will be an expert in the various techniques of Agile methodology.

article thumbnail

Announcing the Winners of the Generative AI World Cup

databricks

We are thrilled to announce the winners of the Generative AI World Cup! This event brought together over 1500 data scientists and AI.

Data 78
article thumbnail

Portioning Recipes, Reducing Waste: How Picnic Simplifies Your Cooking Journey

Picnic Engineering

Cooking a family meal can be an adventure, can’t it? Picture this: the Smiths, a family of four, are planning a cozy Friday dinner. Excited chatter fills the living room as they browse for recipes. “Let’s make pasta with garlic bread,” suggests little Emma. Dad adds, “And a salad to keep it balanced.” After a consensus is reached, they head to the supermarket, revising their list along the way to make sure nothing is missed.

Food 40
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Bridging the AI Adoption Gap: Industry Trends and Insights from Women Leaders in Data & AI

databricks

In the rapidly evolving landscape of AI, organizations across all industries are eager to harness its transformational power. However, successful AI utilization and.

article thumbnail

Striim & Morrisons: Customer Testimonial

Striim

View Case Study Read Blog Post

Data 52
article thumbnail

What Nobody Tells You About Deploying GenAI

Precisely

Large Language Models (LLMs) became popular after the release of ChatGPT two years ago. The idea of chatting with an AI through a browser significantly reduced the technical barriers, making LLMs the fastest-growing platform globally. Since then, ChatGPT-like applications have surged in popularity, driven by their ease of use and groundbreaking innovations.