databricks

FEBRUARY 13, 2025

Today we are announcing a deep partnership with SAP which we think can be game changing for our industry. In short, it is.

IT 132

IT 132

KDnuggets

FEBRUARY 17, 2025

Enhance the array operational process with methods you may not have previously known.

Process 125

Process 125

Waitingforcode

FEBRUARY 12, 2025

After publishing a release of my blog post about the insertInto trap, I got an intriguing question in the comments. The alternative to the insertInto, the saveAsTable method, doesn't work well on partitioned data in overwrite mode while the insertInto does. True, but is there an alternative to it that doesn't require using this position-based function?

SQL 130

SQL IT Data 130

KDnuggets

FEBRUARY 12, 2025

Discover freelancing platforms that care about you, not just your money, offering low commission rate, better policies, and higher earning potential.

127

127

Advertisement

Apache Airflow® is the open-source standard to manage workflows as code. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries. Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.

Datasets

Confluent

FEBRUARY 11, 2025

An expanded partnership between Confluent and Databricks dramatically simplifies the integration between analytical and operational systems.

Systems 118

Systems Data 118

databricks

FEBRUARY 18, 2025

As we welcome the new year, we're thrilled to announce several new resources for R users on Databricks: a comprehensive developer guide, the.

95

95

Engineering at Meta

FEBRUARY 13, 2025

In 2024, our bug bounty program awarded more than $2.3 million in bounties, bringing our total bounties since the creation of our program in 2011 to over $20 million. As part of our defense-in-depth strategy , we continued to collaborate with the security research community in the areas of GenAI, AR/VR, ads tools, and more. We also celebrated the security research done by our bug bounty community as part of our annual bug bounty summit and many other industry events.

Programming 92

Programming Designing Accessible Accessibility 92

KDnuggets

FEBRUARY 11, 2025

In this article, I will introduce you to 10 little-known Python libraries every data scientist should know.

Python 126

Python Data 126

Snowflake

FEBRUARY 11, 2025

AI is proving that its here to stay. While 2023 brought wonder and 2024 saw widespread experimentation, 2025 will be the year that the advertising, media and entertainment industry gets serious about AI's applications. But its complicated: AI proofs of concept are graduating from the sandbox to production, just as some of AIs biggest cheerleaders are turning a bit dour.

Entertainment 81

Entertainment Media Healthcare Technology 81

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

ArcGIS

FEBRUARY 11, 2025

Three short videos that share advice, examples, and analogies to help explain normalization for choropleth maps.

Designing 69

Designing 69

databricks

FEBRUARY 12, 2025

We are excited to announce the second edition of the Databricks AI Security Framework (DASF 2.0 download now )! Organizations racing to harness.

73

73

DataKitchen

FEBRUARY 17, 2025

No Python, No SQL Templates, No YAML: Why Your Open Source Data Quality Tool Should Generate 80% Of Your Data Quality Tests Automatically As a data engineer, ensuring data quality is both essential and overwhelming. The sheer volume of tables, the complexity of the data usage, and the volume of work make manual test writing an impossible task to get done.

SQL 69

SQL Python Government Data Engineering 69

Snowflake

FEBRUARY 13, 2025

As analytics steps into the era of enterprise AI, customers requirements for a robust platform that is easy to use, connected and trusted for their current and future data needs remain unchanged. "Serverless computing" has enabled customers to use cloud capabilities without provisioning, deploying and managing either hardware or software resources.

Management 73

Management Government Cloud Unstructured Data 73

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Netflix Tech

FEBRUARY 14, 2025

Part 1: Creating the Source of Truth for Impressions By: TulikaBhatt Imagine scrolling through Netflix, where each movie poster or promotional banner competes for your attention. Every image you hover over isnt just a visual placeholder; its a critical data point that fuels our sophisticated personalization engine. At Netflix, we call these images impressions, and they play a pivotal role in transforming your interaction from simple browsing into an immersive binge-watching experience, all tailo

Kafka 63

Kafka Datasets Metadata Utilities 63

databricks

FEBRUARY 14, 2025

Databricks is excited to introduce enhanced streaming observability within Workflows and Delta Live Tables (DLT) pipelines. This feature provides data engineering teams with.

Data Engineering 72

Data Engineering Data Engineer Engineering Data 72

Cloudyard

FEBRUARY 11, 2025

Read Time: 2 Minute, 55 Second Monitoring and optimizing cloud costs is a key challenge for businesses operating in cloud environments. Snowflake provides detailed usage insights, but integrating this data with AWS CloudWatch using External Functions allows organizations to track cost in real-time, set up alerts, and optimize warehouse utilization. What if we could integrate Snowflake warehouse cost tracking with AWS CloudWatch?

AWS 59

AWS Finance Cloud Utilities 59

KDnuggets

FEBRUARY 12, 2025

Want to make the most out of large language models? Check out these prompting techniques you can start using today.

113

113

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Snowflake

FEBRUARY 12, 2025

AI agents, autonomous systems that perform tasks using AI, can enhance business productivity by handling complex, multi-step operations in minutes. Agents need to access an organization's ever-growing structured and unstructured data to be effective and reliable. As data connections expand, managing access controls and efficiently retrieving accurate informationwhile maintaining strict privacy protocolsbecomes increasingly complex.

Unstructured Data 67

Unstructured Data Government SQL Structured Data 67

ArcGIS

FEBRUARY 11, 2025

Learn how to explore and understand NetCDF files with ArcGIS Pro's Describe NetCDF File tool. Discover dimensions, variables, and attributes.

Data 60

Data 60

databricks

FEBRUARY 12, 2025

Utilities Of Today Todays power grid traces its roots back to the late 1800s when Pearl Street Station first serviced a handful of.

Utilities 68

Utilities Data Manufacturing IT 68

Scott Logic

FEBRUARY 12, 2025

Introduction Using Playwright snapshots with mocked data can significantly improve the speed at which UI regression is carried out. It facilitates rapid automated inspection of UI elements across the three main browsers (Chromium, Firefox, Webkit). You can tie multiple assertions to one snapshot, which greatly increases efficiency for UI testing. This type of efficiency is pivotal in a rapidly scaling GUI application.

Coding 52

Coding IT Project Data 52

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

FEBRUARY 11, 2025

This article will explore initiating the RAG system and making it fully voice-activated.

Systems 96

Systems IT 96

Confluent

FEBRUARY 13, 2025

How Flink enables developers to connect real-time data to external models through remote inference, enabling seamless coordination between data processing and AI/ML workflows.

Data Process 59

Data Process Process Data 59

Monte Carlo

FEBRUARY 12, 2025

The large model is officially a commodity. In just two short years, API-based LLMs have gone from incomprehensible to smartphone accessible. The pace of AI innovation is slowing. Real world use cases are coming into focus. Going forward, the value of your genAI applications will exist solely in the fitnessand reliabilityof your own first-party data.

Metadata 52

Metadata Data Retail Government 52

databricks

FEBRUARY 17, 2025

As we continue to navigate the complexities of the modern world, it's becoming increasingly clear that data-driven decision making is the key to.

Manufacturing 62

Manufacturing IT Data 62

Advertisement

With over 30 million monthly downloads, Apache Airflow is the tool of choice for programmatically authoring, scheduling, and monitoring data pipelines. Airflow enables you to define workflows as Python code, allowing for dynamic and scalable pipelines suitable to any use case from ETL/ELT to running ML/AI operations in production. This introductory tutorial provides a crash course for writing and deploying your first Airflow pipeline.

Cloud

Snowflake

FEBRUARY 18, 2025

Being able to leverage unstructured data is a critical part of an effective data strategy for 2025 and beyond. To keep up with the competition and AI-accelerated pace of innovation, businesses must be able to mine the treasure trove of value buried in the mountains of unstructured data that comprise approximately 80% of all enterprise data from call center logs, customer reviews, emails and claims reports to news, filings and transcripts.

52

52

KDnuggets

FEBRUARY 17, 2025

Learn AI for free on DataCamp from February 17 to 23.

Engineering 90

Engineering 90

Confluent

FEBRUARY 11, 2025

Discover how Confluent achieved FedRAMP Ready status, marking a milestone in secure cloud services. Learn about our commitment to security and compliance.

Government 59

Government Cloud 59