December, 2024

article thumbnail

The Pragmatic Engineer: Cyber Monday Deals

The Pragmatic Engineer

It's Cyber Monday: and I'm offering one-day, one-off discounts on my ebooks, as well as on The Pragmatic Engineer Newsletter. Here they are: The Pragmatic Engineer Newsletter : 20% off, for the first year, for annual subscriptions. Claim it here. See more details , and read reviews from readers. The Software Engineer's Guidebook : 40% off from the ebook version sold directly.

article thumbnail

Preparing Your Data Infrastructure for 2025: Lessons from the Past, Strategies for the Future

Seattle Data Guy

When I broke into the data world, everyone wanted to hire data scientists that would let their companies become more data driven. There were statistics about the exabytes of data that we were creating and the value it would provide. However, a few years into my career, the data world started to make a pivot… Read more The post Preparing Your Data Infrastructure for 2025: Lessons from the Past, Strategies for the Future appeared first on Seattle Data Guy.

Data 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

10 Python Libraries Every Developer Should Know

KDnuggets

In this article, we’ll go over Python libraries for tasks like logging, unit testing, data handling, and more — each with features that can simplify your application development.

Python 119
article thumbnail

Powering AI innovation by acccelerating the next wave of nuclear

Engineering at Meta

Meta releases a Request for Proposals (RFP) to identify nuclear energy developers to support AI innovation and clean and renewable energy goals.

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Introducing Tax Lots on Robinhood

Robinhood

At Robinhood, we are committed to making investing more accessible and transparent for everyone. That’s why today we’re introducing an important feature designed to help customers manage their tax liabilities and give them flexibility when selling stocks — Tax Lots. Tax Lots allow customers to choose specific assets to sell—whether it’s the ones held long term, the ones with the lowest or highest cost basis, or the ones that might have experienced the greatest loss.

Portfolio 105
article thumbnail

Announcing Public Preview of Cross Platform View Sharing

databricks

We are excited to announce the Public Preview of Cross-Platform View Sharing. Available today, it allows data providers to share views across different.

IT 109

More Trending

article thumbnail

Snowflake Will Block Single-Factor Password Authentication by November 2025

Snowflake

Earlier this year, Snowflake signed the Cybersecurity and Infrastructure Security Agency (CISA) Secure by Design pledge. As part of that commitment, we are announcing that by November 2025, Snowflake will block sign-ins using single-factor authentication with passwords. This enhanced level of protection adds to the growing security capabilities of Snowflake Horizon Catalog , which empowers security admins and chief information security officers to better safeguard their security posture and miti

article thumbnail

10 GitHub Repositories to Master Reinforcement Learning

KDnuggets

Learn reinforcement learning using free resources, including books, frameworks, courses, tutorials, example code, and projects.

Coding 141
article thumbnail

Meta Andromeda: Supercharging Advantage+ automation with the next-gen personalized ads retrieval engine

Engineering at Meta

Andromeda is Meta’s proprietary machine learning (ML) system design for retrieval in ad recommendation focused on delivering a step-function improvement in value to our advertisers and people. This system pushes the boundary of cutting edge AI for retrieval with NVIDIA Grace Hopper Superchip and Meta Training and Inference Accelerator (MTIA) hardware through innovations in ML model architecture, feature representation, learning algorithm, indexing, and inference paradigm.

article thumbnail

Women on Wednesday with Meenakshi Khurana

Precisely

At Precisely, we celebrate the women in our organization because we know that while more women are joining the technology industry, there’s still a gender gap. Supporting and advocating for women in technology is a top priority, which is why the Precisely Women in Technology (PWIT) program was established. Every month, a different woman from the program is featured in this Q&A to share her experience working in tech.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Unlock the Predictive Power of Your Time Series Data

databricks

At Databricks, AutoML is our low-code/no-code model training API that empowers customers to create quality machine learning (ML) models with their data on.

article thumbnail

Cloudera and AWS Partner to Deliver Cost-Efficient and Sustainable Infrastructure for AI and Analytics

Cloudera

As organizations adopt a cloud-first infrastructure strategy, they must weigh a number of factors to determine whether or not a workload belongs in the cloud. Cost has been a key consideration in public cloud adoption from the start. Today, energy efficiency is gaining importance, not only for cutting costs but also as a vital step toward sustainable business practices.

AWS 73
article thumbnail

Securely Query Confluent Cloud from Amazon Redshift with mTLS

Confluent

The recent release of mutual TLS (mTLS) on Confluent Cloud and Amazon Redshift has enabled the streaming of Confluent topics to Amazon Redshift materialized views.

Cloud 59
article thumbnail

Getting Started with MongoDB: Installation and Setup Guide

KDnuggets

MongoDB is a database that’s great for handling large amounts of diverse data. This article walks you through installing MongoDB and using the MongoDB Shell to manage your data easily.

MongoDB 83
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

6 Ways To Prepare Your Data Team for 2025

Ascend.io

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

article thumbnail

A 4-Step Guide to Elevating Your Customer Experience

Precisely

Key Takeaways : Siloed communication channels can result in inconsistent messaging across departments. Define a digital strategy around customer needs to create a foundation for unifying communications – this ultimately improves customer satisfaction and loyalty. The benefits of digital adoption extend beyond internal efficiency. By enabling employees to excel in digital communications, you can significantly enhance your customer experience.

article thumbnail

Supercharging Private Equity Portfolio Returns

databricks

Executive Summary In this blog post we explore how private equity (PE) firms can leverage data intelligence to enhance portfolio returns. We highlight.

article thumbnail

Secure Data Sharing and Interoperability Powered by Iceberg REST Catalog

Cloudera

Many enterprises have heterogeneous data platforms and technology stacks across different business units or data domains. For decades, they have been struggling with scale, speed, and correctness required to derive timely, meaningful, and actionable insights from vast and diverse big data environments. Despite various architectural patterns and paradigms, they still end up with perpetual “data puddles” and silos in many non-interoperable data formats.

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Unify Streaming and Analytical Data with Apache Iceberg®, Confluent Tableflow, and Amazon SageMaker® Lakehouse

Confluent

Tableflow easily integrates with Amazon SageMaker Lakehouse, enabling you to quickly materialize your Apache Kafka topics into Iceberg tables stored in S3.

Kafka 59
article thumbnail

7 Projects to Master Data Engineering

KDnuggets

Learn to build, run, and manage data engineering pipelines both locally and in the cloud using popular tools.

article thumbnail

How To Prepare Your Data Team for 2025

Ascend.io

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

article thumbnail

Maximizing Your Data’s Potential: Best Practices for Streamlining Data Enrichment

Precisely

Key Takeaways: Data enrichment is the process of appending your first-party data with contextually rich third-party data, enabling you to make more data-driven decisions. Traditionally, data enrichment can be lengthy and expensive, but implementing best practices for evaluating datasets and working with a data provider that offers data delivery options fit for your needs can accelerate time to value while reducing costs.

article thumbnail

Prepare Now: 2025's Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Predictive Optimization Automatically Delivers Faster Queries and Lower TCO

databricks

Predictive Optimization (PO) enhances the performance of Unity Catalog managed tables by intelligently optimizing data layouts, leading to significant improvements in query performance.

article thumbnail

Cloudera announces ‘Interoperability Ecosystem’ with founding members AWS and Snowflake

Cloudera

Today enterprises can leverage the combination of Cloudera and Snowflake—two best-of-breed tools for ingestion, processing and consumption of data—for a single source of truth across all data, analytics, and AI workloads. But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. All this by making it easier for customers to connect their workloads with Snowflake, Cloudera, and unique AWS services such as Amazon Simple Storage Service

AWS 60
article thumbnail

AI and Data Predictions 2025: Strategies to Realize the Promise of AI

Snowflake

Snowflake leaders offer insight on AI, open source and cybersecurity development — and the fundamental leadership skills required — in the years ahead. As we come to the end of a calendar year, it’s natural to contemplate what the new year will hold for us. It’s an understatement to say that the future is very hard to predict, but it’s possible to both prepare for the likeliest outcomes and stay ready to adapt to the unexpected.

article thumbnail

Integrating Machine Learning into Existing Software Systems

KDnuggets

Check out these key concepts, tools, jargon, and tips for integrating ML models into existing software systems.

article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

How AI Helps F&B Companies Manage Inventory and Reduce Waste?

RandomTrees

As one of the most important sectors of the global economy, the food and beverage (F&B) industry works in highly volatile conditions and ensures its success by reducing waste and managing inventories. Managing production and consumption, meeting deadlines, cutting waste, and being environmentally friendly are always a challenge. Old and traditional approaches often fail or become inefficient and unresponsive in real time.

Food 52
article thumbnail

What is a Virus Hoax? How to Spot, Avoid, and Respond to Fake Alerts?

Edureka

It was a regular workday. IT worker Divya was halfway through her coffee when a colleague sent her an important email. The subject line read, WARNING: Critical Virus Detected! According to the email, if she didn’t remove a particular file right away, a new virus would cause her operating system to fail. Divya got scared and immediately tried to safeguard her system.

Media 52
article thumbnail

Databricks Brings AI to the Enterprise using NVIDIA AI and Accelerated Computing

databricks

The world of artificial intelligence (AI) and data analytics is about to get a significant boost, thanks to Databricks’ collaboration with NVIDIA. This.

article thumbnail

Advent of Code: A Holiday Treat for Data Professionals

Elder Research

Take a break from the usual routine and join thousands of data professionals for Advent of Code. It's a great way to sharpen your skills!

Coding 59
article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.