Seattle Data Guy

DECEMBER 3, 2024

When I broke into the data world, everyone wanted to hire data scientists that would let their companies become more data driven. There were statistics about the exabytes of data that we were creating and the value it would provide. However, a few years into my career, the data world started to make a pivot… Read more The post Preparing Your Data Infrastructure for 2025: Lessons from the Past, Strategies for the Future appeared first on Seattle Data Guy.

Data 130

Data IT 130

Engineering at Meta

DECEMBER 3, 2024

Meta releases a Request for Proposals (RFP) to identify nuclear energy developers to support AI innovation and clean and renewable energy goals.

Engineering 132

Engineering Data 132

The Pragmatic Engineer

DECEMBER 2, 2024

It's Cyber Monday: and I'm offering one-day, one-off discounts on my ebooks, as well as on The Pragmatic Engineer Newsletter. Here they are: The Pragmatic Engineer Newsletter : 20% off, for the first year, for annual subscriptions. Claim it here. See more details , and read reviews from readers. The Software Engineer's Guidebook : 40% off from the ebook version sold directly.

Engineering 133

Engineering Software Engineering Software Engineer Building 133

KDnuggets

DECEMBER 2, 2024

In this article, we’ll go over Python libraries for tasks like logging, unit testing, data handling, and more — each with features that can simplify your application development.

Python 124

Python Data 124

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Confessions of a Data Guy

NOVEMBER 29, 2024

Well, another turkey day has come upon us all. I trust you are getting at least a day or two off from your overlords from writing code and taking names. While the rest of you will be slicing up that turkey with your friends and family, clinking your glasses and giving toasts to each other, […] The post Turkey Day Is Here – Black Friday Sale – %50 Off appeared first on Confessions of a Data Guy.

Coding 100

Coding Data 100

Robinhood

DECEMBER 2, 2024

At Robinhood, we are committed to making investing more accessible and transparent for everyone. That’s why today we’re introducing an important feature designed to help customers manage their tax liabilities and give them flexibility when selling stocks — Tax Lots. Tax Lots allow customers to choose specific assets to sell—whether it’s the ones held long term, the ones with the lowest or highest cost basis, or the ones that might have experienced the greatest loss.

Portfolio 105

Portfolio Consulting Designing Accessible 105

databricks

DECEMBER 1, 2024

We are excited to announce the Public Preview of Cross-Platform View Sharing. Available today, it allows data providers to share views across different.

IT 109

IT Data 109

KDnuggets

DECEMBER 2, 2024

Learn reinforcement learning using free resources, including books, frameworks, courses, tutorials, example code, and projects.

Coding 146

Coding Project 146

Cloudera

DECEMBER 4, 2024

Today enterprises can leverage the combination of Cloudera and Snowflake—two best-of-breed tools for ingestion, processing and consumption of data—for a single source of truth across all data, analytics, and AI workloads. But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. All this by making it easier for customers to connect their workloads with Snowflake, Cloudera, and unique AWS services such as Amazon Simple Storage Service

AWS 81

AWS Raw Data Relational Database Government 81

Engineering at Meta

DECEMBER 2, 2024

Andromeda is Meta’s proprietary machine learning (ML) system design for retrieval in ad recommendation focused on delivering a step-function improvement in value to our advertisers and people. This system pushes the boundary of cutting edge AI for retrieval with NVIDIA Grace Hopper Superchip and Meta Training and Inference Accelerator (MTIA) hardware through innovations in ML model architecture, feature representation, learning algorithm, indexing, and inference paradigm.

Engineering 80

Engineering Algorithm Utilities Machine Learning 80

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Snowflake

DECEMBER 1, 2024

Earlier this year, Snowflake signed the Cybersecurity and Infrastructure Security Agency (CISA) Secure by Design pledge. As part of that commitment, we are announcing that by November 2025, Snowflake will block sign-ins using single-factor authentication with passwords. This enhanced level of protection adds to the growing security capabilities of Snowflake Horizon Catalog , which empowers security admins and chief information security officers to better safeguard their security posture and miti

Accessible 66

Accessible Accessibility Database Designing 66

databricks

DECEMBER 5, 2024

At Databricks, AutoML is our low-code/no-code model training API that empowers customers to create quality machine learning (ML) models with their data on.

Machine Learning 88

Machine Learning Coding Data 88

KDnuggets

DECEMBER 4, 2024

MongoDB is a database that’s great for handling large amounts of diverse data. This article walks you through installing MongoDB and using the MongoDB Shell to manage your data easily.

MongoDB 102

MongoDB Database Management Data 102

Cloudera

DECEMBER 4, 2024

Welcome to the first installment of a series of posts discussing the recently announced Cloudera AI Inference service. Today, Artificial Intelligence (AI) and Machine Learning (ML) are more crucial than ever for organizations to turn data into a competitive advantage. To unlock the full potential of AI, however, businesses need to deploy models and AI applications at scale, in real-time, and with low latency and high throughput.

Architecture 66

Architecture Machine Learning BI Deep Learning 66

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Precisely

DECEMBER 4, 2024

At Precisely, we celebrate the women in our organization because we know that while more women are joining the technology industry, there’s still a gender gap. Supporting and advocating for women in technology is a top priority, which is why the Precisely Women in Technology (PWIT) program was established. Every month, a different woman from the program is featured in this Q&A to share her experience working in tech.

Professional Services 59

Professional Services Technology Education Programming 59

Confluent

DECEMBER 4, 2024

Tableflow easily integrates with Amazon SageMaker Lakehouse, enabling you to quickly materialize your Apache Kafka topics into Iceberg tables stored in S3.

Kafka 59

Kafka Data Process 59

databricks

DECEMBER 2, 2024

Executive Summary In this blog post we explore how private equity (PE) firms can leverage data intelligence to enhance portfolio returns. We highlight.

Portfolio 89

Portfolio Data 89

KDnuggets

DECEMBER 5, 2024

Learn how to bring the power of AI right to your Android phone—no cloud, no internet, just pure on-device intelligence!

Cloud 104

Cloud 104

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Cloudera

DECEMBER 4, 2024

For more than a decade, Cloudera has been an ardent supporter and committee member of Apache NiFi, long recognizing its power and versatility for data ingestion, transformation, and delivery. Our customers rely on NiFi as well as the associated sub-projects (Apache MiNiFi and Registry) to connect to structured, unstructured, and multi-modal data from a variety of data sources – from edge devices to SaaS tools to server logs and change data capture streams.

Data Pipeline 69

Data Pipeline Data Ingestion Data Preparation Architecture 69

Zalando Engineering

DECEMBER 5, 2024

Introduction At Zalando, we continuously strive to enhance our platform capabilities to provide robust, scalable, and developer-friendly solutions. One such initiative is the integration of Open Policy Agent (OPA) into Skipper , our open-source ingress controller and reverse proxy, to deliver Authorization as a Service. This integration not only allows externalising authorization policies but also aligns with our goals of solving security concerns on the infrastructure with efficiency and develo

52

52

Confluent

DECEMBER 4, 2024

The recent release of mutual TLS (mTLS) on Confluent Cloud and Amazon Redshift has enabled the streaming of Confluent topics to Amazon Redshift materialized views.

Cloud 59

Cloud 59

databricks

DECEMBER 3, 2024

The world of artificial intelligence (AI) and data analytics is about to get a significant boost, thanks to Databricks’ collaboration with NVIDIA. This.

Data Analytics 72

Data Analytics Data 72

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

NOVEMBER 29, 2024

Working with large datasets is common but challenging. Here are some tips to make working with such large datasets in Python simpler.

Datasets 119

Datasets Python 119

Cloudera

DECEMBER 2, 2024

As organizations adopt a cloud-first infrastructure strategy, they must weigh a number of factors to determine whether or not a workload belongs in the cloud. Cost has been a key consideration in public cloud adoption from the start. Today, energy efficiency is gaining importance, not only for cutting costs but also as a vital step toward sustainable business practices.

AWS 70

AWS Amazon Web Services Cloud Computing Utilities 70

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data Engineering 52

Precisely

DECEMBER 5, 2024

Key Takeaways: Data enrichment is the process of appending your first-party data with contextually rich third-party data, enabling you to make more data-driven decisions. Traditionally, data enrichment can be lengthy and expensive, but implementing best practices for evaluating datasets and working with a data provider that offers data delivery options fit for your needs can accelerate time to value while reducing costs.

Datasets 52

Datasets Insurance Retail Data 52

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

databricks

DECEMBER 2, 2024

Predictive Optimization (PO) enhances the performance of Unity Catalog managed tables by intelligently optimizing data layouts, leading to significant improvements in query performance.

Management 68

Management Data 68

KDnuggets

NOVEMBER 29, 2024

This is a collection of the 10 most frequently used Conda commands that every data scientist, machine learning engineer, or Python developer should have at their fingertips.

Data Science 100

Data Science Machine Learning Python Data 100

Cloudera

DECEMBER 3, 2024

Many enterprises have heterogeneous data platforms and technology stacks across different business units or data domains. For decades, they have been struggling with scale, speed, and correctness required to derive timely, meaningful, and actionable insights from vast and diverse big data environments. Despite various architectural patterns and paradigms, they still end up with perpetual “data puddles” and silos in many non-interoperable data formats.

Metadata 65

Metadata SQL Database Data Warehouse 65

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data