Trending Articles

article thumbnail

Is Python OOP the Devil? Or Savior?

Confessions of a Data Guy

Nothing will raise the hackles on the backs of hairy and pale programmers who’ve been stuck in their mom’s basement for a decade like bringing up OOP (Object Oriented Programming), especially in the context of Python. It’s like two fattened calves prepared for slaughter, sharpen your knives, and take your place, it’s time to feast […] The post Is Python OOP the Devil?

Python 130
article thumbnail

How To Data Model – Real Life Examples Of How Companies Model Their Data

Seattle Data Guy

How companies data model varies widely. They might say they use Kimball dimensional modeling. However, when you look in their data warehouse the only part you recognize is the word fact and dim. Over the past near decade, I have worked for and with different companies that have used various methods to capture this data.… Read more The post How To Data Model – Real Life Examples Of How Companies Model Their Data appeared first on Seattle Data Guy.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Building Data Platforms (from scratch)

Confessions of a Data Guy

Of all the duties that Data Engineers take on during the regular humdrum of business and work, it’s usually filled with the same old, same old. Build new pipeline, update pipeline, new data model, fix bug, etc, etc. It’s never-ending. It’s a constant stream of data, new and old, spilling into our Data Warehouses and […] The post Building Data Platforms (from scratch) appeared first on Confessions of a Data Guy.

Building 183
article thumbnail

Infoshare 2024: Stream processing fallacies, part 1

Waitingforcode

Last week I was speaking in Gdansk on the DataMass track at Infoshare. As it often happens, the talk time slot impacted what I wanted to share but maybe it's for good. Otherwise, you wouldn't read stream processing fallacies!

Process 130
article thumbnail

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI pr

article thumbnail

Building cost effective data pipelines with Python & DuckDB

Start Data Engineering

1. Introduction 2. Project demo 3. TL;DR 4. Building efficient data pipelines with DuckDB 4.1. Use DuckDB to process data, not for multiple users to access data 4.2. Cost calculation: DuckDB + Ephemeral VMs = dirt cheap data processing 4.3. Processing data less than 100GB? Use DuckDB 4.4. Distributed systems are scalable, resilient to failures, & designed for high availability 4.5.

article thumbnail

Introducing the Robinhood Crypto Trading API

Robinhood

Robinhood Crypto customers in the United States can now use our API to view crypto market data, manage portfolios and account information, and place crypto orders programmatically Today, we are excited to announce the Robinhood Crypto trading API , ushering in a new era of convenience, efficiency, and strategy for our most seasoned crypto traders. Robinhood Crypto customers in the United States can use our new trading API to set up advanced and automated trading strategies that allow them to st

Insurance 133

More Trending

article thumbnail

5 Free MIT Courses to Learn Math for Data Science

KDnuggets

Learning math is super important for data science. Check out these free courses from MIT to learn linear algebra, statistics, and more.

article thumbnail

How to Become a Python Full Stack Developer [Step-by-Step]

Knowledge Hut

In less than a decade, Python has become the most popular programming language in the world. It's used by major companies like Google and Facebook, and its versatility and ease of use make it a great choice for beginners too. We all know that Python is a powerful programming language. But did you know that it can also be used to create full-stack web applications?

Python 97
article thumbnail

Snowflake Ventures Expands Investment in Sigma, Deepening Commitment to Bringing World-Class BI Directly into the AI Data Cloud

Snowflake

We’re excited to announce today that we’re reinforcing our commitment and deepening our partnership with Sigma with an expanded investment from Snowflake Ventures. Sigma is a leading business intelligence and analytics solution that makes it easy for employees to explore live data, create compelling visualizations and collaborate with colleagues. Sigma allows employees to break free of dashboards and build workflows, powered by write-back to Snowflake through their unique Input Tables capability

BI 92
article thumbnail

Solving the Dual-Write Problem: Effective Strategies for Atomic Updates Across Systems

Confluent

The dual-write problem can arise in any distributed system. Fortunately, it has solutions in event sourcing & the transactional outbox & listen-to-yourself patterns.

Systems 92
article thumbnail

Leading the Development of Profitable and Sustainable Products

Speaker: Jason Tanner

While growth of software-enabled solutions generates momentum, growth alone is not enough to ensure sustainability. The probability of success dramatically improves with early planning for profitability. A sustainable business model contains a system of interrelated choices made not once but over time. Join this webinar for an iterative approach to ensuring solution, economic and relationship sustainability.

article thumbnail

Social Impact Using Data and AI: Revealing the 2024 Finalists for the Data For Good Award

databricks

The annual Data Team Awards celebrate the critical contributions of data teams to various sectors, spotlighting their role in driving progress and positive.

Data 93
article thumbnail

Top SQL Queries for Data Scientists

KDnuggets

SQL seems like a data science underdog compared to Python and R. However, it’s far from it. I’ll show you here how you can use it as a data scientist.

SQL 87
article thumbnail

Importance of Software Engineering: Key Reasons

Knowledge Hut

A software engineer studies, designs, develops, maintains, and retires Software. That’s why in almost every organization, there is a need for a software engineer. And this somehow raises the importance of software engineering today. Though it deals with different areas and serves many functions, educating the software engineer about best software practices and discipline is necessary.

article thumbnail

Retail Media’s Business Case for Data Clean Rooms Part 2: Commercial Models

Snowflake

In Part 1 of “Retail Media’s Business Case for Data Clean Rooms,” we discussed how to (1) assess your data assets and (2) define your data structures and permissions. Once you have a plan on paper, you can begin sizing the data clean room opportunity for your business. Step 3: Commercial Models to Unlock Revenue at Scale Modeling the business value comes down to two things: (1) What data are you making accessible; and (2) How many partners are you willing (and able) to engage?

Retail 87
article thumbnail

Navigating the Future: Generative AI, Application Analytics, and Data

Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?

article thumbnail

What’s New from the Geodatabase Team in ArcGIS Pro 3.3

ArcGIS

Here's everything new in ArcGIS Pro 3.3 from the Geodatabase Team.

Data 133
article thumbnail

Orchestrating a Dynamic Time-series Pipeline with Azure Data Factory and Databricks

Towards Data Science

Explore how to build, trigger and parameterize a time-series data pipeline in Azure, accompanied by a step-by-step tutorial Continue reading on Towards Data Science »

article thumbnail

From Data to Destinations: How Skyscanner Optimizes Traveler Experiences with Databricks Unity Catalog

databricks

This blog is authored by Michael Ewins, Director of Engineering at Skyscanner At Skyscanner , we're more than just a flight search engine.

article thumbnail

A Guide to Cyber Security Plan [Elements, Templates, Benefits]

Knowledge Hut

A cyber security plan agrees on the security policies, procedures, and controls required to protect an organization against threats, risks, and vulnerabilities. A cyber security plan can also outline the precise steps to take to respond to a breach. A cyber security plan sets the typical actions for activities such as the encryption of email attachments and restrictions on the use of social media.

article thumbnail

Get Better Network Graphs & Save Analysts Time

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

article thumbnail

5 Python Best Practices for Data Science

KDnuggets

Level up your Python skills for data science with these by following these best practices.

article thumbnail

Bringing Financial Services Business Use Cases to Life: Leveraging Data Analytics, ML/AI, and Gen AI

Cloudera

The financial services industry is undergoing a significant transformation, driven by the need for data-driven insights, digital transformation, and compliance with evolving regulations. In this context, Cloudera and TAI Solutions have partnered to help financial services customers accelerate their data-driven transformation, improve customer centricity, ensure compliance with regulations, enhance risk management, and drive innovation.

article thumbnail

Data Engineering Weekly #174

Data Engineering Weekly

Data Engineering Weekly is sponsored by Astronomer—Enterprise-Grade Apache Airflow. Deliver data on time with the speed and scale your application demands. Learn More → AI Verify Foundation: Model AI Governance Framework for Generative AI Several countries are working on building governance rules for Gen AI. Data sovereignty will play a vital role as countries formulate regulations.

article thumbnail

Beyond the Hype: Can we do better than 'carbon aware' computing? by Colin Eberhardt

Scott Logic

In this episode, Oliver Cronk and David Rees from Scott Logic are joined by Hannah Smith, Director of Operations at Green Web Foundation, an organisation aiming to make the internet fossil-free by 2030. Together, they explore the potential benefits and limitations of ‘carbon aware’ computing, which involves scheduling computational workloads during times or in locations where energy sources have lower carbon emissions.

article thumbnail

Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You Need to Know

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

article thumbnail

Robinhood Announces $1 Billion Share Repurchase Program

Robinhood

The board of directors of Robinhood Markets, Inc. (“Robinhood”) (NASDAQ: HOOD) has authorized a $1 billion share repurchase program, demonstrating management and the board’s confidence in Robinhood’s financial strength and future growth prospects. “As our business and cash flow have continued to grow, we’re excited to announce a $1 billion share repurchase program to return value to shareholders,” said Jason Warnick, Chief Financial Officer of Robinhood.

article thumbnail

5 Best End-to-End Open Source MLOps Tools

KDnuggets

Explore free and open-source MLOps tools for enhanced data privacy and control over your models and code.

Coding 104
article thumbnail

AI-Enhanced User Experiences in ArcGIS Pro 3.3

ArcGIS

Learn about the new AI-enhanced user experiences for geoprocessing in ArcGIS Pro 3.3, including semantic search and tool suggestions.

67
article thumbnail

Future of Data Scientists: Career Outlook

Knowledge Hut

Data Science is the fastest emerging field in the world. It analyzes data extraction, preparation, visualization, and maintenance. Data scientists use machine learning and algorithms to bring forth probable future occurrences. Organizations analyze themselves to grow. Data Science in the future will be the largest field of study. What is Data Science?

article thumbnail

How To Get Promoted In Product Management

Speaker: John Mansour

If you're looking to advance your career in product management, there are more options than just climbing the management ladder. Join our upcoming webinar to learn about highly rewarding career paths that don't involve management responsibilities. We'll cover both career tracks and provide tips on how to position yourself for success in the one that's right for you.

article thumbnail

Pride 2024: Pride is a verb, not just a noun by Caitlin Salt

Scott Logic

It’s June! It’s Pride month! Rainbows! Love is love! We’re your ally! Buy stuff with rainbows on! Let’s come to your Pride parade, but make sure you tone it down a bit! More rainbows! Buy our products! Look, we’ve put a rainbow on it! We love everyone ! We love absolutely everyone, in a very non-specific way! We definitely love sparkly unicorn rainbows!

article thumbnail

Analyzing Table Usage in Stored Procedures

Cloudyard

Read Time: 1 Minute, 27 Second Analyzing Table Usage in Stored Procedures: Imagine you’re a DBA responsible for a large Snowflake warehouse containing critical business data. This warehouse also houses numerous stored procedures used for various data manipulation tasks. As part of your data governance responsibilities, you’re tasked with evaluating current data retention practices.

article thumbnail

How To Create Custom Context Managers in Python

KDnuggets

Context managers in Python help you manage resources efficiently. Learn how to write your own custom context managers.

Python 72
article thumbnail

Cloudera Introduces AI Inference Service With NVIDIA NIM

Cloudera

We are excited to announce a tech preview of Cloudera AI Inference service powered by the full-stack NVIDIA accelerated computing platform, which includes NVIDIA NIM inference microservices , part of the NVIDIA AI Enterprise software platform for generative AI. Cloudera’s AI Inference service uniquely streamlines the deployment and management of large-scale AI models, delivering high performance and efficiency while maintaining strict privacy and security standards.

Cloud 52
article thumbnail

How Embedded Analytics Gets You to Market Faster with a SAAS Offering

Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.