Snowflake

JUNE 14, 2023

Komodo Health is a technology platform company creating the new standard for real-world data and analytics by pairing the industry’s most complete view of patient encounters with enterprise software and machine learning that connects the dots between individual patient journeys and large-scale health outcomes.

Healthcare 52

Healthcare SQL Algorithm Architecture 52

Cloudera

NOVEMBER 12, 2020

Cloud has given us hope, with public clouds at our disposal we now have virtually infinite resources, but they come at a different cost – using the cloud means we may be creating yet another series of silos, which also creates unmeasurable new risks in security and traceability of our data. A solution.

Cloud 103

Cloud Data Warehouse Banking Data 103

Grouparoo

MARCH 30, 2021

Teams are centralizing their data in their data warehouse by loading data in and transforming it as necessary. sql files that, when run in the right order, create useful rollup tables or materialized views of the data. Reverse ETL is taking data from the warehouse and writing it back to line-of-business tools.

Data Warehouse 52

Data Warehouse SQL Project Database 52

Knowledge Hut

JANUARY 12, 2024

What comes to your mind when you hear the term 'Cloud'? Well, in a technologically advanced world, Cloud refers to a place where you can store and manage data on a device. Personally, I find it fascinating how saying, "I can handle the Cloud," has become a ticket to professional opportunities. What is Cloud Computing?

Cloud Computing 98

Cloud Computing Cloud Computer Science Programming Language 98

Snowflake

DECEMBER 19, 2023

The best marketing is truly data-driven, creating powerful product promotions and offers through an understanding of customer needs and preferences. than reading data insights from a beautiful dashboard. It’s a potentially cumbersome and time-consuming process that too often requires moving or sharing access to sensitive customer data.

Building 82

Building Pipeline-centric Database-centric Digital Media 82

phData: Data Engineering

OCTOBER 12, 2022

So you’ve heard all the talk around dbt , but now you’re working to determine if you should go with dbt Core or dbt Cloud and you’re wanting to know what advantages dbt Cloud has over the free dbt Core offering. However, dbt Cloud offers you much more than that.

Cloud 52

Cloud Metadata SQL Data Warehouse 52

dbt Developer Hub

JULY 2, 2023

Data Vault 2.0 is a data modeling technique designed to help scale large data warehousing projects. So why Data Vault? Have you experienced a data warehousing project with 50+ data sources, with 25+ data developers working on the same data platform, or data spanning 5+ years with two or more generations of source systems?

Cloud 52

Cloud Data Warehouse Data BI 52

Data Engineering Podcast

APRIL 19, 2021

Summary Most of the time when you think about a data pipeline or ETL job what comes to mind is a purely mechanistic progression of functions that move data from point A to point B. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Pipeline 100

Data Pipeline Machine Learning Data Warehouse Datasets 100

Cloudera

JANUARY 20, 2021

Most of what is written though has to do with the enabling technology platforms (cloud or edge or point solutions like data warehouses) or use cases that are driving these benefits (predictive analytics applied to preventive maintenance, financial institution’s fraud detection, or predictive health monitoring as examples) not the underlying data.

Manufacturing 109

Manufacturing Data Warehouse Kafka Retail 109

Monte Carlo

APRIL 28, 2022

Most data pros know Snowflake’s pricing model is consumption based–you pay for what you use. Instead of spinning cycles on deteriorated SQL queries, the data cloud provider would rather have you focus those Snowflake credits toward projects like building data apps. Waste isn’t good for anyone.

Data Warehouse 52

Data Warehouse Bytes SQL AWS 52

Knowledge Hut

MARCH 13, 2024

Wondering what is a big data engineer? As the name suggests, Big Data is associated with ‘big’ data, which hints at something big in the context of data. Big data forms one of the pillars of data science. Big data has been a hot topic in the IT sector for quite a long time.

Big Data 52

Big Data Data Engineering Data Engineer Engineering 52

Knowledge Hut

MARCH 13, 2024

Wondering what is a big data engineer? As the name suggests, Big Data is associated with ‘big’ data, which hints at something big in the context of data. Big data forms one of the pillars of data science. Big data has been a hot topic in the IT sector for quite a long time.

Big Data 52

Big Data Data Engineering Data Engineer Engineering 52

Striim

JANUARY 4, 2023

Companies need to analyze large volumes of datasets, leading to an increase in data producers and consumers within their IT infrastructures. These companies collect data from production applications and B2B SaaS tools (e.g., This data makes its way into a data repository, like a data warehouse (e.g.,

PostgreSQL 52

PostgreSQL Data Warehouse Data Lake Data 52

Monte Carlo

JULY 27, 2023

It’s not enough for data teams to be magicians transforming raw data into business value, they need to be responsible (and cost conscious) stewards as well. Unfortunately, data optimization is far from an exact science. When it comes to data optimization, you must weigh the tradeoffs. Optimization should be the focus.”

Data 52

Data Architecture Data Warehouse Data Engineering 52

Netflix Tech

OCTOBER 27, 2021

The Metaflow GUI allows data scientists to monitor their workflows in real-time, track experiments, and see detailed logs and results for every executed task. link] Metaflow is a full-stack framework for data science that we started developing at Netflix over four years ago and which we open-sourced in 2019.

Python 89

Python Machine Learning Data Science Metadata 89

Hepta Analytics

FEBRUARY 14, 2022

DE Zoomcamp 2.2.1 – Introduction to Workflow Orchestration Following last weeks blog , we move to data ingestion. We already had a script that downloaded a csv file, processed the data and pushed the data to postgres database. This week, we got to think about our data ingestion design. It is called Idempotency.

Data Ingestion 52

Data Ingestion Data Engineering Data Engineer Engineering 52

Cloudera

SEPTEMBER 17, 2018

However, as the data warehousing world shifts into a fast-paced, digital, and agile era, the demands to quickly generate reports and help guide data-driven decisions are constantly increasing. Consider the following: More data types to be queried, but increasingly the data resides in separate silos.

Data Warehouse 54

Data Warehouse SQL Portfolio MySQL 54

Knowledge Hut

SEPTEMBER 28, 2023

It stands as a formidable business intelligence tool, providing an end-to-end solution for diverse data needs. This versatile tool handles data extraction, transformation, presentation, and sharing while granting you full control over the information you disseminate. Before we dive in, let's understand what Microsoft Power BI is.

BI 52

BI Business Intelligence Certification Raw Data 52

Knowledge Hut

JUNE 20, 2023

A novice data scientist prepared to start a rewarding journey may need clarification on the differences between a data scientist and a machine learning engineer. Many people are learning data science for the first time and need help comprehending the two job positions. Facial reorganization, social media optimization, etc.

Machine Learning 52

Machine Learning Data Engineering Data Engineer Engineering 52

Cloudera

APRIL 30, 2021

Cloudera Data Engineering (CDE) is a cloud-native service purpose-built for enterprise data engineering teams. CDE is already available in CDP Public Cloud (AWS & Azure) and will soon be available in CDP Private Cloud Experiences. Try out Cloudera Data Engineering today! Getting started with CDE .

Python 63

Python Data Engineering Data Engineer Engineering 63

Grouparoo

MAY 21, 2020

Specifically, the problem is that many marketing tools live in a world where they expect to be “pushed” data, when it would be so much better if they were “pulling” data when they needed it. This takes us to the Stale Data problem. Everyone had a different process and no one really trusted an event-based data source.

Data 52

Data Database Data Warehouse Building 52

Knowledge Hut

NOVEMBER 16, 2023

Amazon Web Services is a cloud platform with more than 165 fully-featured services. Amazon Redshift does the same for big data analytics and data warehousing. It contains columnar data store with billions of rows of data that are parallel placed with each other. What is a column-oriented database?

IT 52

IT Bytes AWS Data Warehouse 52

Cloudera

OCTOBER 18, 2022

Like all of our customers, Cloudera depends on the Cloudera Data Platform (CDP) to manage our day-to-day analytics and operational insights. Many aspects of our business live within this modern data architecture, providing all Clouderans the ability to ask, and answer, important questions for the business. Project CloudCost — design.

Cloud 89

Cloud IT Data Warehouse AWS 89

ProjectPro

NOVEMBER 14, 2015

Big data has taken over many aspects of our lives and as it continues to grow and expand, big data is creating the need for better and faster data storage and analysis. These Apache Hadoop projects are mostly into migration, integration, scalability, data analytics, and streaming analysis. Data Migration 2.

Hadoop 52

Hadoop Project Big Data Healthcare 52

Monte Carlo

APRIL 21, 2022

Adopting a cloud data warehouse like Snowflake is an important investment for any organization that wants to get the most value out of their data. When data quality is neglected, data teams end up spending valuable time responding to broken dashboards and unreliable reports. Data can be stale or duplicative.

Metadata 52

Metadata Bytes Government Data 52

Snowflake

DECEMBER 12, 2023

Iceberg Tables bring the easy management and great performance of Snowflake to data stored externally in an open source format. Snowflake Horizon Seamless data governance with a new user experience in Snowsight – general availability Users can effortlessly explore objects of interest and perform essential actions—all without SQL.

Metadata 90

Metadata Python AWS Government 90

Snowflake

NOVEMBER 2, 2023

Over the years, the technology landscape for data management has given rise to various architecture patterns, each thoughtfully designed to cater to specific use cases and requirements. These patterns include both centralized storage patterns like data warehouse , data lake and data lakehouse , and distributed patterns such as data mesh.

Data Lake 91

Data Lake Data Warehouse Cloud Unstructured Data 91

Monte Carlo

FEBRUARY 26, 2024

A data catalog is a constantly updated inventory of the universe of data assets within an organization. It uses metadata to create a picture of the data, as well as the relationships between data assets of diverse sources, and the processing that takes place as data moves through systems.

Metadata 52

Metadata Government Data Data Governance 52

Snowflake

JANUARY 31, 2023

But in our conversations with customers, we frequently hear that Snowflake provides the best value for the money of any enterprise data platform option available today. The fact is that data platforms are not created equal, and comparing the total cost and the value derived from one with another is difficult. So what gives?

Cloud 69

Cloud Data Programming Language SQL 69

Data Engineering Podcast

JUNE 3, 2021

Summary SQL is the most widely used language for working with data, and yet the tools available for writing and collaborating on it are still clunky and inefficient. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

SQL 100

SQL Building Big Data BI 100

Snowflake

JUNE 28, 2023

Since its launch two years ago, Snowpark has been empowering data scientists, data engineers, and application developers to streamline their architectures, accelerate development, and boost the performance of data engineering and ML/AI workloads on Snowflake.

Python 52

Python Accessible Accessibility Pipeline-centric 52

Snowflake

MARCH 30, 2023

A 2016 data science report from data enrichment platform CrowdFlower found that data scientists spend around 80% of their time in data preparation (collecting, cleaning, and organizing of data) before they can even begin to build machine learning (ML) models to deliver business value.

Engineering 84

Engineering Raw Data Data Science Scala 84

Airbnb Tech

APRIL 13, 2021

The path to cloud efficiency begins with a cost data foundation by Anna Matlin and Tamar Eterman Introduction Business profitability and sustainability are powerful reasons to invest in infrastructure efficiency, but it is easy to feel lost about how to actually reduce costs. Most teams at Airbnb rely on the data warehouse (i.e.,

AWS 52

AWS Raw Data Amazon Web Services Cloud 52

Knowledge Hut

MAY 2, 2024

These gigantic servers are stored in a data warehouse called a Datacenter. Below Diagram (2) indicates a single server serving and sharing resources and data among multiple client machines Does this look simplified enough? One can access the data virtually from any location. Yes of course!

Python 52

Python Bytes Cloud Computing Amazon Web Services 52

Monte Carlo

AUGUST 16, 2022

When it comes to trusting your data, Monte Carlo, the creator of the data observability category, and dbt Labs , creators of dbt, are better together. What went wrong with my data?!” If you’ve been on the receiving end of a broken data pipeline, these questions probably look familiar to you. Why didn’t my job run?”

Engineering 52

Engineering Data Lake Retail BI 52

DareData

AUGUST 12, 2021

Introduction "Data is the 21st century oil". If you work anywhere in the vicinity of data, odds are you've heard some variation of this statement at least once. The goal of this blog post is to hopefully shed some light on what a healthy data ecosystem looks like, so that you might explore your company's data to its full potential.

Transportation 52

Transportation Data Lake Data Warehouse Data 52

Cloudera

SEPTEMBER 9, 2022

The promise of a modern data lakehouse architecture. Imagine having self-service access to all business data, anywhere it may be, and being able to explore it all at once. Imagine quickly answering burning business questions nearly instantly, without waiting for data to be found, shared, and ingested. According to Gartner, Inc.

Architecture 102

Architecture Metadata Unstructured Data Machine Learning 102