Ascend.io

APRIL 22, 2024

Plus, we’ll offer a teaser of what’s to come: an exclusive live demo that you simply cannot miss. The Evolution of Data Engineering Over the past decade, we’ve seen tremendous change in the data engineering landscape. Read More: The State of Data Engineering in 2023: Does Your Data Program Stack Up?

Project 52

Project Metadata Data Pipeline Data Engineering 52

Data Engineering Podcast

OCTOBER 30, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. RudderStack helps you build a customer data platform on your warehouse or data lake.

Engineering 100

Engineering MongoDB Scala MySQL 100

Christophe Blefari

MAY 18, 2023

." Since joining Google, he's been working on Malloy, a new way to query data. Malloy compiles in SQL and works on data semantics. During the demo, Llyod does some data analysis in the browser and it's just mind-blowing 🤯 At the same time someone Google also did a Calcite presentation.

Data 130

Data BI Consulting Data Science 130

Data Engineering Podcast

DECEMBER 18, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 100

Data Lake Data Warehouse Data Pipeline MongoDB 100

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. Does not have the resources to implement robust data governance and management.

Data Management 52

Data Management Management Data Lake Data Warehouse 52

Snowflake

MAY 1, 2024

One of their customers, a major data supplier, used the solution to stream near real-time visualizations of a massive 150 million polygon data set at sub-second speeds, surpassing the capabilities of competing solutions.

Media 101

Media Building Data Warehouse Technology 101

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. Does not have the resources to implement robust data governance and management.

Data Management 52

Data Management Management Data Lake Data Warehouse 52

The Modern Data Company

MAY 10, 2023

In our previous post, The Pros and Cons of Leading Data Management and Storage Solutions , we untangled the differences among data lakes, data warehouses, data lakehouses, data hubs, and data operating systems. Does not have the resources to implement robust data governance and management.

Data Management 52

Data Management Management Data Lake Data Warehouse 52

Data Engineering Podcast

NOVEMBER 27, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 100

Data Lake Data Warehouse MongoDB Data Pipeline 100

Data Engineering Podcast

DECEMBER 4, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

APRIL 3, 2022

Summary The flexibility of software oriented data workflows is useful for fulfilling complex requirements, but for simple and repetitious use cases it adds significant complexity. Coalesce is a platform designed to reduce repetitive work for common workflows by adopting a visual pipeline builder to support your data warehouse transformations.

Data Warehouse 100

Data Warehouse Data Workflow Data Architecture SQL 100

Data Engineering Podcast

DECEMBER 11, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. RudderStack helps you build a customer data platform on your warehouse or data lake.

Database 100

Database MySQL Data Lake MongoDB 100

Christophe Blefari

MARCH 31, 2023

If you did not register next week we’ll host an online meetup about Airflow alternatives and Prefect and Dagster teams will do a demo. Google Data Cloud & AI Summit Two days ago Google announced new things at their Data Cloud & AI Summit. I've already seen a few "jokes" on LinkedIn.

Bytes 130

Bytes Data Google Cloud Education 130

Data Engineering Podcast

NOVEMBER 20, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 130

Data Lake Data Ingestion MongoDB Scala 130

The Modern Data Company

MAY 8, 2023

Data lakes, data warehouses, data hubs, data lakehouses, and data operating systems are data management and storage solutions designed to meet different needs in data analytics, integration, and processing. However, data warehouses can experience limitations and scalability challenges.

Data Management 52

Data Management Data Lake Management Data Governance 52

The Modern Data Company

MAY 8, 2023

Data lakes, data warehouses, data hubs, data lakehouses, and data operating systems are data management and storage solutions designed to meet different needs in data analytics, integration, and processing. However, data warehouses can experience limitations and scalability challenges.

Data Management 52

Data Management Data Lake Management Data Governance 52

The Modern Data Company

MAY 8, 2023

Data lakes, data warehouses, data hubs, data lakehouses, and data operating systems are data management and storage solutions designed to meet different needs in data analytics, integration, and processing. However, data warehouses can experience limitations and scalability challenges.

Data Management 52

Data Management Data Lake Management Data Governance 52

Data Engineering Podcast

NOVEMBER 6, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Data teams are increasingly under pressure to deliver.

MongoDB 130

MongoDB Scala MySQL Data Lake 130

RandomTrees

APRIL 18, 2024

Real-world scenario Let’s consider a real-world scenario where a retail company has been using Informatica PowerCenter for its data integration needs, including extracting Products data and sales data from various sources, transforming it, and loading it into a data warehouse.

Coding 52

Coding Retail Metadata Python 52

Christophe Blefari

JUNE 16, 2023

Why data consumers do not trust your reporting — It is a good illustration of the data journey manifesto. Stakeholders often notice data issues before the data team does. Data warehouses are mutable, this is one of the many root causes proposed by Lucas. Data Documentation 101: Why?

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Data Engineering Podcast

JUNE 19, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Unstruk is the DataOps platform for your unstructured data.

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Monte Carlo

APRIL 27, 2023

Empowered by the rise of the modern data stack , leading companies like Warner Music Group , Chime and Petsmart are now turning to the Composable CDP to unlock a modular customer data architecture that centers on the cloud data warehouse. Why not build one single store of customer data to activate from centrally?

Data Warehouse 72

Data Warehouse Data Collection Architecture Data Storage 72

Data Engineering Podcast

APRIL 24, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Missing data? Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Warehouse 100

Data Warehouse Data Lake Data Pipeline BI 100

Databand.ai

JUNE 28, 2023

This might include processes like data extraction from different sources, data cleansing, data transformation (like aggregation), and loading the data into a database or a data warehouse. Data storage and delivery : Observability continues into the storage and delivery phase. Was this article helpful?

Data Pipeline 98

Data Pipeline Data Engineering Data Engineer Engineering 98

Data Engineering Podcast

JULY 3, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Tired of deploying bad data? Need to automate data pipelines with less red tape?

Architecture 100

Architecture Metadata MongoDB MySQL 100

Cloudera

AUGUST 31, 2021

Cloudera and Accenture demonstrate strength in their relationship with an accelerator called the Smart Data Transition Toolkit for migration of legacy data warehouses into Cloudera Data Platform. Accenture’s Smart Data Transition Toolkit . Are you looking for your data warehouse to support the hybrid multi-cloud?

Data Warehouse 80

Data Warehouse Database-centric Metadata Cloud 80

Data Engineering Podcast

APRIL 17, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Warehouse 100

Data Warehouse SQL Data Engineering Data Engineer 100

Monte Carlo

MARCH 21, 2024

I maintain a sandbox environment for Monte Carlo’s solution engineers to demo our data observability solution. I take a lot of pride in creating a realistic environment that mirrors the architecture our customers use to deliver data every day. I use Mockaroo to simulate source data.

Data Warehouse 52

Data Warehouse Technology Database Machine Learning 52

Data Engineering Podcast

JUNE 26, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Unstruk is the DataOps platform for your unstructured data.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Data Engineering Podcast

MAY 25, 2021

RudderStack’s smart customer data pipeline is warehouse-first. It builds your customer data warehouse and your identity graph on your data warehouse, with support for Snowflake, Google BigQuery, Amazon Redshift, and more. RudderStack’s smart customer data pipeline is warehouse-first.

Database 100

Database Building Data Warehouse Machine Learning 100

Data Engineering Podcast

OCTOBER 2, 2021

Datafold also helps automate regression testing of ETL code with its Data Diff feature that instantly shows how a change in ETL or BI code affects the produced data, both on a statistical level and down to individual rows and values. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Building 100

Building BI Data Architecture Architecture 100

Cloudera

DECEMBER 21, 2020

In this blog we will take you through a persona-based data adventure, with short demos attached, to show you the A-Z data worker workflow expedited and made easier through self-service, seamless integration, and cloud-native technologies. Company data exists in the data lake. The Data Scientist.

Banking 97

Banking Data Lake Data Data Warehouse 97

Data Engineering Podcast

JUNE 1, 2021

RudderStack’s smart customer data pipeline is warehouse-first. It builds your customer data warehouse and your identity graph on your data warehouse, with support for Snowflake, Google BigQuery, Amazon Redshift, and more. RudderStack’s smart customer data pipeline is warehouse-first.

Data Pipeline 100

Data Pipeline Data Warehouse Data Workflow Data 100

Data Engineering Podcast

NOVEMBER 13, 2022

Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. RudderStack helps you build a customer data platform on your warehouse or data lake.

MongoDB 100

MongoDB Scala MySQL Google Cloud 100

Data Engineering Podcast

MAY 18, 2021

RudderStack’s smart customer data pipeline is warehouse-first. It builds your customer data warehouse and your identity graph on your data warehouse, with support for Snowflake, Google BigQuery, Amazon Redshift, and more. RudderStack’s smart customer data pipeline is warehouse-first.

Metadata 100

Metadata Kafka Data Warehouse Hadoop 100

Data Engineering Podcast

MARCH 16, 2020

Your team will get the most complete, accurate and ready-to-use behavioral web and mobile data, delivered into your data warehouse, data lake and real-time streams. Set up a demo and mention you’re a listener for a special offer! Setting up and managing a data warehouse for your business analytics is a huge task.

Building 100

Building Data Warehouse NoSQL Data Lake 100

Data Engineering Podcast

SEPTEMBER 23, 2018

This includes modeling the lifecycle of your information as a pipeline from the raw, messy, loosely structured records in your data lake, through a series of transformations and ultimately to your data warehouse. What is your opinion on the relative merits of a data warehouse vs a data lake and are they mutually exclusive?

Data Lake 100

Data Lake Data Warehouse Data Architecture Architecture 100