Ascend.io

AUGUST 31, 2023

In the dynamic world of data, many professionals are still fixated on traditional patterns of data warehousing and ETL, even while their organizations are migrating to the cloud and adopting cloud-native data services. Transform before Load: The ETL process conforms data to the static, predefined warehouse schema.

Data Lake 52

Data Lake ETL Tools Data Warehouse Data Pipeline 52

Grouparoo

DECEMBER 14, 2021

The ETL data integration process has been around for decades and is an integral part of data analytics today. In this article, we’ll look at what goes on in the ETL process and some modern variations that are better suited to our modern, data-driven society. What is ETL?

Process 52

Process Raw Data Data Warehouse Data Pipeline 52

Data Engineering Podcast

DECEMBER 4, 2022

Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day.

Business Intelligence 100

Business Intelligence Metadata BI MongoDB 100

Data Engineering Weekly

MARCH 12, 2023

LinkedIn writes about dependency caching solutions and why they adopted user-level caching instead of cluster-level. link] Microsoft: Speeding up “Reverse ETL” Reverse ETL is an approach to bring data from a central warehouse/lake/lakehouse into real-time operating systems such as Salesforce, Marketo, or Zendesk.

Data Engineering 52

Data Engineering Data Engineer Engineering SQL 52

Grouparoo

OCTOBER 26, 2021

This may include a data warehouse when it’s necessary to pipeline data from your warehouse to various destinations as in the case of a reverse ETL pipeline. Data Pipeline vs ETL An ETL (Extract, Transform, and Load) system is a specific type of data pipeline that transforms and moves data across systems in batches.

Data Pipeline 52

Data Pipeline ETL Tools ETL System Data Warehouse 52

Data Engineering Podcast

OCTOBER 16, 2022

Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day.

Database 100

Database Metadata MongoDB MySQL 100

Data Engineering Podcast

OCTOBER 2, 2022

Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day.

Metadata 100

Metadata Electronics MongoDB MySQL 100

Data Engineering Podcast

SEPTEMBER 25, 2022

Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day.

Building 100

Building Metadata MongoDB MySQL 100

Data Engineering Podcast

MARCH 27, 2022

Privacera is an enterprise grade solution for cloud and hybrid data governance built on top of the robust and battle tested Apache Ranger project. Their SDKs make event streaming from any app or website easy, and their state-of-the-art reverse ETL pipelines enable you to send enriched data to any cloud tool.

Data Governance 130

Data Governance Government Cloud Building 130

Data Engineering Podcast

AUGUST 27, 2021

Supercharge your business teams with customer data using Hightouch for Reverse ETL today. Have you ever had to develop ad-hoc solutions for security, privacy, and compliance requirements? Supercharge your business teams with customer data using Hightouch for Reverse ETL today. No more scripts, just SQL.

Data Integration 100

Data Integration Architecture Data Warehouse Data Lake 100

Data Engineering Podcast

OCTOBER 9, 2022

Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day. are already available as plug-and-play connectors with reliable, intuitive SaaS solutions. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day.

Metadata 100

Metadata MongoDB AWS MySQL 100

Data Engineering Weekly

MARCH 30, 2023

We discussed the potential consolidation of various tools and categories in the modern data stack, including ETL, reverse ETL, data quality, observability, and data catalogs. We also discussed ETL's potential future, the rise of zero ETL, and its challenges.

Machine Learning 52

Machine Learning Government AWS Data Engineering 52

dbt Developer Hub

JUNE 12, 2023

This table only stores the current attributes for each user, and is then loaded into the various SaaS platforms via Reverse ETL tools. Related resources ​ Operational Analytics in Practice How dbt Labs' data team approaches reverse ETL The Operational Data Warehouse: Reverse ETL, CDPs, and the future of data activation

Building 59

Building ETL Tools Data Warehouse Machine Learning 59

Snowflake

OCTOBER 9, 2023

Now, Hightouch and Snowflake are launching an event collection solution that makes it easy to collect and then store digital events directly in the Data Cloud. Reverse ETL : Activate data to 200+ downstream tools with SQL, dbt and more. Many event collection solutions charge for each incremental “monthly tracked user” (MTU).

Cloud 88

Cloud Building SQL Data 88

Data Engineering Podcast

NOVEMBER 10, 2021

After experiencing the impacts of fragmented metadata and previous attempts at building a solution Suresh Srinivas and Sriharsha Chintalapani created the OpenMetadata project. Supercharge your business teams with customer data using Hightouch for Reverse ETL today. Start trusting your data with Monte Carlo today!

Metadata 100

Metadata Data Warehouse Data Lake BI 100

Data Engineering Podcast

AUGUST 28, 2022

Orchestration engines are one step in that direction, but they are not a complete solution. Their SDKs make event streaming from any app or website easy, and their state-of-the-art reverse ETL pipelines enable you to send enriched data to any cloud tool. Summary The dream of every engineer is to automate all of their tasks.

Data Engineering 100

Data Engineering Data Engineer MongoDB Metadata 100

Data Engineering Podcast

AUGUST 20, 2021

Supercharge your business teams with customer data using Hightouch for Reverse ETL today. Have you ever had to develop ad-hoc solutions for security, privacy, and compliance requirements? Supercharge your business teams with customer data using Hightouch for Reverse ETL today. No more scripts, just SQL.

Building 100

Building Data Lake Data Warehouse SQL 100

Monte Carlo

DECEMBER 29, 2022

What else could you need from a forward-looking proposal on better root cause analysis solutions? But what makes this a post worth reading is the discussion on why we decided to discard the original solution for a more practical, elegant one involving our partners. There are charts, there are equations, there is code.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52

Christophe Blefari

DECEMBER 31, 2023

Octolis is a CDP / reverse-ETL solution and Brevo is a CRM, the join makes total sense. AI data platform VAST Data raises $118m. All-in-one platform for big corp to do AI and engineering at the same place. Octolis has been acquired by Brevo (ex-SendinBlue). See you this Friday with a post opening 2024 🎊

Data 100

Data Cloud Storage Datasets Python 100

Grouparoo

JANUARY 26, 2022

Over the last few years, tools like Snowflake and BigQuery have become the go-to solution in this space. Data teams are now becoming involved in this productization of their data stack through this process called Reverse ETL. At Grouparoo, we are also seeing an uptick in requests for Clickhouse, an open source data warehouse.

Data Warehouse 52

Data Warehouse Food ETL Tools Raw Data 52

Data Engineering Podcast

AUGUST 14, 2021

Supercharge your business teams with customer data using Hightouch for Reverse ETL today. Have you ever had to develop ad-hoc solutions for security, privacy, and compliance requirements? Supercharge your business teams with customer data using Hightouch for Reverse ETL today. No more scripts, just SQL.

Unstructured Data 100

Unstructured Data Machine Learning Data Lake SQL 100

Data Engineering Podcast

OCTOBER 2, 2022

Alvin is a platform that aims to provide a low effort solution for data lineage capabilities focused on simplifying the work of data engineers. Their SDKs make event streaming from any app or website easy, and their state-of-the-art reverse ETL pipelines enable you to send enriched data to any cloud tool.

IT 100

IT Food PostgreSQL MongoDB 100

Data Engineering Podcast

AUGUST 6, 2021

Supercharge your business teams with customer data using Hightouch for Reverse ETL today. Have you ever had to develop ad-hoc solutions for security, privacy, and compliance requirements? Supercharge your business teams with customer data using Hightouch for Reverse ETL today. No more scripts, just SQL.

Database 100

Database SQL BI Business Intelligence 100

Data Engineering Podcast

JUNE 26, 2022

Their SDKs make event streaming from any app or website easy, and their state-of-the-art reverse ETL pipelines enable you to send enriched data to any cloud tool. What are the challenges that they typically experience that leads them to MDM as a solution for their problems? Who are the target customers for Profisee?

Data Management 100

Data Management Management MongoDB Scala 100

Monte Carlo

SEPTEMBER 12, 2022

Now, according to Maxime, a new trend is emerging that could have a similar effect on data engineering workloads: reverse ETL. Reverse ETL tooling enables companies to easily move transformed data from their cloud warehouse out into operational business tools, like a CRM.

BI 52

BI Data Governance ETL Tools Data Warehouse 52

ProjectPro

FEBRUARY 16, 2023

Knowing SQL helps data engineers optimize data infrastructures for better performance and efficiency and also develop more effective data models and data warehousing solutions. A DELETE command can always be reversed by using a rollback action. The Unpivot operator performs the reverse operation, turning column-based data into rows.

Data Engineering 52

Data Engineering Data Engineer SQL Engineering 52

Monte Carlo

MARCH 30, 2022

And as we’ve learned building solutions to curb the causes and downstream impact of data issues, it happens more often than you think. Tagging tables that are covered by data SLAs as part of a data certification process is a great solution to avoid the “you’re using that table?!” Like any entropic system, data breaks.

Data Warehouse 52

Data Warehouse Data Machine Learning Data Engineering 52

Monte Carlo

SEPTEMBER 1, 2022

The analytical mindset helps you ask the right questions to evaluate business impact whereas the engineering mindset helps you reverse engineer the path from the goal to the steps required to reach it. It can be the same way with data engineers and the bevvy of technology solutions we leverage on the job.

Data Engineering 52

Data Engineering Data Engineer Engineering Datasets 52

Meltano

JULY 7, 2022

An ideal data stack today can have upwards of 15 tools in it, including extract and loader tools, transformers, reverse ETL, warehouses, business intelligence (BI) tools, and metrics layers. Data professionals are feeling this pain, but the solution isn’t necessarily obvious to them.

BI 52

BI Software Engineer Software Engineering Data Workflow 52

Monte Carlo

APRIL 12, 2022

Some are proven best practices, some are solved by vendor solutions, and some we haven’t quite yet solved ourselves. Sometimes that may involve building complex ETL pipelines from scratch. It’s much faster to just use an automated solution. Reviewing the ETL code of the upstream table experiencing the issue.

Data Engineering 52

Data Engineering Data Engineer Process Engineering 52

Towards Data Science

APRIL 17, 2023

We’ve been building modern data stacks, migrating to Snowflake like our lives depended on it, investing in headless BI, and growing our teams faster than you can say reverse ETL. Eventually, however, these solutions started tying volume of data to cost. Don’t get me wrong: I’m a firm believer in the modern data stack.

Data 97

Data Data Engineering Data Engineer Engineering 97

Towards Data Science

JUNE 16, 2023

Both options can work and the best solution depends on your situation. Mapping out these use cases requires you to have a deep understanding of how your company works, what’s most important to your stakeholders and what potential implications of issues are. bronze, silver, gold) or a binary approach (e.g. critical, non-critical).

BI 80

BI Data ETL Tools Machine Learning 80

dbt Developer Hub

FEBRUARY 7, 2022

DM me in dbt Community Slack (I’m @Donny Flynn (Census) ) if you want to learn more about JaffleGaggle, PLG, reverse ETL, or how I created these random datasets. ? You most definitely deserve a jaffle. ? PS: @clrclr don’t hate me. ??

Data Warehouse 52

Data Warehouse Datasets Data SQL 52

Monte Carlo

JULY 5, 2023

Babylist’s sophisticated data stack comprises several technologies: Snowflake at the center of storage and compute, dbt for modeling, an AWS data science stack atop SageMaker, Segment and Astronomer for reverse ETL into various internal and external tools, Sigma for data visualization, Secoda for cataloging, and Monte Carlo for data observability.

High Quality Data 52

High Quality Data Data Software Engineer Software Engineering 52

Monte Carlo

APRIL 13, 2023

We’ve been building modern data stacks, migrating to Snowflake like our lives depended on it, investing in headless BI, and growing our teams faster than you can say reverse ETL. Eventually, however, these solutions started tying volume of data to cost. Don’t get me wrong: I’m a firm believer in the modern data stack.

Data 59

Data BI Engineering Data Engineering 59

Christophe Blefari

MARCH 2, 2024

Using DuckDB + Ibis for RAG — Handy code snippet to explain why DuckDB is a good solution bringing best of both world when it comes to RAG. Personally I'm the kind of guy who likes to build it custom because I think an out-of-box solution does not exist. I bet it gonna become the best solution for this issue out there.

Data 162

Data Python Database BI 162

Data Engineering Weekly

DECEMBER 18, 2023

link] Sponsored: RudderStack launches Trino Reverse ETL source The integration supports warehouse-based diffing, making it the most performant Reverse ETL solution for Trino. RudderStack just launched Trino as a Reverse ETL source.

Data Engineering 67

Data Engineering Data Engineer Engineering Food 67