Remove whats-new-data-sharing-and-collaboration-lakehouse
article thumbnail

Data Engineering Weekly #120

Data Engineering Weekly

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. I believe Data Contract is a technology solution to bring organizational change.

article thumbnail

Making Email Better With AI At Shortwave

Data Engineering Podcast

In this episode he shares the technical challenges that he and his team have overcome in integrating AI into their product, as well as the benefits and features that it provides to their customers. Data lakes are notoriously complex. Can you describe what Shortwave is and the story behind it? Your first 30 days are free!

Data Lake 182
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Version Your Data Lakehouse Like Your Software With Nessie

Data Engineering Podcast

Summary Data lakehouse architectures are gaining popularity due to the flexibility and cost effectiveness that they offer. The link that bridges the gap between data lake and warehouse capabilities is the catalog. Data lakes are notoriously complex. Go to dataengineeringpodcast.com/dagster today to get started.

Data Lake 147
article thumbnail

Find Out About The Technology Behind The Latest PFAD In Analytical Database Development

Data Engineering Podcast

Over the decades of research and development into building these software systems there are a number of common components that are shared across implementations. Data lakes are notoriously complex. Join us at the top event for the global data community, Data Council Austin. Your first 30 days are free!

Database 162
article thumbnail

Taking Charge of Tables: Introducing OpenHouse for Big Data Management

LinkedIn Engineering

Co-Authors: Sumedh Sakdeo , Lei Sun , Sushant Raikar , Stanislav Pak , and Abhishek Nath Introduction At LinkedIn, we build and operate an open source data lakehouse deployment to power Analytics and Machine Learning workloads. While functional, our current setup for managing tables is fragmented.

article thumbnail

Q&A Picnic Data Engineering Series

Picnic Engineering

Data Mesh, or Hub-and-Spoke? and other reflections on building data governance. Since the publication of the first blog post in this series, we have received numerous questions via social media, direct messages, public posts, and meet-up discussions. What exactly is a “lakeless” Data Warehouse? Any advice?

article thumbnail

Analytics Engineer: Job Description, Skills, and Responsibilities

AltexSoft

As you may guess from the name, this role sits somewhere in the middle of a data analyst and data engineer, but it’s really neither one nor the other. Quoting a comment from the Reddit discussion , “Their [analytics engineers] job is to marry the technical requirements of the data stack with the business objectives”.