Blog Designing Pipeline-centric Systems 
Lyft Engineering
APRIL 3, 2023
This blog post focuses on the scope and the goals of the recommendation system, and explores some of the most recent changes the Rider team has made to better serve Lyft’s riders. Introduction: Scope of the Recommendation System The recommendation system covers user experiences throughout the ride journey.
Data Engineering Weekly
MARCH 3, 2024
Here is the agenda, 1) Data Application Lifecycle Management - Harish Kumar( Paypal) Hear from the team in PayPal on how they build the data product lifecycle management (DPLM) systems. 3) DataOPS at AstraZeneca The AstraZeneca team talks about data ops best practices internally established and what worked and what didn’t work!!!
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
DoorDash Engineering
NOVEMBER 28, 2023
It is amusing for a human being to write an article about artificial intelligence in a time when AI systems, powered by machine learning (ML), are generating their own blog posts. Setting an initial ambitious goal to drive model development velocity, we soon assembled a team that included both design and engineering.
Databand.ai
JULY 19, 2023
Data lineage tools provide a visual representation of your data’s journey across multiple systems and transformations. This feature is particularly useful in complex data architectures, where data may pass through multiple systems and transformations.
Pinterest Engineering
SEPTEMBER 20, 2023
These teams work together to ensure algorithmic fairness, inclusive design, and representation are an integral part of our platform and product experience. Likewise in closeup recommendations, we added an additional diversification objective to the existing DPP Node as the final step in our blending pipeline prior to returning ranked results.
Data Engineering Weekly
APRIL 2, 2023
Meta: Presto - A Decade of SQL Analytics at Meta Presto and Kafka are the two systems that greatly impacted data infrastructure in the last decade. As with any good system, Presto went through many optimizations. There are some interesting threads on Twitter, but the highlight for me is the design of the Tweet search system.
Data Engineering Weekly
APRIL 16, 2023
Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make collecting data from every application, website, and SaaS platform easy, then activating it in your warehouse and business tools. Watch On-demand Niels Claeys: Use dbt and Duckdb instead of Spark in data pipelines AWS u-24tb1.metal
Expert insights. Personalized for you.
87 
Let's personalize your content