Addressing the Challenges of Sample Ratio Mismatch in A/B Testing
DoorDash Engineering
OCTOBER 17, 2023
Cautionary tales of faux gains and real losses Example 1: The $10 Million Mirage Imagine that your target is to improve weekly revenue per user. Almost every customer-focused company has an internal practice of dogfooding in which internal employees get the latest features by default. split — more than enough to trigger an SRM failure.
Let's personalize your content