Shashank Agarwal

Technical lead on the Experimentation Platform team at Wayfair. Shashank's expertise lies at the intersection of software engineering and causal inference

Wayfair Tech Blog

When Assigned Isn't Exposed: How Wayfair Uses Trigger Analysis to Recover Hidden Test Signals

A/B testing is one of the most important tools for data-driven product development. It allows teams to estimate the causal impact of a product, design or engineering change by randomly assigning customers to control and treatment experiences. At Wayfair, experimentation runs at scale across the product, and our platform Gambit handles millions of assignments every day. The mechanics are intentionally simple: when a customer loads a page where a test is active, they are immediately bucketed into control or treatment. Assignment is fast, consistent and happens at pageview. But assignment at pageview is not the same as exposure to the treatment.

15 Min Read