System Design · Uber · Medium
Experiment Design for Email Campaign A/B Test 1) Randomization Randomization unit: The individual user (hashed email address / stable user ID) at the weekly campaign level. Each week, eligible users are randomly assigned to either the control (current subject line) or treatment (new subject line) group. Stratification blocks: Engagement tier (e.g., active openers, occasional openers, dormant users) Device category (mobile, desktop, tablet) Locale / region (or time zone…
Checking your access…