System Design · Upstart · Medium
You are given A/B test results for a redesigned account creation funnel. The data file contains these fields: group (control/treatment), sessions, signups, activation_d7, p95_latency_ms, support_tickets, refund_rate, and revenue_d30. Outline precisely your step-by-step method for: Checking data quality: run a sample ratio mismatch (SRM) test, verify assignment integrity, and reconcile exposure logs with analytics event counts. Selecting one primary metric and a small number…
Checking your access…