Back to problems

Search / Ranking / Experimentation

System Design · Amazon · Hard

Requirements Choose a domain. Often the interviewer will suggest “search ranking” or “image generation for brand ads,” but you may be asked to pick one yourself. Walk through the full ML stack: retrieval, candidate generation, ranking, re-ranking, business-rule overlays, and online evaluation. Discuss evaluation metrics. For offline evaluation, cover NDCG and MRR. For online evaluation, cover CTR, conversion, and brand-safety pass rate. Also explain how to design an A/B test…

Checking your access…