Back to problems

Decide launch of downranking suspected bad sellers

System Design · ByteDance · Hard

You are considering a change to marketplace search ranking in which listings from sellers that a model identifies as high-risk would be demoted in the results. Decide whether this change should be launched. Provide a complete decision framework and experiment design, addressing all of the following: (a) Specify the exact treatment. For example, you might move listings from sellers above a given risk threshold down by a fixed number of positions, or apply a multiplicative…

Checking your access…