Back to problems

Design experiment for homepage tab replacement

System Design · Roblox · Medium

Imagine that on September 1, 2025, Roblox will remove one of its current homepage tabs and launch a redesigned replacement. You need to design a robust causal experiment to evaluate the change’s impact both on individual end-users and on the platform’s creator ecosystem. Your experimental plan must specify the following: Randomization unit and design: choose whether the unit is a user, device, or another entity, and describe how to avoid contamination when a person signs in…

Checking your access…