Evaluate AI-assisted ad creation

Meta is evaluating whether to introduce an AI-assisted ad creation tool for advertisers. The tool would help advertisers produce ad copy and/or creative assets within the existing ad creation flow. The product team wants to determine whether the feature delivers genuine value, rather than merely attracting clicks.

How would you decide whether this feature should launch?

Please cover:

• The product goal and the key success metric(s)
• A complete set of metrics spanning advertiser adoption, campaign creation, downstream ad performance, platform revenue, and user-quality safeguards
• An experiment design, including the randomization unit, test length, and how to account for the fact that using the feature may be optional
• How to separate incremental impact from cannibalization of existing ad creation tools or sources
• Major risks such as selection bias, interference through the ad auction, novelty effects, and heterogeneous treatment effects across advertiser segments

Overview: This question tests skills in product analytics, experiment design, causal inference, metric definition, and measuring downstream business and user-quality effects for an AI-assisted advertising feature.