Resolve a Conflict Between Metrics and Customer Feedback

Overview: Examine a decision in which the numbers and what customers said directly seemed to point in opposite directions. Look at instrumentation, segmentation, timing, and sampling bias, then describe the extra evidence and the trade-off that settled the disagreement.