Cvs Health · Statistics & Data Analysis
Explain p-value and choose correct test
TrueInterview
October 7, 2026 · 1 min read
Part A — Plain-language p-value: Describe a p-value to a layperson without ever saying it is the probability that the null hypothesis is true. Draw on a concrete real-world analogy, and clear up typical misreadings—for example, p does not measure effect size, and p is conditional on the chosen test and its assumptions.
Part B — Wilcoxon vs t-test: For each scenario below, choose and defend the right test, its assumptions, and an effect-size measure.
-
Paired data: 12 patients have systolic blood pressure recorded before and after a low-sodium diet; the paired differences are skewed and contain outliers. Decide between a paired t-test and a Wilcoxon signed-rank test. Give the assumptions, how you would assess them, how ties or zero differences are treated, and an effect size to report (for example, Cohen's dz versus the rank-biserial correlation or matched-pairs r).
-
Independent samples: Compare length of stay across two independent clinics (n=18 and n=25) when variances are unequal and the distributions are non-normal with heavy tails. Select either Welch's t-test or a Wilcoxon rank-sum (Mann–Whitney) test. Discuss what the nonparametric approach estimates—the probability of superiority—versus the mean-difference target of Welch's test, when each option is more appropriate, and how you would add confidence intervals and a robust effect size (such as Hedges' g with HC3 standard errors or Cliff's delta).
Overview: This question assesses a candidate's grasp of statistical inference, hypothesis testing, and robust test choice, centered on p-value interpretation and decisions between paired and independent designs as well as parametric and rank-based methods.