Capital One · Statistics & Data Analysis
Choose and compute correct t-test
TrueInterview
October 7, 2026 · 1 min read
An ads experiment yields two independent samples of watch time per impression, measured in seconds:
- Group A: , ,
- Group B: , , Treat the departure from normality as mild and rely on the large sample sizes. Tasks:
- Write the null and alternative hypotheses formally, and say whether a one-tailed or two-tailed test is appropriate when the product objective is to detect an increase; explain your reasoning.
- Calculate the Welch t-statistic, the approximate degrees of freedom, the p-value, and the 95% confidence interval for . Present the formulas and numeric results rounded to three decimals.
- Compute Cohen's d using the unbiased pooled standard deviation and describe what the effect size means.
- Suppose you had pre-registered a one-tailed test for an increase. Recompute the p-value for that specification and discuss the risks of getting the one-tailed direction wrong.
- Power/MDE: with (two-sided) and power , what per-group sample size is required to detect a 2-second difference if the common SD is about 30.5? Show the formula and the resulting number. Overview: This question tests a candidate's ability to perform statistical inference for experiments: stating hypotheses and choosing directionality, computing Welch's t-test for independent samples, constructing confidence intervals, calculating Cohen's d, and carrying out power/sample-size calculations.
Loading comments…