Lesson 5: What 95% confidence really means
How many of 100 intervals capture p?
SkillWhat the confidence level means
Worked example
A health department runs the same survey in 100 different regions with the same true proportion , taking an independent random sample in each and calculating a 95% confidence interval for .
(a) How many of the intervals would you expect to contain ?
(b) Find the probability that at least 93 of the intervals contain .
(c) A manager says, "With 95% intervals, all 100 should contain ." Comment.
Step 1: Model the count
Each interval contains with probability 0.95, independently, so the number that do is .
Each region is a trial with two outcomes (captures or not), the same success probability, and independent samples.
Step 2: Expected number
.
Step 3: Probability of at least 93
(binomial cdf).
Step 4: Probability that all 100 contain p
Step 5: Comment
The manager is wrong. A 95% confidence level means about 95% of intervals contain , so we expect about 5 to miss. All 100 containing has probability only about 0.006.
Answer
(a) 95 (b) (c) Wrong: we expect about 5 to miss ; the probability that none miss is about 0.006.
Try a similar one
A fresh question of the same kind, checked as you answer, with hints and a full solution.
Method
The number of intervals containing is .
Use the binomial mean and cdf.
Watch out for
Computing instead of : "at least 93" includes 93.