Lesson 7 of 8 · 15 min

What 95% confidence means

Explain the confidence level through repeated sampling, see why most but not all intervals contain μ, avoid the probability misreading, and use an interval to judge a claim.

What you will be able to do

  • Explain that confidence intervals vary from sample to sample and that most, but not all, contain μ\mu.
  • Interpret a confidence level as the long-run proportion of intervals that capture μ\mu.
  • Count intervals that miss μ\mu, and find probabilities about them with the binomial distribution.
  • Use a confidence interval to judge a claim about μ\mu, worded carefully in context.

A bottling plant's machine is set to fill bottles with a mean of 500500 mL. Imagine 100 inspectors, each taking their own random sample of 40 bottles and building a 95% confidence interval for the mean fill. Their intervals will all be different, because their samples are. Will every interval contain 500500?

Interactive

Many samples, many intervals

Draw 100 intervals and count the ones that miss μ\mu. Then change the confidence to 80% and 99%: what happens to the widths, and to the number that miss? Then change nn.

Twenty 95% intervals from twenty samples of 40 bottles. Nineteen contain μ=500\mu = 500; one (red) misses. (Each sample's own ss makes real widths differ slightly; here they are drawn equal.)

Key idea

What the confidence level describes

μ\mu is a fixed number. The intervals are what vary, because they are built from random samples. A 95% confidence level means that if you took many random samples and built an interval from each, about 95% of the intervals would contain μ\mu. Most, but not all: about 1 in 20 misses.

For one calculated interval, say "we are 95% confident that μ\mu lies between … and …". The confidence is in the method that produced it.

Common mistake

"There is a 95% probability that μ is in (496.1, 499.5)"

Once the interval is calculated, nothing in that statement is random: μ\mu is fixed and the endpoints are numbers, so μ\mu either is in the interval or is not. The 95% is the probability, before sampling, that the method will produce an interval containing μ\mu. Also avoid "95% of the data lie in the interval" and "95% of sample means lie in the interval": both are wrong.

A random sample of 60 apples gives an approximate 95% confidence interval for the mean mass of all apples in an orchard of (182.4,189.6)(182.4, 189.6) g. Which statement is correct?

Choose one answer

Fifty independent random samples are taken, and an approximate 90% confidence interval for μ\mu is calculated from each. How many of the intervals would you expect not to contain μ\mu?

Confidence intervals are how scientists and regulators test claims. If a claimed value of μ\mu lies inside the interval, it is a plausible value and the data give no reason to doubt it (they don't prove it, either). If it lies outside, the data are evidence against the claim, because a 95% interval misses the true mean only about 5% of the time.

Worked example

Testing a label claim with a confidence interval

  • Complex unfamiliar
  • Technology active

A drinks company labels its bottles "500 mL" and claims the mean fill is 500500 mL. A consumer group buys a random sample of 5050 bottles and finds xˉ=497.8\bar{x} = 497.8 mL and s=6.2s = 6.2 mL.

(a) Calculate an approximate 95% confidence interval for the mean fill μ\mu, correct to 2 decimal places.

(b) Does the interval support the company's claim? Explain.

(c) The company replies that a 99% interval contains 500 mL. Verify this, and evaluate the company's argument.

4 steps

Try it yourself first, then check the working one step at a time.

Method

  1. Build the interval, then ask whether the claimed μ\mu is inside.

  2. Inside: plausible. Outside: evidence against the claim.

  3. Remember that the conclusion can depend on the confidence level, and say so.

Watch out for

  • Saying the claim is "proved false": the interval gives evidence, not certainty.

  • Concluding the 95% interval has a 95% chance of containing 500 mL.

A company claims its delivery drivers average 42 deliveries a day. A random sample of 45 driver-days gives the 95% interval (39.8,43.6)(39.8, 43.6) for the mean. What is the best conclusion?

Choose one answer

Summary

  • Intervals vary from sample to sample; μ\mu does not.

  • A 95% confidence level means about 95% of intervals from repeated samples contain μ\mu: most, but not all.

  • Say "95% confident", not "95% probability that μ\mu is in this interval".

  • The number of CC-level intervals out of kk that contain μ\mu is approximately Bin(k,C)\mathrm{Bin}(k, C).

  • A claimed value inside the interval is plausible; outside, the data are evidence against it.

Finished the lesson?

Try the 3 quick checks above and the lesson completes itself, or mark it complete now.

Lesson 7 of 80% read

Save your progress with a free account