Lesson 2: Bias and procedures that ensure randomness
Select a simple random sample and compare methods
SkillsProcedures that ensure randomnessSpotting bias in samples
Worked example
A Cairns surf life saving club has 800 members and wants to survey 40 of them about training times.
(a) Describe how to select a simple random sample of 40 members using a calculator.
(b) Describe how to select a systematic sample of 40 members from the membership list.
(c) The club president suggests surveying the 40 members at Sunday morning training instead. Explain why this may be biased.
Step 1: Set up the sampling frame
Use the club's membership list of all 800 members and number them 1 to 800.
Every member must be on the list, or some can never be chosen.
Step 2: Generate random numbers
Use
RanInt#(1, 800)(Casio) orrandInt(1, 800)(TI) repeatedly. Ignore any number already chosen, until there are 40 different numbers.Step 3: Select the sample
The 40 members with those numbers form a simple random sample. Every group of 40 members was equally likely to be chosen.
Step 4: Find the sampling interval
, so the systematic sample takes every 20th member.
Step 5: Choose a random start
Generate a random integer from 1 to 20, say 13. The sample is members : that is 40 members.
The random start gives every member the same chance, , of selection.
Step 6: Explain the bias
Members who come to Sunday morning training are the ones for whom the current time suits. Members who can't make that time — perhaps because of work or family — are left out, so the survey would likely overstate support for the current training times. This is convenience (selection) bias.
Answer
Number the 800 members, generate random integers from 1 to 800 ignoring repeats until 40 are chosen. For a systematic sample, take every 20th member from a random start between 1 and 20. Surveying Sunday trainers is a convenience sample that leaves out members for whom that time doesn't suit, so it is biased towards the current times.
Try a similar one
A fresh question of the same kind, checked as you answer, with hints and a full solution.
Method
Number the sampling frame to .
Simple random sample: random integers from 1 to , ignoring repeats.
Systematic sample: ; random start from 1 to ; then every th.
To explain bias, say who is left out and which way that pushes the result.
Watch out for
Forgetting to say what happens to repeated random numbers.
Starting a systematic sample at member 1 every time: the start must be random.