Lesson 9: Stereotype priming and behaviour
Evaluate a priming study and its reliability
SkillsStereotype priming researchAnalysing priming data
Worked example
A student repeats the priming experiment with her netball team. The six players who arrive first are given the old-age sentences and the next six the neutral sentences. She times each player herself with her phone's stopwatch as they walk to the door. The old-age group takes a mean of 6.10 s (SD 0.42) and the neutral group 5.62 s (SD 0.35); an unpaired t-test gives , .
She concludes: "This proves that stereotype priming does not work."
Evaluate her method and her conclusion, with reference to validity, reliability and the replication history of Bargh, Chen & Burrows (1996).
Step 1: Allocation
Allocation was by arrival time, not random. Players who arrive first may differ systematically (keener, fitter, more punctual) from those who arrive later, a confounding variable that threatens internal validity. Random allocation would spread these differences.
Step 2: Timing and blinding
She timed the players herself and knew each player's condition, so her expectations could bias the times, the very problem Doyen et al. (2012) identified. A blind timekeeper or automatic timing would remove it.
Step 3: Sample
Twelve netballers is a small convenience sample from one sport, so the results generalise poorly (external validity), and with six per group the test has little power to detect a small effect.
Step 4: The statistics
, so she should fail to reject the null hypothesis. The difference is not statistically significant, but the means differ in the predicted direction, and with so few participants a real effect could have been missed (a possible type II error).
Step 5: The conclusion
A non-significant result does not prove that priming does not work. At most it fails to find evidence for it in this sample. Her conclusion overstates the data.
Step 6: Link to the wider evidence
The original study found a significant effect with 30 participants per experiment, but larger replications with automated timing (Doyen et al. 2012) did not, so the effect's reliability is genuinely uncertain. Her study cannot settle the question either way; a larger, randomly allocated, blind replication could add evidence.
Answer
Her method has non-random allocation (a confound), an unblinded timekeeper (experimenter bias), and a small convenience sample (low power, poor generalisability). With she fails to reject the null hypothesis, but this does not prove priming has no effect: a type II error is possible. Given that the original finding has replicated poorly with tighter controls, the effect's reliability is uncertain; her study adds little evidence either way.
Try a similar one
A fresh question of the same kind, checked as you answer, with hints and a full solution.
Method
Check allocation, blinding, sample size and sample type, and name the threat each creates.
Compare with 0.05 and use the right wording ("fail to reject", never "prove").
Consider type I and type II errors.
Place the result in the context of other replications.
Watch out for
Writing "accept the null hypothesis" or "proves". Statistics never prove a hypothesis.
Listing limitations without saying what each does to validity or reliability.