Lesson 3: WEIRD research and international collaboration
Evaluate a claim from a WEIRD sample
SkillsWEIRD samples and collaborationResearch methods across cultures
Worked example
A news article reports: "Psychologists have shown that people are happiest when they make decisions on their own." The study it describes asked 200 psychology undergraduates at a university in the United States to rate their happiness after choosing a prize themselves or having it chosen for them.
Evaluate the article's claim with reference to the sample.
Step 1: Describe the sample
Psychology undergraduates at one US university: young, educated, from a Western, industrialised, rich, democratic society, a WEIRD sample.
Step 2: Identify the problem
The claim is about "people" in general, but the finding may reflect the culture of the sample. The US is strongly individualist, where personal choice is valued; in cultures that tend to value group decisions, having a choice made by family or the group may not reduce happiness.
Step 3: Name the validity issue
The study may have good internal validity, but its external (population) validity is limited: the results may not be fully applicable to people in other cultural contexts, or even to older or less educated Americans.
Step 4: Suggest how to test it
Repeat the study in several cultures, with researchers from each culture adapting and translating the materials (international collaboration).
Step 5: Judge the claim
The claim overgeneralises. The evidence supports the conclusion only for people like the participants.
Answer
The claim overgeneralises: the sample is WEIRD (US psychology undergraduates), and valuing personal choice may be a feature of an individualist culture. The finding may not apply in cultures that tend to value group decisions. Testing it across cultures through international collaboration would show whether it generalises.
Try a similar one
A fresh question of the same kind, checked as you answer, with hints and a full solution.
Watch out for
Saying the study is "wrong". It may be valid for its sample; the problem is generalising beyond it.