Lesson 6: Cultural bias in intelligence testing

Find and explain a biased test item

SkillsCultural bias in testingReliability and validity of tests

Worked example

  • Complex unfamiliar

A test developer trialled five items of a new reasoning test with two groups of Year 7 students from different cultural backgrounds. The groups were matched on their total scores on the rest of the test. The table shows the percentage of each group who answered each item correctly (illustrative data).

Item12345
Group A (%)7265588044
Group B (%)7063317846

Item 3 asks which of four winter sports uses a toboggan.

(a) Identify the item most likely to be culturally biased, using the data. (b) Explain why it is biased, and evaluate what the developer should do.

1 of 5 steps
  1. Step 1: Find the differences

    Differences (A − B): item 1, 2; item 2, 2; item 3, 27; item 4, 2; item 5, −2 percentage points.

Try a similar one

A fresh question of the same kind, checked as you answer, with hints and a full solution.

Method

  1. With groups matched on ability, compare pass rates item by item.

  2. A large gap on one item suggests bias in that item.

  3. Explain what besides the ability the item measures.

  4. Evaluate the remedy and its limits.

Watch out for

  • Choosing the hardest item (item 5) instead of the one with the biggest gap between groups.

  • Treating a gap between matched groups as a difference in ability.

Save your progress with a free account