Lesson 7: Reliability and validity of diagnosis

Agreement is not accuracy

SkillReliability and validity of diagnosis

Worked example

  • Complex familiar

In a fictional study, two psychiatrists who trained together at the same clinic independently assess 20 people referred for low mood. They agree on 18 of the 20 diagnoses. A year later, an independent team carries out a full follow-up assessment and finds that 5 of those 18 agreed diagnoses were wrong.

(a) Calculate the per cent agreement. (b) Calculate the percentage of all 20 people whose agreed diagnosis was confirmed by the follow-up. (c) Explain what the results show about the reliability and validity of the diagnoses, and suggest a reason.

1 of 5 steps
  1. Step 1: Per cent agreement

    1820×100%=90%\frac{18}{20} \times 100\% = 90\%
    90%90\%

Try a similar one

A fresh question of the same kind, checked as you answer, with hints and a full solution.

Method

  1. Agreement measures reliability; confirmation by an independent follow-up measures validity.

  2. Look for a reason errors could be shared.

Watch out for

  • Concluding the diagnoses were valid because the psychiatrists agreed.

  • Dividing 13 by 18 when the question asks for a percentage of all 20 people.

Save your progress with a free account