Lesson 6 of 8 · 14 min

Extinction, recovery, generalisation and discrimination in operant conditioning

Describe extinction and spontaneous recovery when reinforcement stops, and stimulus generalisation and discrimination when a behaviour is reinforced in one situation, and compare them with classical conditioning.

What you will be able to do

  • Describe extinction and spontaneous recovery in operant conditioning.
  • Describe stimulus generalisation and discrimination in operant conditioning.
  • Compare these processes in operant and classical conditioning.
  • Interpret rate-of-response data across reinforcement, extinction and recovery.

The four processes you met in classical conditioning have operant versions with the same names. What changes is the cause. In classical conditioning everything hangs on whether the CS still predicts the UCS. In operant conditioning it hangs on whether the behaviour still produces its consequence, and on the situation in which it does.

Definition

Extinction and spontaneous recovery (operant)

Extinction is the gradual weakening and eventual disappearance of a learnt behaviour when it is no longer reinforced.

Spontaneous recovery is the reappearance of the extinguished behaviour after a rest period, back in the same situation, without any new reinforcement. It is usually weaker and extinguishes again if reinforcement does not return.

Presses per minute in a Skinner box (model data). B: baseline. F1, F10: minutes 1 and 10 with food after each press. E1, E5, E10: minutes 1, 5 and 10 with no food. R1, R5: minutes 1 and 5 after a day's rest, still with no food.

The shape matches the classical curve with one addition. When reinforcement first stops, responding often rises briefly (an "extinction burst": the rat presses harder and faster, as you jab a lift button that isn't working) before it declines. After a rest, the behaviour reappears (spontaneous recovery), weaker than at its peak.

In everyday life: a child who always got a biscuit by asking at the supermarket keeps asking, and asks louder, when the parent stops buying; if the parent holds firm, the asking dies out. Weeks later, in the same aisle, the child asks again: spontaneous recovery.

Using the column graph, by what percentage did the rate of pressing fall from the last minute with food (F10) to the tenth minute without food (E10)? Give your answer to the nearest whole number.

in %

Round to the nearest whole number.

Definition

Generalisation and discrimination (operant)

Stimulus generalisation in operant conditioning is performing a reinforced behaviour in situations, or to stimuli, similar to those in which it was reinforced.

Stimulus discrimination is performing the behaviour only in the situation, or to the stimulus, in which it has been reinforced, and not in similar ones where it has not. The stimulus that signals "reinforcement is available now" is called a discriminative stimulus.

Skinner studied discrimination by adding a light to the box. If presses earn food only while the light is on, the rat soon presses mostly when the light is on and hardly at all when it is off: the light has become a signal that pressing pays. Before that training, a rat reinforced with the light on would also press under a dimmer or differently coloured light (generalisation).

You discriminate all the time: you put your hand up in class but not at the dinner table, because only one setting reinforces it. A child who calls every adult man "Dad", because saying "Dad" was praised, is generalising; when only saying it to their own father earns delight, they learn to discriminate.

Interactive

Discrimination with a light

Food follows presses only while the light is on. Watch where the presses go. Then take the food away.

The same four processes in the two kinds of conditioning
ProcessClassical conditioningOperant conditioning
ExtinctionThe CS is presented repeatedly without the UCS; the CR fades.The behaviour is no longer reinforced; it fades.
Spontaneous recoveryAfter a rest, the CS produces the CR again, weaker.After a rest, the behaviour reappears in the same situation, weaker.
GeneralisationThe CR is produced to stimuli similar to the CS.The behaviour is performed in situations similar to where it was reinforced.
DiscriminationThe CR is produced to the CS only, because only it is followed by the UCS.The behaviour is performed only where (or when) it is reinforced.

Worked example

Operant extinction, recovery and discrimination at home

  • Complex familiar

Ruby, aged 4, gets out of bed and comes to the lounge room most nights, and her parents let her watch TV with them. They decide to stop: each time she comes out, they walk her straight back to bed without talking. For the first few nights she comes out even more often, then less and less, and after two weeks she stays in bed. During a week at her grandparents' house she does not come out at all. Back home a month later, she comes out once.

Explain each change in Ruby's behaviour using operant conditioning.

5 steps

Try it yourself first, then check the working one step at a time.

Name the process in each scenario.

A cat used to run to the kitchen at the sound of the can opener because it was always fed afterwards. Its owners now use the can opener for their own food and feed the cat later. Running to the kitchen at the sound gradually stops. Which statement is correct?

Choose one answer

Common mistake

Extinction is not negative punishment

In negative punishment, something the learner already has is taken away after the behaviour (a phone, playtime). In extinction, the reinforcer the behaviour used to produce stops arriving: nothing is removed. Both reduce behaviour, but they are different processes.

Summary

  • Operant extinction: a behaviour that is no longer reinforced fades, often after a brief burst.

  • Operant spontaneous recovery: after a rest, the extinguished behaviour reappears in the same situation, usually weaker.

  • Operant generalisation: the reinforced behaviour is performed in similar situations; discrimination: only where it is reinforced.

  • A discriminative stimulus (such as Skinner's light) signals when a behaviour will be reinforced.

  • The processes share names with classical conditioning, but depend on reinforcement rather than on the CS predicting the UCS.

Finished the lesson?

Try the 3 quick checks above and the lesson completes itself, or mark it complete now.

Lesson 6 of 80% read

Save your progress with a free account