Lesson 6 of 8 · 14 min
Extinction, recovery, generalisation and discrimination in operant conditioning
Describe extinction and spontaneous recovery when reinforcement stops, and stimulus generalisation and discrimination when a behaviour is reinforced in one situation, and compare them with classical conditioning.
What you will be able to do
- Describe extinction and spontaneous recovery in operant conditioning.
- Describe stimulus generalisation and discrimination in operant conditioning.
- Compare these processes in operant and classical conditioning.
- Interpret rate-of-response data across reinforcement, extinction and recovery.
The four processes you met in classical conditioning have operant versions with the same names. What changes is the cause. In classical conditioning everything hangs on whether the CS still predicts the UCS. In operant conditioning it hangs on whether the behaviour still produces its consequence, and on the situation in which it does.
Definition
Extinction and spontaneous recovery (operant)
Extinction is the gradual weakening and eventual disappearance of a learnt behaviour when it is no longer reinforced.
Spontaneous recovery is the reappearance of the extinguished behaviour after a rest period, back in the same situation, without any new reinforcement. It is usually weaker and extinguishes again if reinforcement does not return.
Presses per minute in a Skinner box (model data). B: baseline. F1, F10: minutes 1 and 10 with food after each press. E1, E5, E10: minutes 1, 5 and 10 with no food. R1, R5: minutes 1 and 5 after a day's rest, still with no food.
The shape matches the classical curve with one addition. When reinforcement first stops, responding often rises briefly (an "extinction burst": the rat presses harder and faster, as you jab a lift button that isn't working) before it declines. After a rest, the behaviour reappears (spontaneous recovery), weaker than at its peak.
In everyday life: a child who always got a biscuit by asking at the supermarket keeps asking, and asks louder, when the parent stops buying; if the parent holds firm, the asking dies out. Weeks later, in the same aisle, the child asks again: spontaneous recovery.
Using the column graph, by what percentage did the rate of pressing fall from the last minute with food (F10) to the tenth minute without food (E10)? Give your answer to the nearest whole number.
Definition
Generalisation and discrimination (operant)
Stimulus generalisation in operant conditioning is performing a reinforced behaviour in situations, or to stimuli, similar to those in which it was reinforced.
Stimulus discrimination is performing the behaviour only in the situation, or to the stimulus, in which it has been reinforced, and not in similar ones where it has not. The stimulus that signals "reinforcement is available now" is called a discriminative stimulus.
Skinner studied discrimination by adding a light to the box. If presses earn food only while the light is on, the rat soon presses mostly when the light is on and hardly at all when it is off: the light has become a signal that pressing pays. Before that training, a rat reinforced with the light on would also press under a dimmer or differently coloured light (generalisation).
You discriminate all the time: you put your hand up in class but not at the dinner table, because only one setting reinforces it. A child who calls every adult man "Dad", because saying "Dad" was praised, is generalising; when only saying it to their own father earns delight, they learn to discriminate.
Food follows presses only while the light is on. Watch where the presses go. Then take the food away.
| Process | Classical conditioning | Operant conditioning |
|---|---|---|
| Extinction | The CS is presented repeatedly without the UCS; the CR fades. | The behaviour is no longer reinforced; it fades. |
| Spontaneous recovery | After a rest, the CS produces the CR again, weaker. | After a rest, the behaviour reappears in the same situation, weaker. |
| Generalisation | The CR is produced to stimuli similar to the CS. | The behaviour is performed in situations similar to where it was reinforced. |
| Discrimination | The CR is produced to the CS only, because only it is followed by the UCS. | The behaviour is performed only where (or when) it is reinforced. |
Worked example
Operant extinction, recovery and discrimination at home
Ruby, aged 4, gets out of bed and comes to the lounge room most nights, and her parents let her watch TV with them. They decide to stop: each time she comes out, they walk her straight back to bed without talking. For the first few nights she comes out even more often, then less and less, and after two weeks she stays in bed. During a week at her grandparents' house she does not come out at all. Back home a month later, she comes out once.
Explain each change in Ruby's behaviour using operant conditioning.
Step 1: What maintained the behaviour
Getting out of bed was followed by TV and company (added): positive reinforcement, so it happened most nights.
Step 2: The first few nights
When the reinforcement stopped, she came out more at first: an extinction burst, common at the start of extinction.
Step 3: The next two weeks
Getting out of bed no longer produced TV or attention, so it gradually stopped: extinction.
Step 4: At her grandparents' house
The behaviour had been reinforced only at home; it did not occur at her grandparents': it is under the control of the home setting (discrimination).
Behaviour that was reinforced in one setting is performed in that setting; the cues of the home (the lounge room, her parents watching TV) signal that reinforcement was available there.
Step 5: A month later
After a break, she came out once with no new reinforcement: spontaneous recovery. If her parents again walk her back, it should extinguish quickly.
Try it yourself first, then check the working one step at a time.
Answer
Positive reinforcement (TV and company) maintained it; when reinforcement stopped there was a brief burst, then extinction; not doing it elsewhere is discrimination (it was only reinforced at home); coming out once a month later is spontaneous recovery.
Name the process in each scenario.
A cat used to run to the kitchen at the sound of the can opener because it was always fed afterwards. Its owners now use the can opener for their own food and feed the cat later. Running to the kitchen at the sound gradually stops. Which statement is correct?
Common mistake
Extinction is not negative punishment
In negative punishment, something the learner already has is taken away after the behaviour (a phone, playtime). In extinction, the reinforcer the behaviour used to produce stops arriving: nothing is removed. Both reduce behaviour, but they are different processes.
Summary
Operant extinction: a behaviour that is no longer reinforced fades, often after a brief burst.
Operant spontaneous recovery: after a rest, the extinguished behaviour reappears in the same situation, usually weaker.
Operant generalisation: the reinforced behaviour is performed in similar situations; discrimination: only where it is reinforced.
A discriminative stimulus (such as Skinner's light) signals when a behaviour will be reinforced.
The processes share names with classical conditioning, but depend on reinforcement rather than on the CS predicting the UCS.
Finished the lesson?
Try the 3 quick checks above and the lesson completes itself, or mark it complete now.