Lesson 4 of 8 · 16 min

Operant conditioning and the Skinner box

Describe how behaviour is learnt from its consequences, how the Skinner box controls and records it, and how Skinner built operant conditioning in response to Pavlov's work.

What you will be able to do

  • Describe operant conditioning as learning from the consequences of a voluntary behaviour.
  • Describe the operation of the Skinner box and read a cumulative record.
  • Define reinforcement and punishment, positive and negative.
  • Explain how Skinner's work developed in response to Pavlov's.

Classical conditioning explains why a dog drools at a sound, but not why it learns to scratch at the back door to be let out, or why you check your phone every few minutes. Those are things the learner does, not reflexes that happen to it. They are shaped by what follows them. Learning of this kind is operant conditioning: the learner "operates" on the environment, and the consequence changes how likely the behaviour is to happen again.

Definition

Operant conditioning

Operant conditioning is learning in which the likelihood of a voluntary behaviour increases or decreases because of the consequence that follows it.

History

From Thorndike's cats to Skinner's box

In the 1890s Edward Thorndike put hungry cats in "puzzle boxes" with food outside. A cat that happened to pull the right loop escaped and ate; over many trials it escaped faster and faster. Thorndike's law of effect (1898) said that behaviour followed by a satisfying result is "stamped in", and behaviour followed by discomfort is "stamped out".

B. F. Skinner built on this in the 1930s, and on Pavlov. He agreed with Pavlov that learning should be studied in controlled experiments on observable behaviour, but saw that Pavlov's account covered only respondent behaviour, reflexes elicited by a stimulus. Most behaviour is operant: emitted by the learner and controlled by its consequences. Skinner set out the theory in The Behavior of Organisms (1938) and kept testing it in experiments such as "'Superstition' in the pigeon" (1948).

The Skinner box. To study operant behaviour as precisely as Pavlov studied salivation, Skinner designed an operant chamber, now called a Skinner box. A hungry rat (or a pigeon) is placed in a small box that contains:

  • a lever to press (for pigeons, a key to peck): the response being learnt
  • a food dispenser that drops a pellet into a tray: a reinforcer
  • a light and a speaker: signals the experimenter can switch on and off
  • in some studies, a floor grid that can give a mild electric shock: an aversive stimulus to add or remove
  • a cumulative recorder outside the box, which marks every response automatically

The experimenter decides in advance exactly what follows a press, and the box applies it the same way every time and records every response. That control is what made it a powerful research tool: the consequence is the independent variable, the rate of responding the dependent variable.

A cumulative record (model data). None: baseline, no consequence. Food: a pellet after each press. No food: the dispenser switched off. The slope is the rate of pressing: steep while each press is reinforced, flat once the presses stop.

Using the cumulative record, what was the rat's mean rate of pressing, in presses per minute, while each press was followed by food (from 5 to 20 minutes)?

in presses per minute

Reinforcement and punishment. Skinner sorted consequences by what they do to behaviour. A reinforcer is any consequence that makes the behaviour more likely; a punisher is any consequence that makes it less likely. Each can work by adding something (positive) or removing something (negative). That gives four kinds of consequence.

The four consequences, in the Skinner box
Effect on behaviourSomething is added (positive)Something is removed (negative)
Behaviour becomes more likely (reinforcement)Positive reinforcement: a food pellet drops after each press.Negative reinforcement: a press switches off a mild shock or a loud noise.
Behaviour becomes less likely (punishment)Positive punishment: a press brings a mild shock.Negative punishment: a press takes away access to food for a minute.

Key idea

Positive and negative are not good and bad

Positive means a stimulus is added. Negative means a stimulus is taken away. Reinforcement always makes behaviour more likely, and punishment always makes it less likely, whether positive or negative.

Interactive

The Skinner box

Pick what follows a lever press, name it, and watch the cumulative record. Pressing rates come from a simple model, so the shapes are right and the numbers illustrative.

In a Skinner box study, a rat's lever presses switch off a loud tone. The rate of pressing rises. Which statement is correct?

Choose one answer

Skinner's superstitious pigeons (1948). Skinner placed eight hungry pigeons, one at a time, in a box where the food hopper opened every 15 seconds whatever the bird did. Six of the eight developed a clear, repeated ritual: one turned in circles, one thrust its head into an upper corner, two swung their heads like a pendulum. Whatever a bird happened to be doing when food arrived was reinforced, so it did it more, which made it more likely to be doing it the next time food came.

Skinner called this superstition: behaviour strengthened by a reinforcer that only happened to follow it. He compared it to a bowler's twist of the shoulders after releasing the ball. The study shows the power of a consequence's timing: reinforcement strengthens whatever comes just before it, whether or not the behaviour caused it.

Why did Skinner's (1948) pigeons develop "superstitious" behaviours?

Choose one answer

Worked example

Design a Skinner box experiment

  • Complex familiar

A researcher wants to test whether removing a loud noise when a rat presses a lever changes its rate of pressing. Describe how a Skinner box could be used, naming the IV, the DV and two controlled variables, and predict the result.

5 steps

Try it yourself first, then check the working one step at a time.

Exam tip

Describing the operation of the Skinner box

A full description names the parts and what each does: the animal (deprived of food, so food works as a reinforcer), the response (pressing a lever), the consequence the experimenter controls (food pellet, shock, light), and how responses are recorded (automatically, as a cumulative record, so the rate of responding can be measured). Then say what the box was used to show: how each kind of consequence changes the rate of responding.

Summary

  • Operant conditioning: a voluntary behaviour becomes more or less likely because of its consequence. The learner is active.

  • Skinner built on Thorndike's law of effect and Pavlov's experimental method, but explained emitted (operant) behaviour rather than reflexes elicited by a stimulus.

  • The Skinner box controls exactly what follows a response (food, shock, light) and records every response automatically as a cumulative record.

  • Reinforcement makes behaviour more likely and punishment less likely; positive adds a stimulus and negative removes one.

  • Skinner (1948): pigeons fed every 15 seconds regardless of behaviour developed rituals, because reinforcement strengthens whatever it follows.

Finished the lesson?

Try the 3 quick checks above and the lesson completes itself, or mark it complete now.

Lesson 4 of 80% read

Save your progress with a free account