Classical Conditioning in Learning
Classical Conditioning in Learning
How Do We Learn?
LEARNING OBJECTIVE QUESTION (LOQ 21-1 How do we define learning, and
what are some basic forms of learning?
By learning, we humans adapt to our environments. W e learn to expect and prepare
for significant events such as the arrival of food or pain (classical conditioning). W
e learn
to repeat acts that bring rewards and avoid acts that bring unwanted results (operant
conditioning). We learn new behaviors by observing events and people, and through
language, we learn things we have neither experienced nor observed (cognitive learning).
But how do we learn?
One way we learn is by association. Our mind naturally connects events that occur in
sequence. Learned associations feed our habitual behaviors (Urcelay & Jonkman, 2019;
Wood, 2017). Habits can form when we repeat behaviors in a given context-sleeping
ni a certain position in bed, biting our nails when taking an exam, or switching off the
lights when leaving a room. As behavior becomes linked with the context, our next expe-
rience of that context will evoke our habitual response. That's true of both good habits
(eating fruit) and bad (overindulging ni alcohol) (Graybiel &Smith, 2014). T o increase
your self-control, and to achieve your academic goals, the key is to form helpful habits
(Fiorella, 2020).
How long does it take to form a beneficial habit? To find out, one British research
team asked 96 university students to choose a healthy behavior (such as running before
dinner or eating fruit with lunch), to do it daily for 84 days, and to record whether the
behavior felt automatic (something they did without thinking and would find ti hard
not to do). On average, behaviors became habitual after about 66 days (Lally et al., 2010)
Is there something you'd like to make a routine or essential part of your life? Just do it
every day for two months, or a bit longer for exercise, and you likely will find yourself
→ learning the process of acquiring through with a new habit. This happened for two of your authors—with a midday workout [DM
experience new and relatively enduring and a late afternoon guitar practice session [ND] having long ago become an automatic
information or behaviors. daily routine.
MODULE 21 BASIC LEARNING CONCEPTS AND CLASSICAL CONDITIONING 261
+ , BOOM! wincing
Other animals also learn by association. Disturbed by a squirt of water, the sea slug associative learning learning that certain
Aplysia protectively withdraws its gill. If the squirts continue, as happens naturally events occur together. The events may be
ni choppy water, the withdrawal response diminishes. But fi the sea slug repeatedly two stimuli (as in classical conditioning) or a
receives an electric shock just after being squirted, its protective response ot the squirt response and its consequence (as in operant
instead grows stronger. The animal has associated the squirt with the impending shock. conditioning).
Complex animals can learn to associate their own behavior with its outcomes. An stimulus any event or situation that evokes
aquarium seal will repeat behaviors, such as slapping and barking, that prompt people a response.
to toss ti a herring. After five speech-imitating African gray parrots were adopted and respondent behavior behavior that occurs
housed together at England's Lincolnshire Wildlife Park, they started using obscenities, as an automatic response to some stimulus.
which put the park staff into hysterics. The birds' "fowl" language prompted moving
them from public display. "The more they swear, the more you usually laugh, which then operant behavior behavior that operates on
t h e environment, producing a c o n s e q u e n c e
triggers them ot swear again," explained the park manager (Franklin &Merrifield, 2020).
By linking two events that occur close together, sea slugs, seals, and parrots are exhib-
iting associative learning. The sea slug associates the squirt with an impending shock;
the seal associates slapping and barking with a herring treat; and the parrot associates
uttering an obscenity with a positive reaction from humans. Each animal has learned
something important to its survival: anticipating the immediate future.
This process of learning associations is conditioning. It takes two main forms: Most of us could not list ni order the songs
• In classical conditioning (FIGURE 21.1), we learn to associate two stimuli and thus to on our favorite album or playlist. Yet hearing
the end of one piece cues (by association)
anticipate events. A( stimulus si any event or situation that evokes a response.) We an anticipation of the next. Likewise, when
learn that a flash of lightning signals an impending crack of thunder; when lightning singing your national anthem, you associate
flashes nearby, we start to brace ourselves. We associate stimuli that we do not the end of each line with the beginning of the
control, and we respond automatically (exhibiting respondent behavior). next. (Pick a line out of the middle and notice
• nI operant conditioning, we learn to associate a response (our behavior) and its how much harder it is to recall the previous line.)
consequence. Thus, we (and other animals) learn ot repeat acts followed by good
results (FIGURE 21.2) and avoid acts followed by bad results. These associations produce
operant behaviors (which operate on the environment to produce consequences). I FIGURE 21.2
Operant conditioning
To simplify, we will explore these two types of
associative learning separately. Often, though, they
occur together, as on one Japanese cattle ranch, where
the clever rancher outfitted his herd with electronic
pagers, which he called from his cell phone. After a
week of training, the animals learned to associate two
stimuli-the beep of their pager and the arrival of food
(classical conditioning). But they also learned to associ-
ate their hustling to the food trough with the pleasure
of eating (operant conditioning), which simplified the
rancher's work. Classical conditioning + operant condi-
tioning did the trick. (a) Behavior: Being polite (b) Consequence: Getting a treat (c) Behavior strengthened
262 CHAPTER 7 LEARNING (MODULES 21-23)
→ cognitive learning hte acquisition fo mental Conditioning is not the only form of learning. Through cognitive learning, we acquire
information, whether by observing events, by mental information that guides our behavior. Observational learning, one form of cogni-
watching others, or through language. tive learning, lets us learn from others' experiences. Chimpanzees, for example, some-
classical conditioning a type of learning ni times learn behaviors merely by watching other chimpanzees perform them. fI one
which we link two or more stimuli; as a result, animal sees another solve a puzzle and gain a food reward, the observer may perform
to illustrate with Pavlov's classic experiment, the trick more quickly. So, too, in humans: We look and we learn.
the first stimulus (a tone) comes to elicit
behavior (drooling) in anticipation of the
RETRIEVAL PRACTICE
second stimulus (food).
behaviorism the view that psychology RP-1 Why are habits, such as having something sweet with that cup of coffee, so hard to break?
(1) should be an objective science that I APPENDIX E
ANSWERS N
(2) studies behavior without reference to
mental processes. Most research psychologists
today agree with (1) but not with (2).
Classical Conditioning
LOQ 21-2 What is behaviorism's view of learning?
For many people, the name Ivan Pavlov (1849-1936) rings a bell. The Russian physiologist's
early twentieth-century experiments— now psychology's most famous research-are
classics, and the phenomenon he explored we justly call classical conditioning
Pavlov's work laid the foundation for many of psychologist John B. Watson's ideas. nI
searching for laws underlying learning, Watson (1913) urged his colleagues to discard
reference to inner thoughts, feelings, and motives. The science of psychology should
instead study how organisms respond to stimuli in their environments, said Watson: "Its
theoretical goal is the prediction and control of behavior. Introspection forms no essen-
tial part of its methods." Simply said, psychology should be an objective science—based
on observable behavior.
This view, which Watson called behaviorism, influenced North American psychol-
ogy, especially during the first half of the twentieth century. Pavlov and Watson came to
Ivan Pavlov "Experimental investigation. share both a disdain for "mentalistic" concepts (such as consciousness) and abelief that
should lay a solid foundation for a future true
the basic laws of learning were the same for all animals —whether sea slugs or dogs or
science of psychology" (1927). humans. Few researchers today agree that psychology should ignore mental processes.
but most do agree that classical conditioning is a basic form of learning by which all
organisms adapt to their environments.
Pavlov's Experiments
LOO 21-3 Who was Pavlov, and what are the basic components of classical
conditioning?
Pavlov was driven by a lifelong passion for research. After setting aside his initial plan to
follow his father into the Russian Orthodox priesthood, Pavlov earned a medical degree
at age 3 and spent the next two decades studying dogs' digestive system. This work
earned him, in 1904, Russia's first Nobel Prize. But Pavlov's novel experiments on learn-
ing, which consumed the last three decades of his life, earned this feisty, intense scien-
tist his place in history (Todes, 2014).
Pavlov's new direction came when his creative mind seized on an incidental observation.
John B . Watson Watson (1924) admitted
Without fail, putting food ni a dog's mouth caused the animal to salivate. Moreover, the dog
began salivating not only to the taste of the food, but also to the mere sight of the food, or the
to "going beyond my facts" when offering
his famous boast: "Give me a dozen healthy
food dish, or the person delivering the food, or even the sound of that person's approach-
infants, well-formed, and my own specified
ing footsteps. At first, Pavlov considered these "psychic secretions" an annoyance—
world to bring them up ni and I'l guarantee until he realized they pointed to asimple but fundamental form of learning.
to take any one at random and train him Pavlov and his team of researchers —over half of whom were women (Hill
to become any type of specialist I might 2019) - tried to imagine what the dog was thinking and feeling as it drooled in antic-
select - - doctor, lawyer, artist, merchant- ipation of the food. This only led them into fruitless debates. So, to explore the phe-
chief, and, yes; even beggar-man and nomenon more objectively, they experimented. To eliminate other possible influences,
thief, regardless of his talents, penchants, they isolated the dog in a small room, secured it in a harness, and attached a device to
tendencies, abilities, vocations, and race of divert its saliva to a measuring instrument (FIGURE 21.3). From the next room, they pre-
his ancestors." sented food —first by sliding in a food bowl, later by blowing meat powder into the dog's
MODULE 21 BASIC LEARNING CONCEPTS AND CLASSICAL CONDITIONING 263
* FIGURE 21.3
Pavlov's device for recording neutral stimulus (NS) in classical
salivation Atube ni the dog's
conditioning, a stimulus that elicits no
cheek collects saliva, which si
response before conditioning.
measured ni a cylinder outside
the chamber. unconditioned response (UR) in classical
conditioning, an unlearned, naturally
occurring response (such as salivation) to an
unconditioned stimulus (US) (such as food in
the mouth).
unconditioned stimulus (US) ni
classical conditioning, a stimulus
that unconditionally— naturally and
automatically - triggers an unconditioned
response (UR).
conditioned response (CR) ni classical
mouth at a precise moment. They then paired various neutral stimuli (NS) —events the conditioning, a learned response to a
dog could see or hear but didn't associate with food —with food ni the dog's mouth. If a previously neutral (but now conditioned)
sight or sound regularly signaled the arrival of food, would the dog learn the link? If so, stimulus (CS).
would it begin salivating in anticipation of the food? conditioned stimulus (CS) in classical
The answers proved to be Yes and Yes. Just before placing food ni the dog's mouth conditioning, an originally neutral stimulus
to produce salivation, Pavlov sounded a tone. After several pairings of tone and food, that, after association with an unconditioned
the dog, now anticipating the meat powder, began salivating to the tone alone. In later stimulus (US), comes to trigger a conditioned
response (CR).
experiments, a buzzer,' a light, a touch on the leg, even the sight of a circle set off the
drooling. (This procedure works with people, too. When hungry young Londoners viewed
abstract figures before smelling peanut butter or vanilla, their brain soon responded in
anticipation to the abstract images alone [Gottfried et al., 2006].)
Adog does not learn ot salivate ni response ot food ni its mouth. Rather, food ni the
mouth automatically, unconditionally, triggers a dog's salivary reflex (FIGURE 21.4). Thus,
Pavlov called this drooling an unconditioned response (UR). And he called the food an
unconditioned stimulus (US).
Salivation in response to a tone, however, is learned. It is conditional upon the dog's
V FIGURE 21.4
Pavlov's classic experiment Pavlov
associating the tone with the food. Thus, we call this response the conditioned response presented a neutral stimulus a( tone) tusj
(CR). The stimulus that used to be neutral (in this case, a previously meaningless tone before na unconditioned m
usiults dof(in
that now triggers salivation) is the conditioned stimulus (CS). Distinguishing these two mouth). The neutral m
sit uuls then became
kinds of stimuli and responses is easy: conditioned =learned; unconditioned =unlearned. a conditioned stimulus, producing a
conditioned response.
Us (food
in m o u t n i
NS
SUR (tone)
(salivation) salivation
An unconditioned stimulus (US) produces an unconditioned response (UR). Aneutral stimulus (NS) produces no salivation response.
D U R I N G C O N D I T I O N I N G
AFTER CONDITIONING
NS US (food
(tone) ni mouth)
CS
(tone) .
Coo
(salivation) (salivation)
The U
S is repeatedly presented just after the NS. I n e p r e v i o u s v n e u r a s u m u l u s a l o n e n o w p r o c u c e s a c o n c i u o n e d r e s p o n s e
i n e 0 3 C o n t t lu e s t o D O u u ce d u K. K , Thereoy d e c o m i n g a c o n c i i o n e d s t m u l u s o .
T'he "buzzer" (English translation) was perhaps the bel people commonly associate with Pavlov (Tuly, 2003). Pavlov used
various stimuli, but some have questioned whether he used a bell.
264 CHAPTER 7 LEARNING (MODULES 21-23)
THE EARS HEAR THE RIGHT AWAY THE HOW DO THE EARS IVE NEVER BEEN
CAN OPENER.. STOMACH KNOWS THAT TELL THE STOMACH? ABLE TO FIGURE
SUPPER S
I COMING. THAT OUT
RETRIEVAL P R A C T I C E
RP-2 An experimenter sounds a tone just before delivering an air puff that causes your eye ot
blink. After several repetitions, you blink to the tone alone. What si the NS? The US? The
UR? The CS? The CR?
I APPENDIX E
ANSWERS N
ACQUISITION
LoQ 21-4 nI classical conditioning, what are the processes of acquisition, extinction,
spontaneous recovery, generalization, and discrimination?
T
o understand the acquisition, or initial learning, of the stimulus-response relationship,
Pavlov and his associates wondered: How much time should elapse between present-
ing the NS (the tone, the light, and the touch) and the US (the food)? In most cases, not
much —hafl a second usually works well.
What do you suppose would happen fi the food (US) appeared before the tone (NS)
rather than after? Would conditioning occur? Not likely. Conditioning usually won't occur
when the NS follows the US. Remember: Classical conditioning si biologically adaptive because
ti helps humans and other animals prepare for good or bad events. To Pavlov's dogs, the originally
neutral tone became a CS after signaling an important biological event— the arrival of food
(US). oT deer ni the forest, a snapping twig (CS) may signal a predator's approach (US).
Research on male Japanese quail shows how a CS can signal another important bio-
logical event (Domjan, 1992, 1994, 2005). Just before presenting a sexually approachable
female quail, the researchers turned on a red light. Over time, as the red light continued
acquisition ni classical conditioning, the to herald the female's arrival, the light alone caused the male quail to become excited
initial stage —when one links a neutral They developed a preference for their cage's red-light district, and when a female
stimulus and an unconditioned stimulus so appeared, they mated with her more quickly and released more semen and sperm
that the neutral stimulus begins triggering (Matthews et al., 2007). This capacity for classical conditioning supports reproduction.
the conditioned response. (In operant In humans, too, objects, smells, sounds, and sights associated with sexual
conditioning, the strengthening of a pleasure-even a geometric figure, in one experiment-can become conditioned stim-
reinforced response.)
uli for sexual arousal (Byrne, 1982; Hoffman, 2012, 2017). Onion breath, for example, si
higher-order conditioning a procedure an NS-it does not typically produce sexual arousal. But when repeatedly paired with a
in which the conditioned stimulus in one passionate kiss, it can become a CS and do just that (FIGURE 21.5).
conditioning experience is paired with a
new neutral stimulus, creating a second
The larger lesson: Conditioning helps an animal survive and reproduce— by responding ot
(often weaker) conditioned stimulus. For cues that help ti gain food, avoid dangers, locate mates, and produce offspring (Hollis, 1997).
example, an animal that has learned that a Learning makes for yearning.
tone predicts food might then learn that a Through higher-order conditioning, a new NS can become a new CS without the pres-
light predicts the tone and begin responding ence of a US. Al that's required is for it to become associated with a previously condi-
to the light alone. (Also called second-order tioned stimulus. fI a tone regularly signals food and produces salivation, then a light
conditioning.) that becomes associated with the tone (light →tone →food) may also begin ot trigger
MODULE 21 BASIC LEARNING CONCEPTS AND CLASSICAL CONDITIONING 265
G FIGURE 2 1.5
US UR An unexpected CS Psychologist Michael
(sexual
(passionate
K i s s I arousal) Tirel (1990) recalled: M
y" firstgirlfriend loved
onions, so l came to associate noino breath
whti kissing. Before long, onion breath sent
tingles up and down m y spine. Oh wtah a
NS feeling!"
⼗
US UR
(onion (passionate (sexual
breath) kiss) arousal)
lonion (sexual
Dreatn arousal)
Strong
A c o u i s i t i o n .
Spontaneous
(NS +US) Extinction recovery of C
R
(CS alone)
Strength @ FIGURE 21.6
of CR Extinction Idealized curve of acquisition, extinction,
(CS alone)
and spontaneous recovery ehT rising
curve shows the C R rapidly growing stronger
sa the NS becomes a SC eud to repeated
pairing with the U RC then
S (acquisition). ehT
Weak weakens rapidly as het SCis presented onela
Pause
(extinction). After a pause, the (weakened) CR
Time reappears (spontaneous recovery).
CHAPTER 7 LEARNING (MODULES 21-23)
Pavlov's Legacy
LOQ 21-5 Why does Pavlov's work remain so important?
What remains today of Pavlov's ideas? Agreat deal. Most psychologists now agree that
classical conditioning is a basic form of learning. Modern neuroscience has also sup-
ported Pavlov's ideas — yb identifying neural circuits that link a conditioned stimulus
(warning signal) with an impending unconditioned stimulus (threat) (Harnett et al., 2016;
Yau &McNally, 2018). Other researchers have applied Pavlov's ideas to shopping. Condi-
tioning neutral brand logos with positive or negative images can cause people to like or
loathe those brands (Alves et al., 2020). Judged with today's knowledge of the interplay
of our biology, psychology, and social-cultural environment, some of Pavlov's ideas were
incomplete. But if we see further than Pavlov did, it is because we stand on his shoulders.
Why does Pavlov's work remain so important? fI he had merely taught us that old
dogs can learn new tricks, his experiments would long ago have been forgotten. Why
should we care that dogs can be conditioned to salivate to the sound of a tone? The
importance lies first ni the finding that many other responses ot many other stimuli can be
classically conditioned ni many other organisms— in fact, in every species tested, from micro-
scopic creatures to earthworms ot fish to dogs to monkeys to people (Schwartz, 1984;
. Zhou et al., 2019). Thus, classical conditioning is one way that virtually all organisms
S
learn to adapt to their environment.
Second, Paulov showed us how a process such as learning can be studied objectively. He
was proud that his methods involved virtually no subjective judgments or guesses about
what went on in a dog's mind. The salivary response is a behavior measurable ni cubic
centimeters of saliva. Pavlov's success suggested a scientific model for how the young
discipline of psychology might proceed —by isolating the basic building blocks of com-
plex behaviors and studying them with objective laboratory procedures.
RETRIEVAL P R A C T I C E
RP-6 Companies often pay to make their products visible ni popular movies and television
shows - such as when beloved characters drive particular car brands. (Have you
noticed that the Avengers all drive Audis?) Based on classical conditioning principles,
what might be an effect of this pairing?
ANSWERS N I APPENDIXE
RETRIEVAL PRACTICE
RP-7 nI Watson and Rayner's experiments, "Litle Albert" learned to fear a white rat after
repeatedly experiencing a loud noise as the rat was presented. nI these experiments,
what was the US? The UR? The NS? The CS? The CR?
I APPENDIX E
ANSWERS N
MODULE 22 OPERANT CONDITIONING 269
LOQ 21-1 How do we define learning, and what are some basic
forms of learning?
Test ue answesr here,ehcholk your austisni Appendinwfirs,t hetn
1. Learning si defined as "hte process of acquiring through
LOQ 21-2 What si behaviorism's view of learning?
experience w
en dna relatively enduring
LOQ 21-3 Who was Pavlov, and what are the basic components
2. Two forms of associative learning are classical conditioning, n
i
of classical conditioning?
which the organism associates
LOQ 21-4 nI classical conditioning, what are the processes and operant conditioning, ni which the organism associates
of acquisition, extinction, spontaneous recovery,
generalization, and discrimination? a. two or more responses; a response and its consequence
b. two or more stimuli; two or more responses
LOQ 21-5 Why does Pavlov's work remain so important? c. two or more stimuli; a response and its consequence
LOQ 21-6 What have been some applications of Pavlov's work ot d. two or more responses; two or more stimuli
human health and well-being? How did Watson apply 3. nI Pavlov's experiments, the tone started as a neutral stimulus,
Pavlov's principles to learned fears? and then became a(n) - stimulus.