Module 4

OPERANT CONDITIONING
Operant conditioning, sometimes referred to as instrumental conditioning, is a learning
method that employs rewards and punishments for behavior. Through operant conditioning,
an association is made between a behavior and a consequence (whether negative or positive)
for that behavior. For example, when lab rats press a lever when a green light is on, they
receive a food pellet as a reward. When they press the lever when a red light is on, they
receive a mild electric shock. As a result, they learn to press the lever when the green light is
on and avoid the red light.
PRINCIPLES OF OPERANT CONDITIONING

1. Reinforcement:

A process that strengthens or maintains a behavior by introducing a favorable consequence or

removing an unfavorable one.

 Positive reinforcement

Positive reinforcers are favorable events or outcomes that are presented after the
behavior. I n positive reinforcement situations, a response or behavior is strengthened
by the addition of praise or a direct reward. If you do a good job at work and your
manager gives you a bonus, that bonus is a positive reinforcer.

 Negative reinforcement
Negative reinforcers involve the removal of an unfavorable events or outcomes after
the display of a behavior. In these situations, a response is strengthened by the
removal of something considered unpleasant. For example, if your child starts to
scream in the middle of a restaurant, but stops once you hand them a treat, your action
led to the removal of the unpleasant condition, negatively reinforcing your behavior
(not your child's).
2. Punishment:
Punishment is the presentation of an adverse event or outcome that causes a decrease in the
behavior it follows. There are two kinds of punishment. In both of these cases, the behavior
decreases.
 Positive punishment
Positive punishment, sometimes called punishment by application, presents an
unfavorable event or outcome to weaken the response it elicits. It sounds like an
oxymoron, but in this instance, positive doesn't mean 'good.' Instead, it suggests that
something is added to the situation to act as a punisher. Spanking for misbehavior is
an example of punishment by application.
 Negative punishment
 Negative punishment, also known as punishment by removal, occurs when a
favorable event or outcome is removed after a behavior occurs. Taking away a child's
video game following misbehavior is an example of negative punishment.

3. Operant Behavior and Antecedents:

 Discriminative Stimulus (SD): Signals the availability of reinforcement (e.g., a

stoplight turning green signals safe crossing).
 Response: The observable behavior influenced by antecedents and consequences.
 Contingency Management: Direct control of antecedents and consequences to
modify behavior effectively (Cooper et al., 2019).

4. Shaping:

A method of teaching new behaviors by reinforcing successive approximations toward

the desired behavior. For instance, teaching a child to write involves reinforcing initial
scribbles, followed by improved attempts.

5. Extinction:

The process by which a previously reinforced behavior diminishes over time when
reinforcement ceases. For example, ignoring a child’s tantrum can eventually lead to its
cessation.

SCHEDULES OF REINFORCEMENT

In the context of operant conditioning, schedules of reinforcement refer to the specific

patterns and timings of reinforcement provided for a desired behavior. These schedules
significantly influence how quickly and effectively a behavior is learned and maintained.
Reinforcement schedules can be broadly categorized into two types: continuous
reinforcement and partial reinforcement. Understanding these schedules is essential for
behavior modification, as they dictate the persistence and resistance to extinction of the
behaviors they reinforce.

1. Continuous Reinforcement (CRF)

Continuous reinforcement is the simplest form of reinforcement schedule, where the target
behavior is reinforced every time it occurs. This schedule is ideal during the initial stages of
learning because it facilitates rapid acquisition of the behavior. However, behaviors
reinforced continuously are more likely to extinguish once the reinforcement ceases
(Miltenberger, 2022).

Example: A child receives praise every time they clean their room.

2. Partial Reinforcement

In contrast, partial reinforcement involves reinforcing the behavior only some of the time.
This approach leads to greater persistence of the behavior over time and is less vulnerable to
extinction than continuous reinforcement (Bouton, 2016). Partial reinforcement is divided
into four types:

a) Fixed-Ratio (FR) Schedule

In a fixed-ratio schedule, reinforcement is provided after a fixed number of responses. This

leads to high rates of responding, as the individual knows exactly how many responses are
required before reinforcement is delivered. However, this schedule can result in pauses after
reinforcement, known as post-reinforcement pauses (Martin & Pear, 2024).

Example: A salesperson earns a commission after selling five products.

b) Variable-Ratio (VR) Schedule

A variable-ratio schedule provides reinforcement after an unpredictable number of responses.

This schedule is known for producing high, steady rates of response and is highly resistant to
extinction (Cooper, Heron, & Heward, 2019).

Example: Slot machines in casinos, where the player is rewarded after a random number of
lever pulls.

c) Fixed-Interval (FI) Schedule

In a fixed-interval schedule, reinforcement is given after a fixed amount of time has passed,
provided the behavior occurs. The response pattern tends to be characterized by a "scalloped"
effect, where the behavior accelerates as the time for reinforcement nears.

Example: A student receives a test score every semester, leading to increased studying just
before exam time.

d) Variable-Interval (VI) Schedule

A variable-interval schedule provides reinforcement after an unpredictable amount of time,

maintaining a steady and consistent rate of response. This schedule tends to produce a
moderate, but stable rate of behavior (Miltenberger, 2022).

Example: Checking for new email messages at unpredictable intervals.

3. Comparison and Practical Implications

 Continuous reinforcement results in quick learning but can lead to rapid extinction if
reinforcement is discontinued.
 Partial reinforcement, particularly the variable-ratio schedule, is often more effective in
maintaining behaviors in the long term, due to its resistance to extinction (Cooper et al.,
2019).

Understanding these schedules is crucial for practitioners in fields such as behavior

modification, education, and therapy, where shaping behaviors and ensuring their persistence
is essential.
APPLICATIONS OF OPERANT CONDITIONING IN BEHAVIOUR
MODIFICATION

Operant conditioning, conceptualized by B.F. Skinner, is a fundamental theory in behavioral

psychology. It emphasizes the relationship between behaviors and their consequences,
providing robust frameworks for modifying behavior across various domains such as
education, healthcare, therapy, and organizational management. Below is a highly detailed
exploration of its applications, supported by examples and academic references.

1. Token Economies

 Concept: A token economy system utilizes tokens as conditioned reinforcers, which

individuals can exchange for desired rewards. Tokens bridge the gap between the
behavior and the ultimate reinforcement.
 Examples:
o In classrooms, students receive tokens for completing assignments, good
behavior, or attending classes, which can be exchanged for privileges such as
extra recess time or snacks.
o In psychiatric institutions, patients might earn tokens for self-care routines,
like taking medication on time or participating in group therapy.
 Advantages:
o Provides immediate reinforcement for desired behaviors.
o Easily customizable to individual needs and goals.
o Scalable across diverse environments.
 Challenges:
o Requires consistent implementation.
o Over-reliance on tangible rewards may diminish intrinsic motivation if not
phased appropriately.

2. Behavioral Contracts

 Concept: Behavioral contracts are formal agreements between two parties, typically
outlining the desired behavior, criteria for reinforcement, and specific consequences
for non-compliance.
 Examples:
o A student agrees to complete daily assignments, with a reward of additional
recreational time if successful.
o A weight-loss program participant signs a contract committing to a calorie-
reduction plan, with incentives like fitness equipment or social
acknowledgment for meeting milestones.
 Effectiveness:
o Increases commitment to behavior change by defining clear goals.
 o Enhances accountability by involving both parties in creating and monitoring
the contract.
 Applications in Therapy: Often used in cognitive-behavioral therapy (CBT) for
individuals with attention-deficit/hyperactivity disorder (ADHD) or substance use
disorders.

3. Self-Management Programs

 Concept: Self-management leverages individual autonomy to monitor, regulate, and

reinforce one's own behaviors. It often involves setting goals, self-recording, and
applying reinforcements or punishments.
 Examples:
o Smoking cessation programs where individuals track smoking triggers and
reinforce abstinence with rewards.
o Students setting goals for study hours and rewarding themselves with leisure
activities upon completion.
 Advantages:
o Fosters independence and long-term behavior change.
o Cost-effective as it reduces reliance on external intervention.

4. Applied Behavior Analysis (ABA)

 Concept: ABA systematically applies operant conditioning principles to modify

socially significant behaviors. ABA programs are particularly prominent in
developmental disorders like autism spectrum disorder (ASD).
 Examples:
o Teaching language and communication skills to children with ASD using
reinforcement strategies.
o Encouraging adaptive behaviors such as self-care, play skills, and social
interaction.
 Components:
o Reinforcement: Positive reinforcement to encourage participation and
learning.
o Task Analysis: Breaking complex tasks into smaller, teachable steps.
o Data-Driven Decisions: Regular monitoring and adjustments based on
performance.
 Effectiveness:
o Evidence-based research demonstrates significant improvement in
developmental outcomes for children with ASD through ABA interventions
(Cooper et al., 2019).

5. Extinction Procedures
  Concept: Extinction involves reducing undesired behaviors by eliminating their
reinforcing consequences. While highly effective, it often leads to an "extinction
burst" (a temporary increase in the undesired behavior) before diminishing.
 Examples:
o Ignoring a child's tantrums that previously received attention.
o Removing access to a smartphone when it is used inappropriately during study
time.
 Considerations:
o Consistency is critical; partial reinforcement may inadvertently strengthen the
undesired behavior.
o Often combined with reinforcement of alternative positive behaviors.

6. Time-Out Techniques

 Concept: Time-out involves temporarily removing an individual from a reinforcing

environment following undesirable behavior, reducing its recurrence.
 Examples:
o A child sent to a designated "calm-down corner" after aggressive outbursts.
o A worker excluded from team activities after violating workplace policies.
 Effectiveness:
o Particularly effective in managing impulsive and disruptive behaviors.
o Works best when combined with positive reinforcement for desired behaviors.

7. Social Skills Training

 Concept: Operant conditioning is integral to teaching social skills by shaping

appropriate interactions and reinforcing positive social behaviors.
 Examples:
o Role-playing exercises in therapy sessions for children with social anxiety.
o Providing praise and rewards for maintaining eye contact during
conversations.
 Effectiveness:
o Beneficial in therapeutic settings, schools, and rehabilitation programs.

Conclusion

Operant conditioning principles provide a versatile and evidence-based framework for

modifying behavior across various domains. Techniques like token economies, behavioral
contracts, and ABA have proven transformative in therapy, education, and self-improvement
contexts. Despite challenges like ethical concerns and potential over-reliance on external
reinforcers, their adaptability and effectiveness make them indispensable tools in behavioral
psychology.