Transcript Document

Ivan Pavlov (1849-1936)
Classical conditioning procedure
S
R
Classical conditioning procedure
US
UR
Classical conditioning procedure
S
R
+
US
UR
Classical conditioning procedure
CS
CR
+
US
UR
Stimulus Generalization, stimulus discrimination, extinction
Extinction: how we know it isn’t forgetting
1) Spontaneous Recovery
2) Rapid Reaquisition
3) Disinhibition
Higher Order Learning
Human Applications of Classical Conditioning
1) Money
2) Fear (simple phobias)
3) Drug addiction
4) Advertising
Instrumental Conditioning Foundations
Thorndike’s Puzzle Boxes
Thorndike’s Puzzle Boxes
One cat’s data (all of the others are similar):
Burrhus Frederick Skinner
The Skinner Box
Some basic terminology
R -- Rfer
Response-reinforcer relationship
Positive Rfer
Consequence:
Negative Rfer
Positive (presented)
Negative (removed)
positive reinforcement
negative punishment
(reward)
(omission)
Positive punishment
negative reinforcement
(escape)
Why you should never use positive punishment:
Why you should never use positive punishment:
-emotional side-effects
-imitation
-person delivering punishment becomes an aversive CS (leads
to escape or avoidance responses)
How to punish effectively:
-should occur for every instance of the behaviour (not caught)
-no escape from the punishment (bail)
-should occur immediately following behaviour (time to trial)
-should not be paired with a positive reinforcer (TV, concerts)
-alternative response made available (skill building, education)
-should be as intense as possible the first time (first offence leniency)
Instrumental extinction
R -- 000
Some initial side-effects with operant extinction:
1) Increase in response frequency
2) Increase in response vigor (force)
3) Increase in response variability
A fourth element: the discriminative stimulus
SD (S+)
S (S-)
Shaping in Four Easy Steps
1) identify the target, current behaviours
2) Construct a list of “successive approximations” to the target
3) Starting with the first item on the list, reinforce until frequency is stable
4) Put the behavior on extinction until next “successive approximation” behavior is performed,
return to step 3.
Shaping in Four Easy Steps
1) identify the target, current behaviours
2) Construct a list of “successive approximations” to the target
3) Starting with the first item on the list, reinforce until frequency is stable
4) Put the behavior on extinction until next “successive approximation” behavior is performed,
return to step 3.
Partial Reinforcement Schedules
Cumulative Recorder
Partial Reinforcement Schedules
VR
FR
FI
VI