Transcript Slide 1

Experimental Analysis of Choice
• Methods: concurrent schedules, concurrent chains,
delay discounting, foraging contingencies, behavioral
economic contingencies.
• Models and Issues: matching/melioration,
maximizing/optimality, hyperbolic discounting, behavioral
economic/ecological models, behavior momentum, molar
versus molecular issue, concepts of response strength.
• Applications: self-control, drug abuse, gambling, risk,
economics, behavioral ecology, social/political decision
making.
Operant Conditioning
Operant Conditioning
HERRNSTEIN’S HYPERBOLA:
ASSUMPTIONS
• 1. The matching law holds.
• 2. Every contingency involves choice (e.g.,
one can respond to a given alternative or
not).
• 3. Not responding to one alternative
means all others supply reinforcers too.
• 4. The total behavior in a situation is
constant.
B1
r1

B1  B 2 r1  r 2
Assume B1  B 2  k .
B1
r1

k
r1  r 2
Set B1= B, r1= r, and r2= ro, where ro
represents other sources of reinforcement.
Thus,
kr
B
r  ro
Herrnstein's Hyperbola
Operant Conditioning
Operant Conditioning
HERRNSTEIN’S HYPERBOLA
B  r krro
Modern Version
R
kr
a
a
o
r
r 
b
a
MULTIVARIATE RATE EQUATION
Rout = { ln [a1 exp (1/Rin) + a0]}
Operant Conditioning
Operant Conditioning
MATCHING LAW
Herrnstein
R1 / R1 = r1 / r2
Baum
R1 / R2 = b (r1 / r2)a
MATCHING LAW
• R1 / R2 = r1 / r2
Herrnstein
• R1 / R2 = b (r1 / r2)a
Baum
• V1 / V2 = b (r1 / r2)a1 (M1 / M2)a2 (D2 / D1)a3
• Rachlin’s “Value”
Melioration: A Theory of Matching
“To make better”: Behavior shifts to the
higher return (lower cost) or equal local
rates of reinforcement.
(R1 / R2) = (r1 / r2), or (r1 / R1) = (r2 / R2)
(reinforcers per response, i.e., return).
(T1 / T2) = (r1 / r2), or (r1 / T1) = (r2 / T2) (local
rate of reinforcement).
Example: Conc VI 30”VI 120”
Suppose in the first hour of exposure 1000 responses were
emitted to each alternative:
(VI 30”) r1 / R1 = (120 rfs / 1000 resps). Return = 0.120
(VI 120”) r2 / R2 = (30 rfs / 1000 resps). Return = 0.03
Ultimately behavior will shift toward the higher return. What
will be the result?
120 / (1000 + x) = 30 / (1000 – x); x = 600.
120 / 1600 = 30 / 400 i.e., matching (80% responses on VI
30” alternative).
Return = 0.075 rfs/resp on each alternative.
Problem: Conc VR 30 VR 120
ALL responses will ultimately be made to the VR
30 alternative. This is consistent with matching,
but same would be said if all the responses were
made to the VR 120 alternative. But melioration
can predict which alternative should receive all
the responses:
VR 30: r1/ R1 = 1/30; VR 120: r2/ R2 = 1/120.
These cannot change, so shifting to the higher
return means all the responses will go to VR 30
alternative.
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
FUNCTIONAL PROPERTIES AND CURVE
FITTING
• What is the “real” delay function?
Vt = V0 / (1 + Kt)
Vt = V0/(1 + Kt)s
Vt = V0/(M + Kts)
Vt = V0/(M + ts)
Vt = V0 exp(-Mt)
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning
Operant Conditioning