Transcript lecture4

What is vision used to catch a ball?
What can we tell from the eye movements?
Types of Eye Movement
Information Gathering
Voluntary (attention)
Stabilizing
Reflexive
Saccades
vestibular ocular reflex (vor)
new location, high velocity, ballistic
body movements
Smooth pursuit
optokinetic nystagmus (okn)
object moves, velocity, slow
whole field image motion
Vergence
change point of fixation in depth
slow, disjunctive (eyes rotate in opposite directions)
(all others are conjunctive)
Fixation: period when eye is relatively stationary between saccades.
QuickTime™ and a
YUV420 codec decompressor
are needed to see this picture.
Catching: Gaze Patterns
X
X
saccade
X
smooth pursuit
Thrower
Terminology: saccadic eye movement
Catcher
Catching: Gaze Anticipation
Saccade
reaction time = 200ms
61 ms
X
-53 ms
X
X
Thrower
Catcher
Timing of departure and arrival linked to critical events
What is the significance of prediction?
Brain must learn the way ball moves etc and program
movement for an expected state of world. Not reacting simply to
current visual information. Stimulus
Response
Why is prediction necessary?
Analysis of visual signals takes a lot of time!
Photoreceptors
ganglion cells
Primary visual cortex
mid-brain
brain stem
LGN
other cortical areas
muscles
Round trip from eye to brain to muscles takes a minumum
of 200 msec. Cricket ball only takes about 600 msec.
Prediction gets around the problem of sensory delays.
How good is prediction?
Accuracy of Fixations near Bounce
20 deg
bounce point
2D elevation
Subjects fixate above the bounce point
QuickTime™ and a
YUV420 codec decompressor
are needed to see this picture.
Poor tracking when ball is unexpectedly bouncy
QuickTime™ and a
YUV420 codec decompressor
are needed to see this picture.
Better tracking 2 trials later.
Pursuit accuracy following bounce
%age of time gaze on Target
Measure proportion of time between bounce & catch that eye is close to ball
100%
tennis ball
90%
80%
70%
60%
bouncy ball
50%
40%
30%
20%
5 subjects
10%
0%
1
2
3
4
5
6
Trial Number
Does pursuit accuracy improve with repeated trials?
Does it matter which ball is used first? What can we conclude if it does?
Prediction in Squash
QuickTime™ and a
TIFF (LZW) decompressor
are needed to see this picture.
Prediction in Squash
QuickTime™ and a
H.263 decompressor
are needed to see this picture.
QuickTime™ and a
TIFF (LZW) decompressor
are needed to see this picture.
Error between fixation and bounce-point
0.15
16
0.1
14
0.05
0
Error (degrees of
visual angle)
latency (seconds)
Time between fixation on front wall
and bounce on front wall
12
10
Player 1
-0.05
-0.1
Player 2
8
6
-0.15
4
-0.2
2
-0.25
0
Player 1
Player 2
Percentage Pursuit from Bounce off
Wall to Bounce on Floor
80
70
Pursuit (%)
60
50
40
30
20
10
0
velocity (degrees/second/second)
Maximum speed for perfect pursuit and for
reduced gain pursuit
“Reduced gain” means eye lags behind ball.
“Gain” = 1 means perfect tracking
300
250
200
150
Player 1
Player 2
100
50
0
These speeds are much higher than expected. Too high for a reactive system.
That is, prediction is necessary. 100deg/sec = 10 deg in 100 msec.
Binocular Vision
Stereoscopic information: image in the two eyes is different.
This information is used to perceive the depth relations in
the scene.
When is stereoscopic information useful?
- reaching and grasping
- walking over obstacles
- catching??
Development of stereoscopic vision
- amblyopia/ astigmatism
- critical period
Difference in retinal distance between the objects in the two eyes is called
“retinal disparity” and is used to calculate relative depth.
Binocular Vision
QuickTime™ and a
decompressor
are needed to see this picture.
The eye fixates the front of the obstacle, plans the foot placement, and
moves ahead before the foot is placed.
Monocular Vision
QuickTime™ and a
decompressor
are needed to see this picture.
The eye fixates the front of the obstacle, and guides the foot placement
before moving ahead.
Other information that may be useful for catching.
Motion parallax: change in relative position of objects at different
depths when the head moves.
Looming: image of ball increases in size as ball gets closer.
Rate of change of size can be used to calculate “time-to-contact”
Pursuit movement: keeping the eye on the ball.
target selection
Planning?
saccade decision
saccade command
inhibits SC
Cerebellum
Learning?
signals to muscles
decision to pursue/attention
Supplementary eye fields
planning?
detect/analyze
retinal image motion
prediction/
learning?
signals to muscles
Even the simplest action must involve linkage between
memory, vision, eye movements, and body movements.
from Land et al, 1999
What are the questions?
• Is the behavior observed by Land in cricket also true for a simple task like catching a ball?
• What eye movements are made in this case?
• Do subjects anticipate the bounce point? By how much?
• Do Subjects look at floor or above the bounce point?
• What happens after bounce?
• How do subjects adjust to different balls?
• …..
• Is there a difference between throwing and catching? Why?
• What eye movements are made when observing others throw and catch?
• Similarity between individuals?
Procedure:
• Select subject and calibrate eye tracker. Three people stand at equal distances apart and
throw the ball back and forth, with a bounce in the trajectory. First throw in a predictable
manner, about 10 times.
• Then use a different ball, 10 trials.
• Compare one versus two eyes???
•
•
•
•
•
•
•
•
Data analysis
Get dvd from Travis . Play it frame-by-frame on a Mac computer using the RIT program.
What to look for:
– Describe eye movements sequence for each trial
eg Trial 1: fixate near hands/saccade to bounce point/fixate/track portion of trajectory/fixate
for last part of trajectory (??)
Trial 2: fixate near hands/saccade to bounce point/fixate/track portion of trajectory/fixate for
last part of trajectory (??)
….
What is the timing of the saccades/fixations/tracking relative to movement of the ball. How
much do subjects anticipate the bounce point, if at all?
How accurate is pursuit? Calculate percent time eye is on the ball in the period between
bounce and catch.
– Compare different conditions.
– What happens with the different balls? Do the eye movements change with additional
experience? How quickly do they adjust?
Other Aspects:
–
How similar are different individuals? Where would we expect similarities/ differences?
•
What is the role of the pursuit movement? Is pursuit is used to guide hands. Maybe position of eye in head.
•
Binocular information versus monocular (looming)
QuickTime™ and a
YUV420 codec decompressor
are needed to see this picture.
Different gaze pattern for watching
but still anticipate bounce and catch events.
Gaze Patterns Different when Watching
saccade
X
X
X
Thrower
Catcher
Watching:Gaze Anticipation
-51 ms
X
-517 ms
X
-167 ms
X
Thrower
Catcher
Head rotation begins 200-500 msec before release