Transcript Opportunity Knocks

Assisted Cognition
Henry Kautz
University of Washington
UW Computer Science & Engineering
UW Institute on Rehabilitation Medicine Technology
Intel Research Seattle
Vision
Computer systems that assist
people with cognitive disabilities
Prompting, guiding, warning
Self-adaptive
No explicit programming by users
Little or no instruction by caretakers
No user data-collection overhead
Directly sense environment
Robust in the face of noise & error
Opportunity Knocks
A Personal Guidance System for Users with
Cognitive Disabilities
Cognitive Problem
Wayfinding
Travel by foot, car, and public transit
through local community
Problems
Becoming lost
Which way do I turn?
Error recovery
I missed bus stop – now what?
Disorientation
Where am I going?
Result: isolation from friends, family, &
social services
Current Technology
GPS receivers
Difficult to program and use
Designed for drivers or wilderness hikers
Not robust
On sidewalks near buildings
In buses
How to create GPS systems that are
useful for cognitively disabled
individuals?
Opportunity Knocks
Cell phone-based GPS system that
Learns user’s routine without any explicit
data entry
Integrates information about public
transportation
Predicts where user is trying to go, and
offers pro-active help
Detects user errors, and helps user get
back on track
Opportunity
Knocks
Demonstrated at AAHA
Future of Aging Services,
Washington, DC, March,
2004
Error
Detection
Missing the
bus stop
knock,
knock!
Recent Progress
Prototype demo’d at AAHA Future of Aging Services,
Washington, DC, March 2004
“Opportunity Knocks: a System to Provide Cognitive
Assistance with Transportation Services”, Donald J.
Patterson, Lin Liao, Krzysztof Gajos, Dieter Fox, and
Henry Kautz. Sixth International Conference on
Ubiquitous Computing, Nottingham, England, 2004.
“Learning and Inferring Transportation Routines”, Lin
Liao, Dieter Fox, and Henry Kautz. Best Paper
Award, Nineteenth National Conference on Artificial
Intelligence, San Jose, CA, 2004.
User needs & interface assessment with UW Institute
on Rehabilitation Medicine Technology