Transcript Beyond Human Memory - Microsoft Research

Human Information
Processing
Personal Memex
Virginia Tech Plans with SenseCam: Early Ideas
Microsoft Memex Workshop, July 2006
Beyond Human Memory:
SenseCam Use in Veterinary College
and as Assistive Technology
Manuel A. Pérez-Quiñones,
Edward A. Fox
Friday, December 2, 2005
Virginia-Maryland Regional College of Veterinary
Medicine
Human Information
Processing
Personal Memex
• Context of student life at the Vet School
• Goals:
– improve the recall of clinical procedures studied in lab sessions
– promote learning through sharing of information among students
• which should result from integration of
– audio/photos from multiple SenseCams,
– video from the professor, and
– live notes taken by several students
• Sharing:
– Students will have the option of providing access to particular
pieces of information by particular users.
– Information will be uploaded automatically to a web server where
it will be available to other students for download into their
MyLifeBits data store.
Friday, December 2, 2005
Students with Disabilities
Human Information
Processing
Personal Memex
• Help students with disabilities in their day-today activities on campus
• Use location tracking and some form of
simple tagging of the audio or video data to
help students with prospective remembering
• Allow students with motor disabilities to share
data with their care-giver and/or with the
staff of the Assistive Technologies office
• Track locations indoors with 802.11 device
Friday, December 2, 2005
Original Timeline
Human Information
Processing
Personal Memex
Term
Veterinary School
Students with Disabilities
Spring
2006
Early-semester - 2 students use
SenseCam for week at a time
Mid-semester - administer
memory test; design and
prototype data sharing
functionality
Late-semester - focus group,
interview students
Early-semester – identify students that will
participate; consider privacy and legal
issues
Mid-semester – allow student to use
SenseCam for a period of time. Design and
prototype indoor route visualization.
Late-semester – analyze effectiveness of
SenseCam for students with disabilities
Summer
2006
Implementation of new functionality into MyLifeBits schema.
Write papers with early results, participate in workshops
Fall
2006
Repeat memory study using new
functionality.
Consider collaboration and
sharing of data more explicitly.
Recruit new participants
Deploy system with participants and caregivers
Evaluate effectiveness.
Publish results, participate in workshops
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Human Information
Processing
with the
Personal Memex
Ingrid Burbey, Gyuhyun Kwon, Uma Murthy, Nicholas Polys, Prince Vicent
Friday, December 2, 2005
Human Information Processing Project Presentation
Human Information
Processing
Personal Memex
Overview
1. Project Overview
Scenarios
Literature Search:
HIP Principles
Expert Interviews
Task Analysis
Initial Prototype
Cognitive Walkthrough
with experts
Annotated
Bibliography
Friday, December 2, 2005
Design Guidelines
Revised Prototype
Human Information
Processing
Personal Memex
Overview
1. Project Overview
Literature review
Expert Interview
Studies of current related systems
Brainstorming
Analysis
Iterative analysis and design
based on
Usability claims and HIP principle
Design
Prototype&
Evaluation
Friday, December 2, 2005
Scenario generation
Function decomposition
Task decomposition
Specifying interaction
Low fidelity prototype
Cognitive walkthrough
Human Information
Processing
Personal Memex
Cognitive Walkthrough
1. Cognitive Workthrough Process
System Requirements
HIP/Usability Principle
Memex
Prototyping
Friday, December 2, 2005
Test Scenario
Description
Performing
Cognitive Walkthrough
Record
usability
problems found
Fix
the usability
problems
Human Information Processing: Memory
• The Multi-Store Model
(Atkinson & Shiffrin, 1968)
• Encoding, Storage, Retrieval
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Human Information Processing:
Long-term Memory
Human Information
Processing
Personal Memex
• Types of LTM (evidence from Amnesiac
s)
– Semantic: Knowledge & Facts
– Episodic: Events & Experiences
– Procedural: Skill
• Aspects of LTM
– Explicit aka ‘declarative’
– Implicit aka ‘non-declarative’
Friday, December 2, 2005
Human Information Processing:
Long-term Memory
Human Information
Processing
Personal Memex
• Structure of LTM: Schemas
– Developed by experience and pre-programmi
ng; accommodation & assimilation
– Prototypical elements are always given priority
– Can be applied non-consciously
– Shared across individuals within a culture
– Stable over time
Friday, December 2, 2005
Human Information Processing:
Long-term Memory
Human Information
Processing
Personal Memex
Recall can be confounded by:
• Proactive interference
– prior learning interferes with subsequent
learning
• Retroactive interference
– post hoc learning confounds the prior learn
ing
Friday, December 2, 2005
Human Information Processing:
Long-term Memory
Human Information
Processing
Personal Memex
Models of LTM retrieval
• Associative Memory
– Levels of Processing
– Cue-dependent forgetting
• Encoding Specificity Principle : Context !!!
– Priming & Cues : visual, verbal, …
Friday, December 2, 2005
Human Information Processing:
Working Memory
• Working Memory, Baddeley, 2003
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Symptoms of Macular Degeneration
• Difficult to see colors
• Difficulty recognizing faces
• Prefer dim backgrounds
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Mild Cognitive Impairment
• Due to Hippocampus shrinking
• No universally, accepted definition
• Symptoms
–
–
–
–
Loss of short-term memory
Forgetfulness
Deteriorates over time
Difficulty in associative memory
• Remembering names of people or things
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Design Guidelines
Human Information
Processing
Personal Memex
Design Guidelines
• Formulated in the tradition of Nielsen,
Tognazzini
• Discovered or confirmed through:
– Literature search
– Expert interviews
– Cognitive walkthrough
Friday, December 2, 2005
Design Guidelines
Human Information
Processing
Personal Memex
General Results
• Maintain consistent, meaningful graphics
• Support opportunistic navigation
– user control and freedom
– ‘Bookmarking’ paths, previous searches
• Leverage user recognition rather than recall
– provide context for users while searching and browsing memories
• Provide visibility for mode & system status
• Provide Internationalized Tool Tips for icons and buttons
• Provide Help w/o loosing state
• Provide Tutorials explicitly demonstrating functionality
Friday, December 2, 2005
Design Guidelines
Human Information
Processing
Personal Memex
Population-specific Results:
Mild Cognitive Impairment
• Simplify task steps
• Provide views that can represent time and objects
graphically
• Provide time, space, and object reminders
(for schedules, directions, medication)
Friday, December 2, 2005
Design Guidelines
Human Information
Processing
Personal Memex
Population-specific Results:
Visual Impairment
• Provide enlargeable fonts & interface items (e.g., buttons)
• Provide contrast between font and background
• Provide options for audio output: voice, speed, pitch
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Prototype
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
Human Information
Processing
Personal Memex
Friday, December 2, 2005
General Comments
Human Information
Processing
Personal Memex
• Integration with other applications/devic
es
• Date/time on main screen
• Mouse-over magnification
• Help menu item
• Prototypical terms
• Scroll forward to future events
Friday, December 2, 2005
Tablet Idea
Human Information
Processing
Personal Memex
• Monday Tablet session
• Discussion that people aided by
assistive technologies are delayed a
long time before the right affordances
arise
• Idea that SenseCam could be used
along with a Tablet
• in synergistic capture, analysis, design,
deployment methodology
Friday, December 2, 2005
Summary and Conclusions
•
•
•
•
•
Human Information
Processing
Personal Memex
Two planned efforts
Student project report
Tablet idea
Looking forward to new version!
Hoping Microsoft’s many projects (sear
ch, image processing, Tablet, etc.) can
be integrated with MyLifeBits
• Hope Microsoft staff can help run a JC
DL workshop on personal DLs in 2007
• Open for collaboration
–
[email protected]
Friday, December 2, 2005