Transcript SenseCam - Microsoft Research

SenseCam & memory rehabilitation
Georgina Browne, Emma Berry, Narinder Kapur
Steve Hodges, Lyndsay Williams, Gavin Smyth, James
Srinivasan, Alex Butler, Alban Rrustemi, Ken Wood
Memex Summit, July 2006
Background
• Cambridge Memory Clinic,
Addenbrooke’s Hospital
2
Memex Summit, July 2006
Causes and treatment of memory loss
• Neurodegenerative disease
– Alzheimer’s disease and Lewy Body dementia
can be treated with medication – with limited
success
– No medical treatment for other dementias
– External memory aids (in theory)
• Acquired brain injury (traumatic and nontraumatic)
– External memory aids (in theory)
3
Memex Summit, July 2006
Improving memory with SenseCam
• Different types of memory:
– Episodic – things you have done (personal
experiences)
– Semantic – facts and concepts
– Prospective – things you intend to do (go
shopping, visit friends, make and keep
appointments)
• Almost all memory aids treat prospective
memory
4
Memex Summit, July 2006
Improving memory with SenseCam
• Episodic memory critical to quality of life
– Forms basis for semantic memories
– Guides actions, creates bonds, builds self-concept
• SenseCam records experiences
– Captures events from patient’s point of view
– Without conscious thought or intrusion
– Plays back quickly in simple-to-use, easy-to-view ‘movie’
• Subsequent viewing of image sequences
– Cues recall & so consolidates storage of memories
5
Memex Summit, July 2006
Improving memory with SenseCam
• Cambridge Memory Clinic,
Addenbrooke’s Hospital
• 63 year old, well-educated,
married woman ‘Mrs B’
• Diagnosed with limbic
encephalitis in 2002
• Now has marked amnesia
– usually no memory a couple of days after event
6
Memex Summit, July 2006
Improving memory with SenseCam
• Goals of patient and husband
– To improve Mrs B’s episodic memory
– To share experiences with each other
– To improve Mrs B’s self-esteem and
confidence
7
Memex Summit, July 2006
Improving memory with SenseCam
• Study Protocol
– Experimental condition: SenseCam used to record
‘special’ days (N=9)
– Control condition: written diary used to record ‘special’
days (N=3)
– Baseline condition: no memory aid used to help recall
‘special’ days (N=2)
– Information reviewed every 2 days for 2 weeks
– Memory evaluated before each review
8
Memex Summit, July 2006
Results
Memory of an event over time
2.0
1.5
x
1.0
0.5
Days elapsed following event
9
Memex Summit, July 2006
+3
m
+2
m
+1
m
13
11
9
7
5
3
0.0
1
Baseline
Proportion of event
remembered
2.5
Results
Memory of an event over time
1.5
x
1.0
0.5
Days elapsed following event
10
Memex Summit, July 2006
+3
m
+2
m
+1
m
13
11
9
7
5
0.0
3
Diary
2.0
1
Baseline
Proportion of event
remembered
2.5
Results
Memory of an event over time
11
x
1.0
0.5
Days elapsed following event
Memex Summit, July 2006
+3
m
+2
m
13
11
9
7
5
0.0
+1
m
SenseCam
1.5
3
Diary
2.0
1
Baseline
Proportion of event
remembered
2.5
Results
Memory of an event over time
12
x
1.0
0.5
Days elapsed following event
Memex Summit, July 2006
+3
m
+2
m
13
11
9
7
5
0.0
+1
m
SenseCam
1.5
3
Diary
2.0
1
Baseline
Proportion of event
remembered
2.5
Results: SenseCam feedback
• Results from patient’s point of view:
– More relaxed socially and less anxious
– Sharing experiences again was a ‘sheer
pleasure’
– Seeing images brings memories ‘flooding back’
– ‘It has enormous potential as a memory aid
and has been a great success for us personally’
13
Memex Summit, July 2006
Results: SenseCam feedback
•
14
Publications
–
Berry, E., Kapur, N., Watson, P., Smith, R., Williams, L., & Wilson, B.
(in press). The use of SenseCam as a pictorial diary to improve
autobiographical memory in a patient with limbic encephalitis: A
preliminary report. Neuropsychological Rehabilitation.
–
Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A.,
Smyth, G., Kapur, N., & Wood, K. SenseCam: A retropsective memory
aid. To appear in UbiComp 2006, 8th International Conference on
Ubiquitous Computing, September 17-21, 2006.
–
Tan, D., Berry, E., Czerwinski, M., Sellen, A., Bell, G., Gemmell, J.,
Hodges, S., Kapur, N., Meyers, B., Oliver, N., Robertson, G., & Wood,
K. (in press). Supporting human memory with a personal digital
lifetime store. To appear in J. Teevan & W. Jones (Eds.), Readings in
Personal Information Management. Seattle: University of Washington
Press.
Memex Summit, July 2006
Ongoing research: MSRC
• SenseCam as an episodic memory aid in
patients with early Alzheimer’s disease
• SenseCam as an episodic memory aid in
other patients with memory loss
• SenseCam factors facilitating consolidation
– Image-reviewing schedules
15
Memex Summit, July 2006
Ongoing research: collaborative work
•
Collaborations agreed/underway with:
–
–
–
–
–
16
–
Professor Barbara Wilson, Senior
Scientist, MRC Cognition and Brain
Sciences Unit, Cambridge
–
Professor Adam Zeman, Professor
of Cognitive and Behavioural
Neurology, Peninsula Medical
School, Exeter
Professor John Hodges, Professor
of Behavioural Neurology,
University of Cambridge
–
Professor Jon Evans, Professor of
Applied Neuropsychology,
University of Glasgow
Professor Phillip Barnard, Research
Scientist, MRC Cognition and Brain
Sciences Unit, Cambridge
–
Professor Martin Conway, Director
of Research & ESRC Professorial
Fellow, Leeds Memory Group,
University of Leeds
–
Dr Andrew Bateman, Clinical
Director, Oliver Zangwill Centre of
Neuropsychological Rehabilitation,
Ely
Professor Narinder Kapur, Head
of Neuropsychology,
Addenbrookes Hospital,
Cambridge
Dr Chris Butler, Clinical Research
Fellow, Department of Neurology,
University of Edinburgh
Dr Nick Alderman, Consultant
Neuropsychologist, St Andrews
Hospital, Northampton
Memex Summit, July 2006
Ongoing research: collaborative work
• John Hodges, Professor of Behavioural Neurology,
Addenbrooke’s Hospital
– Mild Cognitive Impairment
– Early Alzheimer’s Disease
• Adam Zeman, Professor of Cognitive &
Behavioural Neurology, Exeter
– Epileptic amnesia
– Semantic dementia
• Oliver Zangwill Centre, Cambridge
– Brain Injury Rehabilitation
– Therapy
17
Memex Summit, July 2006
Ongoing research: collaborative work
• Collaboration with Martin Conway,
Professor of Cognitive Psychology,
Leeds Memory Group, Editor of the
journal Memory
SenseCam is potentially ‘the first truly powerful
21st century memory stimulant’ which could
generally improve and strengthen memory in
normal aging populations and in those with
brain disease
18
Memex Summit, July 2006
Ongoing research: collaborative work
• Undertaking SenseCam memory studies based on
two hypotheses:
1. SenseCam movies mimic episodic memory
•
•
•
•
•
•
Visual
From ‘egocentric’ point of view
Temporally ordered
Formed outside awareness
Time compressed
Correspond to changes in goal-directed behaviour
 Using SenseCam in experimental studies
•
•
19
Investigating extent to which SenseCam stimulates recall and
strengthens learning
Asking ‘How do we forget over time?’ and ‘How do our memories
decline with age?’
Memex Summit, July 2006
Ongoing research: collaborative work
• Professor Conway’s hypotheses cont’d…
2. SenseCam movies stimulate brain regions important for
memory consolidation
•
Hippocampus and related memory structures
•
Neural networks not easily activated otherwise
 Using SenseCam in neuroimaging studies
•
20
Investigating the functional neuroanatomy of episodic memory in
the normal population and in patients
Memex Summit, July 2006
Final words
• SenseCam may be an extremely powerful aid for
people with memory disorders
• SenseCam may be a potential ‘innoculation’
against memory decline in the normal ageing
population
21
Memex Summit, July 2006