Transcript 20061205-VirtHosp-Smith

Mixing the Real and the
Virtual in a Hospital through
Telepresence
Kevin Smith
[email protected]
Mixing the Real and the Virtual!
• Can we mix virtual people with
real people?
• Can we mix real people with
virtual people?
It has already been done!
Simulation & Training using Telepresence
• Benefits:
– Clinicians and other professionals with
heavy demands on their time can
participate in a simulation from anywhere
in the hospital (or outside it)
– Training can take place anywhere eg a
simulation can be run in a patient’s room
immediately after a real patient is
discharged from that room
Is it possible?
• Light Field capture and display
– Perceptually the same as an optical
wavefront
– Based on Integral Photography
invented by Lippmann in 1908!
• Acoustic Wave Field capture and
generation
What’s a Lightfield?
Stanford Multi-Camera Array
Data Rate
• 128 cameras each operating at 30 fps
• 640 x 480 8 bit pixels
• Total data rate of over 9 Gbps
• http://graphics.stanford.edu/papers/CameraArray/
Holografika’s HoloVizio
QinetiQ’s Autostereo 3D Display Wall
Everyone can see the same point
Autostereoscopic Displays
Available Today
• QinetiQ
http://www.qinetiq.com/home/technologies/technologies/optronics/pad/hpv/3d.html
• Holografika
http://www.holografika.com/markets/ts640rc.shtml
• Deep Light
http://www.deeplight.com/products_displays_designer.html
MIT LOUD
Data Rate
• 1020 microphones each sampling at 16
KHz
• 24 bits per sample
• Total data rate of 393 Mbps
• http://cag.csail.mit.edu/mic-array/
IOSONO: Wavefield Generation
• Wave Field Generation
– Large array of speakers – uses Huygens’
Principle
•
http://www.idmt.fraunhofer.de/eng/research_topics/wave_field_synthesis.htm
MERL: 3D TV
•
•
•
•
Lightfield capture and display
16 cameras at 30 fps
1300 x 1030 pixels, 24 bits
Total data rate is over 14 Gbps
• http://www.merl.com/projects/3dtv/
Technology Requirements
• At least Tbps data connections as
standard!
• At least 100 fold increase in embedded
computing power
Telepresence in a Hospital
Already being used eg
• CSIRO’s ViCCU
– http://www.ict.csiro.au/page.php?did=16
• InTouch’s RP-7 System
– http://www.intouch-health.com/products-RP7.html#virtual
Telepresence in a Hospital
• In the future, hospitals can be built
where all walls are two way lightfields
so that a person or an object can be
projected in “full” 3D into any room of a
hospital and, conversely, any patient
can be imaged and viewed in “full” 3D
– http://www.camfpd.com/future.htm
Examples of the Operational Use of
Telepresence in a Hospital
• Specialists can attend a “code blue” as
well as the crash team
• Nursing staff can respond through
telepresence to a patient’s “call button”
and assess whether have to go physically
• A patient can be triaged in an ambulance
by a trauma specialist