Transcript teleimmersion

Teleimmersion
Fazel Fakhrieh
Overview
•
•
•
•
•
Introduction: what is teleimmersion?
Teleimmiersion and the grid
Application of teleimmersion
Teleimmersion technologies
Teleimmersion performance requirements
Definitions of Teleimmersion
• networked/distributed/collaborative
virtual environments
• “[teleimmersive applications] enable the
interaction between geographically
remote participants within a shared, threedimensional space.”
– - Watsen & Zyda
Definitions (cont)
• “The term Tele-immersion was first
used… as the title of a workshop … to
bring together researchers in distributed
computing, collaboration, virtual reality
and networking”
– - Jason Leigh
Definitions (cont)
• “[teleimmersion is] a broad multidisciplinary
research area that includes all aspects of
computer science, virtual reality, virtual worlds,
teleoperation and telepresence. A variety of
network elements are required to scale up virtual
environments to arbitrary sizes, simultaneously
connecting thousands of interacting players and
all kinds of information objects”
– - Brutzman, Macedonia & Zyda
Definitions (cont)
• “The ultimate synthesis of networking and
media technologies”
– - Smith & Weingarten
Definitions (cont)
• Merging Virtual Reality with
Collaboration Technology
-- Rick Stevens
VR
Haptics
VR
VR
Haptics
Haptics
Definitions (cont)
• a notion of some underlying virtual world
• a visual (usually 3D) representation of the
world, possibly augmented with audio and
haptic representations
• multiple participants in the world, aware of one
another
• interactions between participants, directed to
some (possibly frivolous) end
--Sam Taylor
Virtual Reality
Concept: immersing the user in
a computer generated world that
provides suspension of disbelief
(i.e. transports the user into the world).
– Immersive high-resolution real-time stereo
graphics
– Point of view rendering
– High-quality (spatialized or surround) audio
– Haptics (touch and force feedback)
– Basis for creating shared work spaces
VR
Haptics
Examples of Teleimmersion
• scientific visualisation - big data, big
compute
• cooperative design - architects and CAD
• education - distance learning, outreach
• entertainment - multi-player games
• military - training and simulation
Teleimmersion and the grid
• Symbiotic relationship
• A key is bandwidth latency ,jitter of
network
• Integration of computer and data base
• Judgment how far we are from pervasive
use of teleimmersion
Application of teleimmersion
Teleimmersion application classes
•• Interactive
Interactivescientific
scientificvisualization
visualization
•• Education,
Education,training,
training,and
andscenario
scenariosimulation
simulation
•• Art
Artand
andentertainment
entertainment
•• Industrial
Industrialdesign,
design,architectural,
architectural,evaluation
evaluation
Teleimmersion application classes
(cont)
• Information visualization and data mining
• Telecollaboration environments and human
factors
• Telepresence for exploration, construction,
and recreation
Tele-immersion case study
Teleimmertion technologies
•• Information
visualization
Projection based
system and data mining
• Telecollaboration
environments
and human )
– CAVE( Cave Automatic
Virtual Environment
factors
– ImmerDesk
• Telepresence
– PowerWall for exploration, construction,
recreation
• and
Monitor
based system
– Head-mounted displays( HMDs)
– Binocular Omni-Orientation Monitors( BOOMs)
Teleimmertion technologies (cont)
personal
Information
infrastructure
Individuals
Desktop
collaborative
environment
CAVE
ImmersaDesk
Work groups
collaborations
PowerWall
Institutions
Teleimmertion technologies (cont)
• CAVE
• Smaller VR devices
CAVE
• Multi-person, room-sized, high-resolution,
3D video and audio environment
• Graphics are rear-projected in stereo onto
three walls and the floor and are viewed
with stereo glasses
CAVE Capability
• A user is presented with dynamically moving
stereo full-color at multi-thousand-pixel horizontal
resolution on the walls and floor.
• The primary user’s position is tracked so that the
correct perspective view is generated in real time
• The primary user can navigate with variety of
intuitive navigational devices currently under test
and construction.
• …
Immersive Virtual Environment
Audio Synthesizer
Virtual
Environment
Generator
Audio Localizer
commands
Speech
Recognizer
graphics
Display
Electronics
eye position
head position Head/Eye/Hand
Tracking
hand position
Electronics
Haptic/Tactile
kinaesthetics
system
User
Environment
headmounted
display
or
projection
display
system
Teleimmersion performance
requirements
• Teleimmersion data flows
• VR lag and communications performance
• Performance requirement
Teleimmersion data flow
•
•
•
•
•
•
•
•
•
Control
Text
Audio
Video
Tracking
Data base
Simulation
Haptics
Rendering
Synchronization
of events
Tele-immersion
management
Type of flow in collaborative virtual
reality
Control
Text
Audio
Video
Tracking
Database and Event Transactions
Simulation Data
Haptic Drivers
Remote Rendering
VR lag and communication
performance
• Caused by: Rendering, display, tracking,
simulation, communication, synchronization
• Communication’s latency source:
–
–
–
–
–
Transmission
Bandwidth
Switching or routing
Contention
Protocol
• Asynchronous teleimmersion model
Performance requirement
•
•
•
•
Bandwidth requirement
Latency
Reliability
Multicast
Bandwidth requirements
Type Latency
Control < 30 ms
Text < 100 ms
Audio < 30 ms
Video < 100 ms
Tracking < 10 ms
Database < 100 ms
Simulation < 30 ms
Haptic < 10 ms
Rendering < 30 ms
Bandwidth
64Kb/s
64Kb/s
Nx128Kb/s
Nx5Mb/s
Nx128Kb/s
> 1GB/s
> 1GB/s
> 1 Mb/s
>1GB/s
Reliable
Yes
Yes
No
No
No
Yes
Mixed
Mixed
No
Multicast Security Streaming DynQos
No
High No
Low
No
Medium No
Low
Yes
Medium Yes
Medium
Yes
Low
Yes
Medium
Yes
Low
Yes
Medium
Maybe Medium No
High
Maybe Medium Maybe High
Maybe High Maybe High
Maybe Low
Maybe Medium
Further reading
For more information on the topics covered in this chapter,
see www.mkp.com/grids also following references:
• Kalawsky’s reference text on virtual environments is
comprehensive
• Two national research council reports discuss open
research topics in environments and user interfaces
• Burdea provides a comprehensive survey of haptics, and
Minsky a wonderful haptices bibiography
• Matlin and Foley survey human sensory and perception
systems, from which many of the requirments of
teleimmersive and virtual environment derive