Transcript No.8

Spatiotemporal Information
Processing
No.8
Information-oriented real space～Telexistence
The role of Spatiotemporal Information
Processing
Kazuhiko HAMAMOTO
Dept. of Information Media Technology,
School of Information and Telecommunication Eng.,
Tokai University, Japan
Today’s topic
 What world or space is created by VR/MR ?
 Telexistence


Master-slave robot
Twister
 Conclusions



The role of spatiotemporal information processing
What world or space is created ? (again)
Spatiotemporal information processing as “Hyperdistributed system”
VR application : 2 Virtual worlds
 Constructed world（= virtual space in computer）
 Model of the real world
 The real space, but cannot perceive directly


Used for education , training or design


Far, Small or Dangerous
Flight simulator, virtual prototyping
Model of the hyper-real world
 Not real, theoretical world



The world of the theory of relativity
The world of mathematics (vector field, etc.)
Art or amusement
 Transmitted world（VR via Network=ubiquitous）
 Telexistence
 Remote control of a robot
Telexistence
 Telexistence enables people to act freely
without any limitations of time and space.
 It is “remote-control of robot”, but what the
robot sees, what the robot feels, every
sense is returned to a user
 The user can feel high presence. The
feeling is like carrying oneself to and
existing in long-distanced place.
Telexistence 1st ptototype
operation
Visual infor.
Master side
Slave side
Presented by Tachi Labo. in University of Tokyo
Mankind robot operated from
“super cockpit” 2nd protytype
Mutual Telexistence
3rd prototype
 from Master to Slave
 Operation and
operator’s figure
 from Slave to Master
 Visual and tactile infor.
Master
Slave
At master-cockpit
Stereo image
Mutual Telexistence
Retro-reflective material
And projector
Mutual Telexistence
Looks of slave side
Operation at master side
Expected image of mutual telexistence
Mutual Telexistence
In the future..
More familiar application of
Telexistence
 RobotPHONE



New telephone by robot
Gesture can be
transmitted via robot
An example of “Robotics
User Interface (RUI)”
TWISTER
glasses-less and wide-angle stereo system for mutual telexistence
Metaphor of future telephone booth
TWISTER
TWISTER
TWISTER





Simple system for mutual
communication (camera and
display)
360 degree, glasses-less 3D
Movie communication in real time
Head position is fixed
One person uses only
TWISTER IV
 The number of pixels


perpendicular ：600[pixel]
horizontal (360 degree) : 3168[pixel]
 View area


radius :1000[mm]
height :1200[mm]
 Pitch of pixel : 2[mm]
 Rotation speed : 1.66[rps]
 Frame rate : 60[fps]
 Pixel depth : 10[bit] for each RGB
The role of spatiotemporal
information processing
 As 4-dimensional information processing



Keyboard and mouse are used.
acquisition, save, recognition, retrieve, etc.
Algorithmism vs Dataism
 By new modalities


VR, wearable computer, telexistence
The role of computer is being changed
 From
AI (Artificial Intelligence) to IA (Intelligence
Amplification)
The role of spatiotemporal
information processing
question
Mass-communication
Path (VR)
answer
Information processing unit
by effective combination of
Computer and user
Conventional Information
Processing (AI)
Information Processing
by New modality (IA)
What is “Spatiotemporal
Information Processing” ?
 Spatiotemporal Information Processing is
realized by New Modality (=VR)



Mass-communication path between computer
and user can be realized.
Computer power is added to human power.
More large human power is produced.
Information in the brain is output to computer.
The result is returned to the brain. This
process can create “New Intelligence”.
What is “New Intelligence”?
 New knowledge = “Transition of thought outside the brain”




Output of a part of information in the brain
Computer processes the information
After the processing, the result is input to the brain.
New intelligence is created

New intelligence created by interaction with the outside =
affordance
 New behavioral style

Virtualization of the real space (Ubiquitous and hyperdistributed processing), telexistence
VR application : 2 Virtual worlds
 Constructed world（= New knowledge）
 Model of the real world
 The real space, but cannot perceive directly


Used for education , training or design


Far, Small or Dangerous
Flight simulator, virtual prototyping
Model of the hyper-real world
 Not real, theoretical world
The worldExample
of the theoryof
of relativity
 The world
of mathematics
(vector
etc.)
“Transition
of thought
outside
thefield,
brain”
 Art or amusement

 Transmitted world（= New behavioral style）
 Virtualization of the real space
 Telexistence (Remote control of a robot)
Example of “Transition of thought outside the brain”
What space should be created ?
 Visualization of genome data


Analyzing space of genome data
Analysis of function of gene






Interaction of a number of gene with many functions
Visualization by color information after selection
High possibility of overlooking important data
Visualization by only color is not enough for intuitive
understanding
No selection, direct presentation into 3D space.
Selection and analysis after 3D visualization
Analyzing space of genome data
The University of Tokyo, CABIN
Example of “Transition of thought outside the brain”
What space should be created ?
 Visualization system of software




Tokyo electric power
company (1990)
Automation of electrical
power distribution by
computer
Requirement of test of the
computer and the software
Work flow of the software is
visualized into 3D space
Example of “Transition of thought outside the brain”
What space should be created ?
 History of programming languages
New behavioral style
Another virtual world
 Artificial space in computer
 Transform the real space to virtual space
 The real space -> ubiquitous, Computer -> intimate
 Correspondence to “individual” ( example, mobile phone )
 Correspondence to “dispersion” is more important than
“average”
 The real world changes to Hyper-distributed system
on condition of large quantity of information
A metaphor of hyper
distributed system？
Holonic System
 Information system of organism




The number of cell in human body is 60 trillion.
A cell works autonomously, but the cells are
connected, the set of cells works as one
system.
Although each cell has independent system,
the cell keeps the rule as total system.
Holonic System
 An
autonomous distributed information system
with fluctuation
How to use the space ?
 With watch, GPS and mobile phone
 High identification ability of space and time
 Behavioral style with “fluctuation” is possible
 Time Zoning like timetable disappears
 The space is used in “Ad-Hoc”



Active system design extemporaneously
“Meeting and parting” of system ≒ Holonic system
Information system of organism is the most efficiency,
therfore, the system becomes close to organism
system.
Feature of hyper-distributed
system
 Sensing information in real time
 Larger knowledge in a terminal than a center
 Initiative of information flow will be moved to a
terminal side
 Example : Wearable computer application
 Current

situation
Information flow from system (center) to user (terminal)
（information according to position）＝average infor.
 Future

Real time information is sent to center computer
＝pinpoint information processing is available in real time
If hyper-distributed system is
realized..
 If ubiquitous environment is realized by
RFID, intimate computer, etc., very small
scale and very low level information
processing and control will be available.
 Realization of spatiotemporal information
processing on condition of huge number
of information device distributed into the
real world