Transcript Ahuja-SIGMM

Multimedia Research Viewpoint and vision
Sid Ahuja
VP Converged Networks and Services Research
What is Multimedia?
• Not just another medium (media type)?
– Audio, video, data, ..
– Aggregation of two or more different medium?
• Integration of multiple medium in common applications
– Multimedia mail (includes voice, data and images)
• Real time experience in multiple media around a common
event (people centric.. Not machine centric)
Lucent Technologies Proprietary
1
Real Time Multimedia Experience
• Daughter’s Birthday Party
–
–
–
–
Screaming kids everywhere (rich interactive multipoint audio)
Colorful and messed up clothes (rich multipoint video)
Kisses and hugs (rich tactile feedback)
Getting hit by an errant pie (VERY rich tactile feedback)
• Going on a Space Mountain ride at Disney
– The world rushing by (high speed audio, video)
– Hanging on to dear life on a huge drop (g-forces)
– Losing your hat on the third turn (air whizzing by )
• These are IMMERSIVE experiences
– Being hit at the same time in many different ‘senses’
– Produces a feeling of ‘being there’
Lucent Technologies Proprietary
2
Multimedia in Entertainment
• Multimedia Presentations (multimedia content)
– DVD Movies .. Limited to big production houses
– Business presentations (data + A/V clips)
• Multimedia mail
– Audio and Video attachments to email
– MMS .. Multimedia messaging in wireless
– Video clips on the Internet
• Asynchrounous use of Multimedia content
Lucent Technologies Proprietary
3
Networked Multimedia
• Real time multimedia collaboration (why are we not using it?)
– Systems being built since late 80’s .. No common standards
– Confusion about the experience (document sharing, Video
conferencing)
– Lack of common signaling and bandwidth
• Multimedia Books /classrooms
– No standard today
– Mostly one-to-many videocast of a lecture
– Can be truly interactive (from each user’s point of view)
• Interactive Video Games
–
–
–
–
Shared mulitmedia experience
Virtual video, audio and other media (tactile feedback)
Networked video games .. No shared audio, local video
No tools for the consumer
Lucent Technologies Proprietary
4
Challenges .. Vision
• Billions of sources (every person a consumer and producer)
–
–
–
–
Cheap devices for capture and interface
Tools for representation, storage and movement
Network for movement
Already happened to the Text world
• Trillions of experiences
– Representation and indexing
» Not just one kind of video … any set of pixels ..any rate
» New media types .. Tactile, temperature, etc.
– Content identification and ownership
» Encryption
» Watermarking
– Easy sharing with multiple people
» Multicasting
» Group communication support
Lucent Technologies Proprietary
5
Push-to-view (Always-On)
New Applications
Lucent Technologies Proprietary
6
User’s rich video world
New Applications
User has a ‘personalized’ selection of low-bitrate, Always–On, interactive
video channels
The Always-On video channels can be sourced from:
• Entertainment broadcast stations
• Roving reporters .. e.g. an embedded reporter in Iraq
• Monitoring sources: traffic intersection, kid’s room, factory floor,etc.
• Instantaneous person to person video connection (like Push-to-talk to
limited set)
• Personal Video mailbox
Video channels are MPEG4 .. based
• Quick set-up is required for providing Video channels from millions of
sources
• Network infrastructure required to manage totality of Video sources
• Bandwidth per user can be from 64 Kbits/sec to 1 Mbits/sec based on
quality and number of Always-On channels.
Lucent Technologies Proprietary
7
VideoPhone Architecture Overview
Node B
3G-324m
Video phone
Satellite dish
RNC
MSC
ISUP (H.324)
Live Contents
RTP/UDP/IP
Video Content server
Video Portal
• Current Cell Performance
– For Voice only cells:
» ~180 Simultaneous users at 13.3 kbps, ~2.4 Mbps per cell
» Occupancy: to be 90 seconds per call (1.2 Mbits / call)
– For Data only cells:
» ~30 Simultaneous users at 100Kbps, ~ 9 Mbps per cell
» Occupancy: unknown at this time
Lucent Technologies Proprietary
8
Access Independent Subscriber Services
Softswitch
XML
Parlay, SIP
Portals,
Messaging,
Other App Server
SS7
XM/C
IPDC/H.248
LMRS
Service Provider
IP Network
Wireless
PSTN
IMT/PRI
Universal
Gateway
PRI
Circuit
PBX
RNC
SIP
H.323
DSLAM
Splitter
FTTP
ONT
SIP
H.323
MGCP
VoDSL
IAD
Lucent Technologies Proprietary
SIP
H.323
IP PBX
Enterprise
LAN
9
Anytime Anywhere Group Communication across the Network of Networks:
Connection Example
PSTN
2.5G / 3G
Wireless
Network
MMSC
MMS,
Voice,
Video
PSTN user
accessible
through Voice
Voice Call
2.5/3 G User
New Applications
Offline / Busy
user, accessible
through email
E-mail
Data Networks
Internet, Corporate, Home etc.
SMS
Enable group
member
communication
2G
Wireless
Network
2G User
Network
Assistant
SMSC
Ad-hoc group
Multi-modal
communication
Online User
accessible through
Voice / Video /
Messaging
Network Enabled
User reachability
to an ad-hoc group
Time, Place,
Notes
Lucent Technologies Proprietary
10
New Research Directions
•
•
•
•
Rich definition and representation of mulitmedia content
Identification and copying
Tools for masses for creating and sharing content
Next generation network infrastructure
–
–
–
–
–
New signaling infrastructure (SIP+)
Enough capacity for end points
New group support
QOS for real time
Persistence .. How to save for posterity
Lucent Technologies Proprietary
11
SIGMM .. Take the Lead
•
•
•
•
•
•
Wireless world …3GPP / 3GPP2
Wireline world .. W3C , IETF, TV Industry
Multimedia Books …standardize content
Tools for the masses
Facilitate multimedia forums
Hold next retreat as a virtual retreat
Lucent Technologies Proprietary
12