Transcript Title

ResearchChannel
Michael Wellings, Director, Engineering
Immersive Medical Telepresence Workshop Phoenix 2006
Innovations in Interactive HD Video Over High-Bandwidth Networks
September 6-7, 2006
What Is ResearchChannel?
As a consortium of universities and research institutions, we are an
intellectual community that makes knowledge available to all by
sharing our developments, insights and discoveries with a global
audience.
We bring together ideas from the world’s premier institutions and
disseminate those ideas to the public directly.
We engage our audience in the research process by
communicating developments as they unfold.
We experiment with technology to enable alternative, leading-edge
exchanges of our resources.
We are committed to looking forward, both in terms of our
technological innovation and our continual diversification and
expansion of resources for our audience.
Think Forward. Think ResearchChannel.
Pioneering Technology Innovations
To advance global networking technologies
To explore new methods of media distribution and
sharing for teaching learning and research
To further multidisciplinary multinational scientific
collaboration
Because the consortium is uniquely qualified to do so
Think Forward. Think ResearchChannel.
Our Consortium of
University Participants
Arizona State University
Universidad de Puerto Rico
California State College, Monterey Bay
Universidade de São Paulo
Duke University
University of Alaska - Fairbanks
George Mason University
University of Chicago
Indiana University, School of Informatics
University of Hawaii
Johns Hopkins University
University of Kentucky
Massachusetts Institute of Technology
University of Maryland
National University of Singapore
University of Michigan
New York University
University of Pennsylvania
Pennsylvania State University
University of Southern California
Rice University
University of Virginia
Rutgers, The State University of New Jersey
University of Washington
Stanford University Medical Center
University of Wisconsin-Madison
Texas A&M University
Virginia Tech
Tulane University, Freeman School of Business
Yale University
Think Forward. Think ResearchChannel.
and
Research Centers/Affiliates
AARNet
National Academy of Sciences
Advanced Network Forum
National Institute of Nursing
AJA Video Systems Inc.
National Institute of Standards and Technology
Fujinon
National Institutes of Health
Howard Hughes Medical Institute
National Library of Medicine
IBM Corporation
National Science Foundation
Intel Corporation
National Sea Grant College Program
Internet2
NTT Labs
Johnson & Johnson
Pacific Northwest Gigapop
Library of Congress
Poznañ Supercomputing and Networking Center
Microsoft Research
R1edu.org
National Academies
SURFnet
National Academy of Engineering
Vulcan Northwest Inc.
Wisconsin Public Television
Think Forward. Think ResearchChannel.
Our
Newest Participants
Think Forward. Think ResearchChannel.
Our
Multi-platform Distribution
Cable and Satellite Television
DishNetwork satellite system
•11.4 million homes
Cable systems
•10.3 million homes
Streaming Worldwide
• Video on demand
• Broadband and multiple bit rate
Think Forward. Think ResearchChannel.
ResearchChannel
Distribution
U.S. Television Distribution
21.7 million households
DishNetwork satellite system
•
11.5 million homes
Cable systems
•
•
10.2 million homes
35 states
Think Forward. Think ResearchChannel.
New Distribution Initiatives:
Cable VOD
Ideally suited to VOD platform
Charter Communications agreement adds
2 million VOD subscribers
Launch first quarter 2006 with 15 titles per month
Google Video, Open Media Network
Think Forward. Think ResearchChannel.
DigitalWell:
Grid Enabled Digital Asset Management
Project Focus
•
Easy way to acquire, collect, classify, store ,deliver large
collections of digital media over IP networks.
•
Proxy for any type of large data sets but initially focused on
video and audio assets – content agnostic
•
Includes broadcast/Internet Integration
•
Exploits next generation networking to ensure high quality –
Deliver Realism
•
Easy-to-use Web services-based interface compatible with
current Web browsers and computing platforms.
•
Uses pluggable authentication to ensure security and control
access to collections.
•
Scalable architecture ensures that collections can be built,
accessed, searched and shared between disparate networked
communities.
•
D-Lib/Data Grid Interoperation via SRB and OAI for content and
metadata sharing..
•
Middleware – modular integration model
Metadata, DRM/IP, AAI, WSAPI, Grid
•
Automation – End to End
Capture, Describe, Preserve, Deliver
Think Forward. Think ResearchChannel.
Grid Enabled Digital Broadcast
Acquisitio
n
Tape
Ingest
Dub
Television
Scheduling
Broadcast
Services
Final Cut
Edit
Suites
DigitalWell
SRB
TSM
Metadata
Content
Distributio
n
Services
Manage Digital Essence
Encoding
Captioning
Services
Edit, Transcode, …
Automate Metadata
Device Acquisition
MXF, AAF, SMPTE, MPEG7,…
Archive/Preservation
Storage
Tape/Disk
Services
Streaming
VoD
Services
Re-purpose, Footage, …
Service Flows
Think Forward. Think ResearchChannel.
Near-line
Archive
Data Grid
SRB
Storage Abstraction
1st Tier
Disk Cache
Stage Disk
Cache
Near-line
Archive
Data Grid
SRB
Storage Abstraction
1st Tier
Disk Cache
Stage Disk
Cache
Think Forward. Think ResearchChannel.
Think Forward. Think ResearchChannel.
Data Grid - Digital Library Integration
SRB and Digital Libraries
• Conduit for sharing metadata
and/or content in a federation
• Platform for building a preservation
environment
D-Libs using or considering SRB
•
•
•
•
•
MIT D-Space - +120 sites
Cornell Fedora – +30 sites
ResearchChannel DigitalWell
UCSD TV
CDL
Data Grids
• WUNGrid
• PRAGMA Grid
Think Forward. Think ResearchChannel.
Think Forward. Think ResearchChannel.
SC’05 DigitalWell SRB Data Grid Diagram –
HD Collaborative Video Demonstration
Think Forward. Think ResearchChannel.
DigitalWell Collections
Existing, Ongoing, New …
+2100 hrs ResearchChannel, UWTV
+180 Ocean Science uncompressed HD
Microsoft Research Lecture Series
Multi-University Research Library
Forestry Old Growth Satellite Imagery
Deep Space Astronomy – WUNGrid Project
KEXP Radio Live Broadcasts, In Studio Sessions
+15,000 hrs Ethnomusicology
Research Instructional Medical Datasets
UW Library Collections
Think Forward. Think ResearchChannel.
Innovations in
Technology
Why?
To advance global networking technologies
To explore new methods of media
distribution and sharing for teaching
learning and research
To further multidisciplinary multinational
scientific collaboration
Because the consortium is uniquely qualified
to do so
Think Forward. Think ResearchChannel.
On the Leading Edge
ResearchChannel is a collaboration among experts in Internet
networking, storage/search infrastructure development,
emerging streaming media and interactive technologies, digital
television engineering, and video production.
Think Forward. Think ResearchChannel.
Projects
First Internet HDTV transmission - iHDTV
Digital Asset Management System
Development - DigitalWell
Automation of multiple format encoding
Webcasting (SD and HD over IP in multiple
formats)
Streaming to handheld devices
ResearchChannel Internet2 Working Group
Think Forward. Think ResearchChannel.
Advanced Media Delivery Methods
“Big Video”
•
•
•
•
•
•
HD Multiple Unicast
HD Multicast
SD Multicast
SD Multiple Unicast
WMV VOD
HD VOD
“small video”
• Enhanced Phone unicast delivery
• “Podcasting”
AUP of R&E networks (NLR, for example) can make
10gige Lambdas available
The Commodity Internet will catch up
Think Forward. Think ResearchChannel.
Advanced on-line Services
2500 hours of content on the web in multiple
formats:
•
•
•
•
MPEG2 @ 5.6mbps
WMV 1300mbps
WMV multi-resolution feed
Pocket-video files being created
Programming is encoded automatically and pushed to the web
When the show first airs on the channel, the encoded VOD
version is available on the web
Google downloads of ResearchChannel programming available
soon
Think Forward. Think ResearchChannel.
iHDTV Software Suite
iHDTV Explained
• iHD1500
• iHD270
• HD to the Desktop
WindowsXP-based application suite
Released as Open Source as of April 24th, 2006
• Announcement at Internet2 Spring Member Meeting
Think Forward. Think ResearchChannel.
iHDTV Explained
iHD1500
• Uncompressed SMPTE 292M 4:2:2
• Data rate total approx 1.5 gbps
• Requires:
high-end HD capture cards
PCI Express platforms
Windows XP
2 x gige network connection
Jumbo frame transport and routing
Think Forward. Think ResearchChannel.
iHDTV Explained
iHD270 (first introduced aug 99)
•
•
•
•
Sony HDCamtm compression
SDTI data format 270mbps
AJA Xena I/O
Requires:
AJA Xena-HD capture cards
Dual Processor P4
Windows XP
Sony HDCam Hardware encoder/decoder
Gige network connection
Think Forward. Think ResearchChannel.
Recent Demonstrations
Sept 2005 - iGrid San Diego
• Enhanced HD interactive - USA118: Global N-Way
Uncompressed Interactive Conferencing
• Underwater research using HD from SS Thompson –
USA119: 20,000 Terabits Under the Sea
Nov 2005 - SC05 Seattle
• Enhanced HD Interactive Conferencing/HD Storage, capture
and editing using SRB (Storage Resource Broker)
Think Forward. Think ResearchChannel.
iGRID 2005 San Diego
USA118: Global N-Way Interactive HD
USA119: 20,000 Terabits under the sea
Think Forward. Think ResearchChannel.
iGrid Demonstration
USA118: Global N-Way Interactive HD
Think Forward. Think ResearchChannel.
Technology Support
Think Forward. Think ResearchChannel.
iGRID 05 – USA118
Sept 2005 - iGrid San Diego
• Enhanced HD interactive - USA118: Global N-Way
Uncompressed Interactive Conferencing
• Remote sites:
1. Pacific Northwest Gigapop - University of Washington Seattle
2. The WIDE (Widely Integrated Distributed Environment)
Project - Tokyo
3. University of Wisconsin - Madison
4. University of Michigan – Ann Arbor
5. SURFnet - Amsterdam
Think Forward. Think ResearchChannel.
iGRID 05 – USA118
Sept 2005 - iGrid San Diego
• Remote site equipment:
2 RX iHD1500 Hosts (multicast from iGRID)
1 TX iHD1500 Client (unicast to iGRID)
• Central site equipment:
6 RX iHD1500 Clients
2 TX iHD1500 Hosts (Multicast)
Evertz VIP-12 HD Video Tile Generator
Multichannel mix-minus audio system
Think Forward. Think ResearchChannel.
iGRID 05 – USA118
iHD500 – first demonstrated at SuperComputing
2004
• Real-time HD communication: Australia and Seattle >
Pittsburgh @ 1.5gbps each direction
• At that time relatively high latency (1500ms RT)
500ms hardware/software one-way
250ms network delay one-way
Think Forward. Think ResearchChannel.
Think Forward. Think ResearchChannel.
iGRID USA 118 Network Diagram
Think Forward. Think ResearchChannel.
iGRID USA 118
Think Forward. Think ResearchChannel.
iGRID USA 118
Think Forward. Think ResearchChannel.
Think Forward. Think ResearchChannel.
iGRID 05 – USA119
Sept 2005 - iGrid San Diego
• First ever live HD/ip from a ship at sea to viewers on
shore
• Ku-Band equipment upgrade to SeaTel antenna
• Careful RF engineering to design satellite Link-Budget
• Real-time MPEG-2 MP@HL encoding
• Ip gateway
• Satellite modem 20mbps
Think Forward. Think ResearchChannel.
Internet HDTV: VISIONS’05
Think Forward. Think ResearchChannel.
iGRID USA 119
Think Forward. Think ResearchChannel.
iGRID USA 119 Network
Think Forward. Think ResearchChannel.
iHD1500 application
SMPTE 292M/ip
• ~1.5gbps
1080-60i HD video with multiplexed audio
ResearchChannel partner Intel PCE-Express 3.4GHz Dual Xeon
platforms
ResearchChannel partner AJA Video Systems supplied initial round
of Xena-HD capture boards
Think Forward. Think ResearchChannel.
iHD1500 application
Latency about 4 frames end to end plus network
delay
•
•
•
•
•
4 frames=133ms or ~ 1/7 sec
Network delay Australia>Philadelphia ~ 250ms
Satellite latency about 250ms per hop
H.323 devices about 220ms plus network delay
No significant delay in video equipment
Think Forward. Think ResearchChannel.
Software Enhancements
iHD1500 Enhancements:
•
•
•
•
tile display generated in software
Audio mixing in software
Audio mix-minus in software
Video switching in software
Think Forward. Think ResearchChannel.
iHD-X: Open Source Initiative
iHDTV Open Source Group
• Launched Spring quarter 2006
• iHDTV Trusted Partners Group formed
• Advisory groups:
Executive Team
Technical Team
• Enhancement planed as first step
• Wide deployment desired
• Multicast tunnel nodes
• Interoperability with other HD systems is an
important goal
Think Forward. Think ResearchChannel.
High Definition Video to the Desktop
FORMATS
PLAYERS
• MPEG2 MP@HL
• VLC
• VC-1 (WMV-HD)
• WM9/10
• H.264/AVC/MPEG4 Part 10
• QuickTime/MPEG4
• HDV (MPEG2 MP@H14)
• VLC
Think Forward. Think ResearchChannel.
Advanced Delivery Methods
The content is important, not the delivery method
• We will use what works best for the application
• Quality will scale to match the receiving device
Multiple delivery methods will be used
• Wired delivery for stationary receivers
• Non-wired delivery for mobile devices
As high speed connectivity proliferates, over-the-air
transmission becomes less important for stationary receivers
• The multiple use, highly connected devices in the home receive all
content over high speed network connections using several forms
of transport media
Ip over cable, fiber, copper, RF
• CATV operators will migrate to an all-IP delivery scheme and
broadcasters will be hard-pressed to compete
• Traditional Broadcasting’s last stand will be rural areas in advance
of expanding IP networks
Think Forward. Think ResearchChannel.
Advanced Delivery Methods
It took about a year for cable modems downstream speeds to
increase from 2mbps to 8mbps in the Seattle area
High bandwidth connectivity means non-linear viewing of
multi-res content which will change the face of media delivery
Global reach
Old Model:
• Broadcast in your own geographic area
• Compete with local broadcasters and print media
New Model:
• “X-cast” (Podcast, multicast, unicast etc) to the world and
become part of an immense soup of content
• Compete with everyone for a small slice of a universal market
Think Forward. Think ResearchChannel.
ResearchChannel Advanced
on-line Services
ResearchChannel satellite feed on the network
• 233.0.73.29 MPEG2@ 3.2mbps
Live 1080i HD video of Mt Rainier
• 233.0.73.26 MPEG2 MP@HL @ 20mbps
Live 720p HD video of Mt Rainier
http://www.researchchannel.org/tech/desktopclients.asp
HD VOD 720p WMV-HD
http://www.researchchannel.org/visions05/hdpresentation.asp
HD VOD 1080i MPEG2 ML@HL
http://www.researchchannel.org/tech/desktophdsamples.asp
KEXP-FM Audio-on-demand; uncompressed audio webcasting
http://www.kexp.org
Think Forward. Think ResearchChannel.
ResearchChannel Advanced
on-line Services
Successful demonstration home delivery of WMVHD@720p over CATV Modems
Developing VOD archive for oceanographic HD video
KEXP-FM on-line services have a world-wide
audience that equals Seattle broadcast listener
numbers
Think Forward. Think ResearchChannel.
ResearchChannel Advanced
on-line Services
Making Television History
Visions ’05 - Emmy Award Nominee
First-ever live HD 1080i video/IP streamed around the
world
• SMPTE 292M multicast and unicast @ 1.5gbps
• MPEG 2 MP@HL multicast
• WMV-HD multicast with Unicast automatic failover
Think Forward. Think ResearchChannel.
ResearchChannel Advanced
on-line Services
Seattle Science Foundation Project – testbed for new
Medical technology with HD video archiving
WWAMI: collaborative medical education via
Advanced video technology
Think Forward. Think ResearchChannel.
Internet HDTV: VISIONS’05
http://www.researchchannel.org/visions05/multimedia.asp
Think Forward. Think ResearchChannel.
UW Medical Center:
Inside Access -Brain Tumor Surgery
Brain Tumor Surgery
This program profiles an innovative surgical technique for
maintaining the speech and language skills of a brain tumor
patient. The program introduces viewers to Deborah Kelley, a
remarkable patient who bravely allows a camera to follow her
for several weeks, from her initial consultation at the UW
Medical Center's Neurosurgery clinic and then into surgery.
http://www.researchchannel.org/prog/displayevent.
asp?rid=2763
Think Forward. Think ResearchChannel.
For More Information
www.researchchannel.org
inquires: [email protected]
Michael Wellings
Director, Engineering
[email protected]
Think Forward. Think ResearchChannel.