Transcript DVTS with dynamic FEC - Asia Pacific Advanced Network

DVTS UPDATE
Keio University / WIDE Project
DVTS Consortium
Kazunori Sugiura Ph.D.
( [email protected] )
January 23, 2007
Brief update of
DVTS for WindowsXP
DVTSng Rev.2
• Merge DVTS and HiDVTS applications on one
package
– DV -> use DV mode application
– JVC HDV -> use HDV-JVC mode application
– Sony HDV -> use HDV-SONY mode application
other device will be supported on next revision
• IPv6 multicast (ASM/SSM) update
– Rev.1 cannot use IPv6 multicast function
• getaddrinfo() doesn’t run -> re-enable
• Download URL
– http://beta.dvts.info/setup-0.0.0-2.exe
DV Mode Application
Support IEEE1394 output
Not support IEEE1394 output
Please use HDVout tool instead!!
HDV Mode Application
HiDVTS / Camera Output Tool
• Functions
– HDV(MPEG2) RTP data receive
• IPv4, IPv6
• receive port
• unicast, multicast (ASM/SSM)
– IEEE1394(HDV device) output
• only support SONY device (maybe)
• Download URL
– http://beta.dvts.info/hdvout-setup-1.0.0-1.exe
Select HDV device (camera/VCR)
Start/Stop running
Select IP version
Quit application
If you want to use multicast,
Specify multicast address, interface and source address (SSM)
MacOS X
New DVTS for Mac-OSX
• Was not available in Christmas
– Some of the patent issues
– Will be available soon 
• Totally new code
• Internal monitoring and IEEE1394 Output
DVTS with FEC
motivation
• Supportive packet loss avoidance mechanism
for DVTS with minimal quality loss
– Using the network resource effectively
– help reducing quality losses
• Hopefully collaborate within other packet @ Internet
• Dynamic FEC with rate control Mechanism
– Dynamically adapting FEC rate to check network
bandwidth capability
– Frame rate control method reducing bandwidth and
quality of video frames in case of fatal bandwidth
conditions
– Dynamic bandwidth proving via FEC
Practical transport technique
FEC rate
bandwith
Transmission rate
Packet loss rate
Consumed bandwidth
1/1rate
1/2rate
Rate control
FEC
1/3rate
Rate control
FEC
Time
DVRelay
AIT / Thailand
DVRelay
• Frame Reduction
• Motion Detection
• Packet Loss
DVRelay
• combination of dvsend and dvrecv
• Thin-out module is added
– Receives DV stream in full-rate (≈30 Mbps)
– send in a lower data rate
• Used on the path from sender to receiver
– It can be cascaded
– narrower network can receive lower frame rate
dvrelay
DVTS Sender
receiver
thin out
sender
DVTS Receiver
Frame Reduction (1)
• Frame Reduction
– Some frames are selected to be dropped
– Ranges from 1 to 30 based on quality required
– dvrelay thins-out only video portion
DVTS Receiver
Internet
DVTS Sender
dvrelay
DVTS Receiver
Frame Reduction (2)
• One DV frame consist from 1500 DIF blocks (NTSC
format)
– Audio, video, and control blocks
– Video blocks are dropped from selected frames
– Audio and controls blocks are relayed to keep audio quality
intact
• Frames are selected based on RTP timestamp
– It increases 3003 for every frame
• IP packet can carry maximum 17 DIF blocks
– With 1500 bytes MTU
H: header, S: subcode, VA: auxiliary audio, A: audio, V: video
Frame Reduction (3)
• Result
– dvsend sends full-rate
DV stream
– dvrelay thin-outs
frames from 30fps to
10fps
– dvrecv receives 10fps
DV stream
203.159.31.97
dvsend
203.159.31.98
dvrelay
30 fps
203.159.31.62
dvrecv
10 fps
Transmission Rate (Mbps)
35
30
25
dvsend
dvrecv
20
15
10
5
0
19:55:47
19:56:04
19:56:21
19:56:38
Time
19:56:56
19:57:13
19:57:30
Motion Detection(1)
• Bandwidth consumption can be improved by exploiting
the motion in DV stream
– Sometimes DV stream does not contains much mobility
– Like power-point presentations, face to face conferencing
– Dynamically adjust frame rate based on amount of motion
• Two required elements:
– Motion Detection Mechanism
– Frame Rate Adjustment Mechanism
-
=
Motion Detection (2)
Packet Loss (1)
• dvrelay
– Simply sends all the DIF blocks from non-discarded
frames while it sends only the audio and control
blocks from the discarded frames -- at incoming rate
– This behavior creates traffic fluctuation in the network
which generates bursty traffic hence packet loss for
narrowband networks
– Packet loss means incomplete VDO frames
Packet Loss (2)
• To prevent traffic fluctuation
– A application level queue is added in dvrelay
outgoing interface
– First In First Out (FIFO)
– Send packets a in constant bit rate
– Packet sending rate is calculated from the
outgoing frame rate of dvrelay
Packet Loss (3)
• Network operation on narrow bandwidth
networks (eg. Satellite Link)
– Queuing mechanism like ALTQ is used maintain the
priorities for various kinds of traffic
– Network administrators try to assign highest priority to
DVTS streaming traffic to prevent packet loss
Future Works
What (DVTS) need to do
•
•
•
•
Vista capability check
Conference XP Collaboration
AccessGrid Collaboration
MPEG2 and QT
Some Demos
Network Collaboration Game
“Andrew Rivolski”
• Andrew Rivolski is a multiplayer network
game played in an environment consisting
of multiple displays over the Internet.
• Various demos
– Collaboration with USC, RZC
– Demo during SIGGRAPH 2006
– DMC Symposium 2006
Multi Screen
Network
Collaboration
Game
• “Andrew Rivolski”
• Maneuver satellite
by using the foot
panel
Player A
– Avoid hit by the
meteors
• 2 different
Satellite
Player B
Practical Demo
• Remote Conference Studio@SIGGRAPH 06
• Andrew Rivolski Network Game
• DMC Symposium 2006 Fall