Transcript Proposal for CJK working documents of NGN-GSI

CJK NGN Test-bed Configuration
CJK
Test-bed
2008. 2 .20
Test-bed Ad-hoc Group
Norihiro FUKUMOTO, Hideaki YAMADA
KDDI (KDDI R&D Labs.)
Study Phases on the CJK Test-bed
Phase I: 2006 3rd/4th Quarter (Completed)
Network Connectivity
Scenario 2 and 4 only (2 CS and 2 domains)
Status Report during 8th CJK NGN Meeting (January 2007)
Phase II: 2007 1st/2nd Quarter (In Progress)
Scenario 1 and 3, (simpler version of 2 and 4, single domain)
Status Report at the 11th CJK NGN Meeting (February 2008)
We are here
-
-
Phase III: 2007 3rd/4th ~ 2008 1st/2nd Quarter
Scenarios 5 ~ 7
Performance Evaluation of RTP/RTCP-based passive measurement
(led by TTC)
Initial RACF Interoperability testing (led by TTA)
Status report will be provided at the 11th CJK NGN Meeting in 2008.2
Phase IV: 2008 3rd ~ 2009 2nd Quarter (Proposal)
Scenario IPTV Interoperability testing
Performance Evaluation of IPTV services based on RTP/RTCP-based passive
measurement
Continued RACF Interoperability testing
Testing of RACF and RTP/RTCP-based MPM Interactions
2
Test Scenarios
Scenario 1: Single Call Server within a single NGN Network Domain without PSTN
Scenario 2: Call Servers across multiple IP Network Domains without PSTN
Scenario 3: Single Call Server within a single NGN Network Domain with PSTN
Scenario 4: Call Servers across multiple NGN Network Domains with PSTN
Scenario 5: Call Servers across multiple NGN Network Domains with PSTN & Value
Added Services
Initial target
Scenario 6: Performance Evaluation with RTP/RTCP-based Measurement extension
Scenario 7: Call Servers across multiple NGN Network Domains with PSTN, Value
Added Services and RACF Involvement (to be confirmed at the 11th CJK Meeting)
3
Scenario 6 (& a part of 7) (Proposal)
Target Services
Voice/Audio stream (IP telephony)
Basic SIP based signaling
IMS based signaling
Video stream (e.g. IPTV)
unicast based sending
no signaling
multicast based sending
Basic SIP based signaling
IMS (+RTSP) based signaling
Entities Under Test
Cooperation with RACF (MPM application)
RTP translator based evaluation
PMP-FE, PME-FE (Mp, Mr)
RACF (MPM application)
PMR-FE (Mi)
2008 1Q~2Q
PMR-FE (Mu)
2008 3Q~4Q
2009 1Q~2Q
ready for tests
to be prepared
4
Basic Network Configuration in 2008 1Q~2Q
IMS CSCFs
CPE
(PC with RTP/RTCP
client software)
CPE
(PC with RTP/RTCP client
software)
CPE (RTP/RTCP
client appliance)
IMS CSCFs
CPE (RTP/RTCP
client appliance)
Korea
(ETRI Labs.)
China
(CATR Labs.)
established
MPM (Router with mirror
port and RTP translator)
MPM (Router with mirror
port and RTP translator)
IP networks
MPM (Router with mirror
port and RTP translator)
Japan
(KDDI R&D Labs.)
KDDI provides
Already prepared
IMS CSCFs
CPE
(PC with RTP/RTCP client
software)
CPE (RTP/RTCP
client appliance)
5
RTCP based Performance Evaluation Tests
Firstly, go forward with RTCP based performance evaluation tests
described in Y.mpm Appendix II
RTCP covers major metrics
0
7
BT=6
15
L DJ
ToH
31
0
7
BT=7
block length=9
rsvd.
15
reserved
loss rate
end_seq
round trip delay
dup_packets
signal level
min_jitter
R factor
max_jitter
noise level
ext. R factor
RX config
mean_jitter
reserved
JB nominal
dev_jitter
max_ttl_or_hl
discard rate
burst duration
lost_packets
min_ttl_or_hl
0
15
7
BT=N
block length=8
mean_ttl_or_hl
dev_ttl_or_hl
block length
SSRC of source
burst density
gap density
000
Program ID
Reserved
gap duration
Report Timestamp
end system delay
Measurement Interval (ms)
Gmin
Proportion Impaired I frames
Proportion Impaired BP frames
MOS-CQ
Loss rate within I frames
Loss rate within BP frames
JB nominal
Mean GoP Length (frames)
Max GoP Length (frames)
JB nominal
Mean Estimation MOS-V
Mean Estimated PSNR
MOS-V Threshold
Time below MOS threshold
EPSNR Threshold
Time below PSNR threshold
RERL
MOS-LQ
RTCP XR VoIP Metrics
RTCP XR Statistics Summary Metrics
31
Reserved
SSRC of source
SSRC of source
begin_seq
31
Mean Video bit rate (bits/sec)
Round trip delay
A-V Delay (Video I/F)
Playout Interrupt Count
Mean Playout Interrupt Size
Video Playout buffer size
Mean buffer level
loss related metrics
delay related metrics
RTCP XR Video Metrics
miscellaneous network performance metrics
QoE related metrics
CPE configuration metrics
6
Supported Report Blocks of RTCP
RTCP SR/RR (Sender/Receiver Report)
-
Defined in the IETF RFC 3550
-
Sender/receiver report, for basic
transmission and reception statistics
RTCP SR/RR
RTCP XR (eXtended Report)
-
Defined in the IETF RFC 3611
-
Extended reporting format to convey
information that supplements the statistics
that are contained in the report blocks used
in RTCP SR/RR
-
In particular, the VoIP metrics report block is
specified for voice applications
RTCP XR Video Metrics
-
Defined in the IETF Draft
-
Extensions to the RTCP XR to support the
monitoring of video over IP for IPTV and
videoconferencing endpoint reporting
Extend statistics and
VoIP metrics
RTCP XR
Support Video
over IP
RTCP XR Video
Metrics
Support higher
resolution for
Voice over IP
RTCP HR
RTCP HR (High Resolution)
-
Defined in the IETF Draft
-
Extensions to the RTCP XR to support Voice
over IP (VoIP) monitoring for services that
require higher resolution or more detailed
metrics
7
Test items
item 0: Performance evaluation on CPEs
-
CPEs evaluate performances and send them end-to-end
CPEs should support sending/receiving RTCP packets
item 1: Performance evaluation using single MPM
-
A MPM is enabled between CPEs
A MPM evaluate performances of the RTP stream
CPEs should also support receiving RTCP packets from MPMs
item 2: Performance evaluation using multi MPMs
-
Two (or more) MPMs are enabled between CPEs
MPMs send/append evaluated performances
CPEs should also support receiving multiplexed RTCP packets from
MPMs
8
An implementation of MPM
RTP translator including MPM
-
RTP translator includes the MPM and transport function (L3 switch)
-
PME-FE in MPM monitors RTP/RTCP packets to execute performance measurement
-
PMP-FE processes the performance analysis and aggregation
-
PMR-FE reports the measurement data to other MPMs via Mi reference point implemented
as additional RTCP
RTP translator
MPM
PMR-FE
Mi
Transport function
(L3 switch)
Additional RTCP
Segment X
CPE A
RTP/RTCP
Mi
Mr
PMP-FE
Mp
PME-FE
monitor RTP packets
Segment Y
CPE B
9
RTP Translator Sequence Diagram
(Voice over IP, the simplest model)
MPM (RTP Translator)
CPE A
CPE B
RTP
monitors RTP packets and evaluates
the performance of segment X
RTCP SR
RTCP SR
RTCP RR
RR header
Report Block (X)
SDES header
SDES chunk (ノードB)
XR header (PT=207)
XR Report Block BT=1~7) (X)
HR Header sub-block (X)
HR sub-blocks (X)
Segment X
SR header
Sender info
Report Block (X+Y)
SDES header
SDES chunk (Client B)
XR header (PT=207)
XR Report Block BT=1~7) (X+Y)
HR Header sub-block (X+Y)
HR sub-blocks (X+Y)
Segment Y
(*) Opposite direction is ommited
10
RTP Translator Sequence Diagram
(Video over IP, the simplest model)
CPE A
CPE B
MPM (RTP Translator)
RTP
monitors RTP packets and evaluates
the performance of segment X
RTCP SR
RTCP RR
RTCP RR
RR header
Report Block (X)
SDES header
SDES chunk (RTP Translator)
XR header (PT=207)
XR Report Block (BT=1~7) (X)
(XR Video Metrics (X))
HR Header sub-block (X)
HR sub-blocks (X)
Segment X
RR header
Report Block (X+Y)
SDES header
SDES chunk (Client)
XR header (PT=207)
XR Report Block (BT=1~7) (X+Y)
XR Video Metrics (X+Y)
HR Header sub-block (X+Y)
HR sub-blocks (X+Y)
Segment Y
11
RTP Translator Sequence Diagram
(Voice over IP, three segments, with multiplexing)
MPM A (RTP Translator)
CPE A
MPM B (RTP Translator)
CPE B
RTP
RTCP SR
RTCP SR
append
RTCP RR
RR header
Report Block (X+Y)
SDES header
SDES chunk (RTP Translator B)
XR header (PT=207)
XR Report Block BT=1~7) (X+Y)
HR Header sub-block (X+Y)
HR sub-blocks (X+Y)
RR header
Report Block (X)
SDES header
SDES chunk (RTP Translator A)
XR header (PT=207)
XR Report Block BT=1~7) (X)
HR Header sub-block (X)
HR sub-blocks (X)
Segment X
RR header
Report Block (X+Y)
SDES header
SDES chunk (RTP Translator B)
XR header (PT=207)
XR Report Block BT=1~7) (X+Y)
HR Header sub-block (X+Y)
HR sub-blocks (X+Y)
Segment Y
SR header
Sender info
Report Block (X+Y+Z)
SDES header
SDES chunk (Client B)
XR header (PT=207)
XR Report Block BT=1~7) (X+Y+Z)
HR Header sub-block (X+Y+Z)
HR sub-blocks (X+Y+Z)
Segment Z
(*) Opposite direction is ommited
12
Next Steps
Preparation for RACF interoperability testing and Phase IV testing
(IPTV, RACF and MPM testing)
Test-case specification
System setup
Testing scenarios
Budget support for the additional testing by each SDO
Finding collaboration opportunities with other related Testing Programs
(e.g., BcN test-bed, KDDI test-bed)
Miscellaneous configurations for performance evaluation of RTP/RTCP-based
passive measurement
-
Codecs


-
VoIP: G.711u-Law, G.729A
Video/Audio: H.264 MPEG-4 AVC + MPEG-2 AAC
RTP payload format

Video and audio streams are sent over different RTP sessions
13
Implementation examples of MPM and CPE
14