Transcript 31012030r1 TR30_3_Liaison_to_ITU

TD 435rev1 (GEN/12)
INTERNATIONAL TELECOMMUNICATION
TELECOMMUNICATION
STANDARDIZATION SECTOR
January 18-27, 20110
English only
STUDY PERIOD 2009-2012
Original: English
Question(s):
Q13, Q14 and Q17
Source:
Title:
STUDY GROUP 12
Chairman TIA TR30.3 Subcommittee
Updated Liaison presentation from TIA TR30.3 concerning proposed revision of G.1050
ABSTRACT
As indicated in liaison presentations to SG12 over the last 2 years, TIA TR30.3 has been working on a proposed new revision to TIA-921
(Project: PN-3-0062-RV2) and the ITU-T version of the document G.1050, Network Model for Evaluating Multimedia Transmission
Performance Over the Internet Protocol.
TIA TR30.3 has now completed this work and has prepared a draft of TIA-921-B for TIA ballot. TR30.3 has also prepared a harmonized
draft of ITU-T G.1050 Revised. TR30.3 and submits this draft document as a liaison to the upcoming Q13/12 meetings in Geneva. We
request comments and feedback during the session of the attached draft of G.1050 Revised with a goal of achieving possible consent
during January session.
As Chairman of TR30.3, I am submitting the proposed revision to G.1050 and electronic attachments for review and consideration by SG12
Question 13 as an update to Recommendation G.1050 at the January2011 meetings in Geneva. TIA TR-30.3 has approved submitting this
document and associated materials to ITU-T SG12.
This presentation provides an overview of the proposed revision of G.1050 and electronic attachments.
Contacts
Jack Douglass, Chairman TIA TR30.3
PacketStorm Communications
Tel: +1 949-436-0663 C
Email: [email protected]
Chip Webb
Anue System, USA
Tel: +1 512-600-5403
Email: [email protected]
Les Wu
Alcatel-Lucent, USA
Tel: +1 (908) 582-4964
Email: [email protected]
Attention: This is not a publication made available to the public, but an internal ITU-T Document intended only for use by the Member States of ITU, by ITU-T
Sector Members and Associates, and their respective staff and collaborators in their ITU related work. It shall not be made available to, and used by, any other
persons or entities without the prior written consent of ITU-T.
Proposed Revision to G1050
Network Model for Evaluating Multimedia
Transmission Performance over the
Internet Protocol
Liaison to ITU-T SG12 – Q13, Q14, Q17
TIA TR30.3 Committee
Jack Douglass, Chairman, TIA TR30.3
PacketStorm Communications
January 18 to 27, 2011
Agenda
o
o
o
o
o
o
o
o
o
o
o
o
o
G.1050-2007 / TIA-921A
Summary of Changes from G.1050 (2007)
Proposed G.1050 Revision
IP Network Simulation Source Code
IP Network Simulation
Network Models: Core, Core to LAN, LAN to LAN
Impairment Combination Tables
Inputs to IP Network Simulation
IP Network Simulation Outputs
Electronic Attachment
Possible Uses for IP Network Impairment Simulation
Future TIA-921/G.1050 Work
Requests for SG12
Summary of Changes from G.1050 (2007)
o Proposed revision to G.1050 replaces G.1050 (2007)
o G.1050 (2007)
 Gilbert-Elliott mathematical model that fit certain observed network behavior but
was not easily extended to other scenarios
o Revised G.1050 – Provide more realism than the earlier version
 Discrete Event Simulation
 Models the mechanisms using that contribute to packet delay, jitter, and loss:
interfering streams, queue delays in network elements, and the characteristics of
specific access technologies.
 Greatly reduce the number of standard test cases (43 test cases)
 True bidirectional model
 Removed LOO “likelihood of occurrence” concept
 Impairment levels are updated to keep current with evolving IP networks
 Users can customize test cases to fit their specific needs
ITU-T G.1050 and TIA-921
Test Profiles based on ITU-T Y1541
Different test profiles for different Service Level Agreements (SLAs)
Impairment Type
Units
Profile A
Well-Managed
Range (min to max)
Profile B
Partially-Managed
Range (min to max)
Profile C
Unmanaged
Range (min to max)
One Way Latency
ms
20 to 100 (regional)
90 to 300 (intercontinental)
20 to 100 (regional)
90 to 400 (intercontinental)
20 to 500
Jitter (peak to peak)
ms
0 to 50
0 to 150
0 to 500
Sequential Packet Loss
ms
Random loss only (except
when link failure occurs)
40 to 200
40 to 10,000
Rate of Sequential Loss
sec-1
Random loss only (except
when link failure occurs)
< 10-3
< 10-1
Random Packet Loss
%
0 to 0.05
0 to 2
0 to 20
Reordered Packets
%
0 to 0.001
0 to 0.01
0 to 0.1
ITU-T G.1050-2007 and TIA-921A
Network Topologies
DUT
A
LAN A
LAN Rates
----------------Occupancy level
Packet loss
Local
Access
A
Core IP
Network
Route flapping
Local
Access
B
LAN B
Access Rates
Link Failures
Access Rates
LAN Rates
----------------
One-way delay
----------------
-----------------
Occupancy level
Jitter
Occupancy level
Occupancy level
Qos Edge Router
Packet loss
Qos Edge Router
Packet loss
Packet Reorder
LAN-to-LAN IP Network Model
DUT
A
Core IP
Network
Route flapping
Local
Access
B
LAN B
Link Failures
One-way delay
Access Rates
LAN Rates
Jitter
----------------
-----------------
Packet loss
Occupancy level
Occupancy level
Packet Reorder
Qos Edge Router
Packet loss
Core-to-LAN
DUT
B
DUT
B
ITU-T G.1050-2007 and TIA-921A
Impairment Severity Table
LAN / Access Rate Tables
1344 General Model
120 Core to LAN ≤ 3 Mbit/s
48 Core to LAN > 3 Mbit/s (IPTV)
IP Impairment Combinations (Delay and Loss)
Proposed G.1050 Revision
o G.1050 proposed update to Recommendation
 Proposed ITU-T G.1050 Revised Recommendation
harmonized with draft of TIA-921 Ballot
 Request comments and feedback during the session
 Achieve possible consent during January session
o Electronic Attachments
 C++ Source Code and Related Files
 Simulator Inputs, Outputs and Results
IP Network Model Simulation
Source Code
o C++
 Windows XP / 7: Cygwin 1.7
 Linux: OpenSUSE 11.3 (i386), Fedora 9
o Other Linux and Windows Tools
 TCL Versions 8.4 and 8.5
 Perl 5.10
 GNUPlot 4.4
o Simulation environment running on PC
 Sample data, voice, video or audio PCAP files can be run through the
model and captured the output as PCAP files for analysis and
comparison
o The Software Copyright Holder (Anue Systems) will grant a free
license based on Option 1.3 of ITU Software Copyright Statement
and Licensing Declaration – Form has been filed
IP Network Model Simulation
o General purpose discrete Event Simulator
o Event Models simulate Network Elements






Switches
Routers
Access Technologies
Firewalls
Buffers
Connections via wires
o Types of Events for Network Elements
 Packet Arrival
 Packet Departure
 Other types of events are also possible
Model Basic IP Network Element
Third Interferer
Second Interferer
Interfering Stream
Generator
Test Stream Input
to This Stage
Store
and
Forward
Link
Latency
+
Packet Priority
Queues with Loss
Test Stream Output
from This Stage
Disturbance
Packets
CORE Simulation Model
1 Gbit/s
1 Gbit/s
# Switches
Queue
Delay
Reorder
Interfering
Streams
(pcap files)
Interfering
Streams
(pcap files)
Core Network
Test
Stream
Test
Stream
CORE-to-LAN Simulation Model
Interfering
Streams
(pcap files)
Interfering
Streams
(pcap files)
Core Network
Test
Stream
1 Gbit/s
Access Network
Test
Stream
LAN-to-LAN Simulation Model
Interfering
Streams
(pcap files)
Access
Network
1 Gbit/s
Core Network
Test
Stream
Interfering
Streams
(pcap files)
1 Gbit/s
Interfering
Streams
(pcap files)
Core Network
1 Gbit/s
Access
Network
Interfering
Streams
(pcap files)
Test
Stream
Well Managed Network
Well Managed
Network
Element
Core
Impairment / Interferer
PCAP Avg BW
(Mb/s)
Number of Switches
Total Core Link Delay (ms)
Access Rate Down (Mbit/s)
Access Rate Up (Mbit/s)
Residual BER
Managed Bandwidth
IPTV HD Stream 1 - CBR (qty)
IPTV HD Stream 2 - VBR (qty)
IPTV SD Stream 1 - CBR (qty)
IPTV SD Stream 2 - VBR (qty)
VoIP/Fax (qty)
Residual Bandwidth
Peer-to-peer Rate Down
Peer-to-peer Rate Up
HTTP Rate Down
HTTP Rate Up
OTT1 Rate Down
OTT1 Rate Up
OTT2 Rate Down
OTT2 Rate Up
VoIP/Fax Rate Down
VoIP/Fax Rate Down
w2
3
10
Access (pick one technology)
GPON
Access Rate Down (Mbit/s)
Access Rate Up (Mbit/s)
Residual BER
DSL
w1
w3
w4
4
25
5
50
50
50
25
25
1.E-12 1.E-12
33
33
3
3
1.E-08 1.E-08
w5
6
75
w6
w7
w8
7
85
8
100
9
125
10
150
35
25
1.E-11
35
25
25
25
1.E-10 1.E-10
25
25
1.E-09
25
15
25
5
1.E-09 1.E-09
33
3
1.E-08
22
16
2
1
1.E-08 1.E-07
16
1
1.E-07
16
10
1
1
1.E-07 1.E-07
(QoS Voice=1
Video=2)
8
8
2
2
0.064/0.064
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
100%
100%
100%
100%
100%
100%
100%
100%
1
1
1
1
1
1
100%
100%
100%
100%
100%
100%
100%
100%
QoS = 7
1.89
0.285
1.58
0.66
6.678
0.099
2.66
0.051
0.064
0.064
Partially Managed Network
Partially Managed
Network
Element
Core
Impairment / Interferer
PCAP Avg BW
(Mb/s)
Number of Switches
Total Core Link Delay (ms)
Access Rate Down (Mbit/s)
Access Rate Up (Mbit/s)
Residual BER
Managed Bandwidth
IPTV HD Stream 1 - CBR (qty)
IPTV HD Stream 2 - VBR (qty)
IPTV SD Stream 1 - CBR (qty)
IPTV SD Stream 2 - VBR (qty)
VoIP/Fax (qty)
Residual Bandwidth
Peer-to-peer Rate Down
Peer-to-peer Rate Up
HTTP Rate Down
HTTP Rate Up
OTT1 Rate Down
OTT1 Rate Up
OTT2 Rate Down
OTT2 Rate Up
VoIP/Fax Rate Down
VoIP/Fax Rate Down
p2
3
10
Access (pick one technology)
GPON
Access Rate Down (Mbit/s)
Access Rate Up (Mbit/s)
Residual BER
DSL
p1
p3
4
25
p4
5
50
p5
8
75
p6
10
100
12
200
35
35
25
35
15
25
1.E-12 1.E-12 1.E-11
15
5
5
2
1.E-09 1.E-09
15
5
1.E-09
24
18
12
3
1.5
1.5
1.E-08 1.E-07 1.E-07
6
3
1
1
1.E-06 1.E-06
6
1
1.E-06
(QoS Voice=1
Video=2)
8
8
2
2
0.064/0.064
1
1
1
1
1
1
1
1
1
1
1
1
0
1
1
1
1
1
50%
135%
100%
50%
25%
135%
40%
50%
20%
135%
20%
60%
25%
135%
40%
50%
100%
100%
100%
100%
100%
100%
10%
135%
10%
10%
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
QoS = 7
1.89
0.285
1.58
0.66
6.678
0.099
2.66
0.051
0.064
0.064
Unmanaged & Core Network
Unmanaged
Network
Element
Core
Impairment / Interferer
PCAP Avg BW
(Mb/s)
Number of Switches
Total Core Link Delay (ms)
Access Rate Down (Mbit/s)
Access Rate Up (Mbit/s)
Residual BER
Managed Bandwidth
IPTV HD Stream 1 - CBR (qty)
IPTV HD Stream 2 - VBR (qty)
IPTV SD Stream 1 - CBR (qty)
IPTV SD Stream 2 - VBR (qty)
VoIP/Fax (qty)
Residual Bandwidth
Peer-to-peer Rate Down
Peer-to-peer Rate Up
HTTP Rate Down
HTTP Rate Up
OTT1 Rate Down
OTT1 Rate Up
OTT2 Rate Down
OTT2 Rate Up
VoIP/Fax Rate Down
VoIP/Fax Rate Down
u2
3
10
Access (pick one technology)
GPON
Access Rate Down (Mbit/s)
Access Rate Up (Mbit/s)
Residual BER
DSL
u1
4
25
u3
5
50
u4
Core
u5
8
75
10
100
u6
12
200
u7
c1
15
250
3
150
35
35
25
15
5
15
5
35
15
25
5
2
5
2
1.E-12 1.E-12 1.E-11 1.E-09 1.E-09 1.E-09 1.E-09
1000
1000
1.E-12
24
18
12
6
3
6
3
3
1.5
1.5
1
1
1
1
1.E-08 1.E-07 1.E-07 1.E-06 1.E-06 1.E-06 1.E-06
1000
1000
1.E-12
(QoS Voice=1
Video=2)
8
8
2
2
0.064/0.064
10
10
10
10
10
QoS = 7
1.89
0.285
1.58
0.66
6.678
0.099
2.66
0.051
0.064
0.064
100%
100%
200%
200%
100%
100%
10%
135%
10%
10%
100%
100%
200%
200%
100%
100%
50%
135%
100%
50%
25%
135%
40%
50%
20%
135%
20%
60%
25%
135%
40%
50%
20%
135%
20%
60%
200%
200%
100%
100%
100%
100%
100%
100%
50%
50%
100%
100%
100%
100%
100%
100%
50%
50%
100%
100%
1000%
2000%
1000%
1000%
500%
500%
500%
500%
1000%
1000%
Inputs to Network Simulation
Network / Interferer PCAPs
o Network / Interferer Traffic
 IPTV Video, VoIP, Over-the-Top Video, Peer-to-Peer, HTTP, FoIP
 Standard PCAPs or user provided PCAPs
o PCAP – Packet Events drive Discrete Events Simulator
 Packet size
 Packet Timestamps
o PCAP Payload
 Payloads if present in the PCAP are carried through the simulator.
Input PCAP File Characteristics
QoS
PCAP File
2 HD_cbr
2 HD_vbr
2 SD_cbr
2 SD_vbr
7 OTT1_Down
7 OTT1_Up
7 OTT2_Down
7 OTT2_Up
7 P2P_Down
7 P2P_Up
7 HTTP_Down
7 HTTP_Up
7 ipfax_v34_t38_fwd
7 ipfax_v34_t38_rev
1 voip_g729_fwd
1 voip_g729_rev
Data Size
275756340
196918938
274844350
197616080
119929381
1777873
110344529
2100467
34546941
5412102
27377604
1451588
53619
31376
603120
602784
Packets Duration
201282
143737
200617
144246
79619
32832
73522
36356
30000
25500
20000
15000
278
156
7180
7176
142
142
285
285
144
144
331
332
147
152
138
176
49
46
215
215
Date
05/03/10
05/03/10
05/04/10
05/04/10
12/07/09
12/07/09
09/25/10
09/25/10
09/09/09
09/09/09
12/31/69
12/31/69
10/12/09
10/12/09
01/22/10
01/22/10
Time
23:50:12
23:34:54
1:03:49
1:14:50
18:47:41
18:47:41
11:32:07
11:32:07
21:32:08
21:32:07
19:00:24
19:00:26
11:17:46
11:17:49
14:38:24
14:38:24
Avg Pkt Packet
Avg Bitrate 5s peak 1s peak
Description
Size
Rate
1370
1419 15555964 15558816 15574160 High Definition IPTV Flow, Constant Bit Rate
1370
1014 11112049 13112544 18555280 High Definition IPTV Flow, Variable Bit Rate
1370
703
7702130 7704880 7715840 Standard Definition IPTV Flow, Constant Bit Rate
1370
507
5553410 6608880 8789920 Standard Definition IPTV Flow, Variable Bit Rate
1506
554
6678690 7160352 7327760 Progressive Downloaded Over-The-Top High
54
229
99008 115257 121824 Definition Video
1501
222
2662988 12364163 13938272 Adaptively Streamed Over-the-Top Standard
58
110
50663 229643 272608 Definition Video
1152
205
1885957 3261356 3903608
Peer-to-Peer File Download and Sharing
212
168
285154 530008 703416
1369
145
1582495 2167475 4646512
Web Browser Transactions
97
85
65997
89577 193624
193
6
8809
50820
88000
Fax-over-IP
201
3
5468
45320
85600
84
33
22406
22444
22848
G.729 Voice-over-IP
84
33
22403
22444
22848
Input PCAP Files
Managed Bandwidth Characteristics
IPTV HD
IPTV SD
VoIP
Input PCAP Files
Residual Bandwidth Characteristics
Progressive Download
(OTT1)
HTTP
Adaptive Streaming
(OTT2)
Peer-to-Peer
FoIP
Aggregate Bandwidth Characteristics
Dp Series Tests
18000000
20000000
16000000
18000000
Aggregate BW (bits/s)
Aggregate BW (bits/s)
Dw Series Tests
14000000
12000000
10000000
8000000
6000000
4000000
16000000
14000000
12000000
10000000
8000000
6000000
4000000
2000000
2000000
0
0
0
60
120
180
240
300
360
420
480
540
0
600
60
120
180
240
Dw1
Dw2
Dw3
Dw4
Dw5
Dw6
Dw7
Dp1
Dw8
Well Managed
360
420
480
540
600
Dp2
Dp3
Dp4
Dp5
Dp6
Partially Managed
Du Series Tests
Aggregate Core Bandwidth
25000000
600,000,000
20000000
500,000,000
400,000,000
15000000
bits/s
Aggregate BW (bits/s)
300
sec
sec
10000000
300,000,000
200,000,000
5000000
100,000,000
0
0
60
120
180
240
300
360
420
480
540
600
0
0
sec
15
30
sec
Du1
Du2
Du3
Du4
Du5
Unmanaged
Du6
Du7
Core
45
Simulation Outputs
o Output and Result files





.out (CSV)
Time Series of Packet Loss and Delay
Packet Delay Variation (PDV) Histogram
Cumulative Distributive Functions (CDF)
Summary of results
o Output PCAPs
 Analysis of impaired packets can be performed if
payload is included.
.out File (CSV)
Example: HDTV1 / DSL / Well Managed Network
Description:
Content-Encoding :
Delay Unit:
Set Top Box #1 IPTV Downstream
ASCII
ms
Time
Delay
5
5.028805447
5.030184825
5.031562257
5.032941634
5.034321012
5.035698444
5.037077821
5.038455253
5.03983463
5.041214008
5.04259144
5.043970817
5.045350195
5.046727626
5.048107004
5.049486381
5.050863813
5.052243191
5.053620623
Drop
27.84455091
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
27.50758121
0
0
0
0
0
0
0
0
1
1
0
0
0
0
0
0
0
0
1
0
.out File Time Series of Packet Loss and Delay
Example: HDTV1 / DSL / Well Managed Network
Dw1
Dw2
Dw3
Dw4
Dw5
Dw6
Dw7
Dw8
.out File PDV Histograms
Example: HDTV1 / DSL / Well Managed Network
Dw1
Dw2
Dw3
Dw4
Dw5
Dw6
Dw7
Dw8
.out File PDV Histograms and CDFs
Example: HDTV1 / DSL / Well Managed Network
Simulation Results Summary
Example: HDTV1/ DSL / Well Managed Network
Number
of
Min
Packets Delay
Max
Delay
HDTV1_Down
434003
12.50
13.97
47
Dw2
HDTV1_Down
433993
27.51
29.31
Dw3
HDTV1_Down
433970
52.52
Dw4
HDTV1_Down
433944
Dw5
HDTV1_Down
433522
Dw6
Test
Case
File Name
Dw1
Drop Seq
(Loss) Loss
drop %
(Loss)
seq %
(Loss)
max-min
(Jitter)
0
0.011%
0.000%
1.47
47
0
0.011%
0.000%
1.81
67.52
52
0
0.012%
0.000%
15.01
77.70
106.95
59
0
0.014%
0.000%
29.25
87.89
94.71
474
2
0.109%
0.000%
6.82
HDTV1_Down
433541 102.90
153.04
444
8
0.102%
0.002%
50.14
Dw7
HDTV1_Down
433486 127.92
178.05
481
8
0.111%
0.002%
50.14
Dw8
HDTV1_Down
433491 153.34
164.97
456
2
0.105%
0.000%
11.63
.pcap file
Example: HDTV1 (Payloads Truncated)
.out File (CSV)
Example: SDTV2 / DSL / Well Managed Network
Description:
Content-Encoding :
Delay Unit:
Set Top Box #3 IPTV Downstream
ASCII
ms
Time
Delay
5
5.084155125
5.213908587
5.300238227
5.429842105
5.516254848
5.64598892
5.732518006
5.818867036
5.948515235
6.034911357
6.12133241
6.251094183
6.380631579
6.467027701
6.596878116
6.683282548
6.769584488
6.899157895
6.985570637
Drop
53.27604133
53.15206458
53.09975333
53.09975333
53.97893607
53.09975333
53.09975333
53.98514513
53.09975333
53.09975333
53.09975333
54.01707403
53.62069871
53.09975333
53.09975333
53.09975333
53.09975333
53.14577862
53.2229226
53.09975333
0
0
0
0
1
0
0
0
0
0
0
0
0
1
0
0
0
1
0
0
.out File Time Series of Packet Loss and Delay
Example: SDTV2 / DSL / Partially Managed Network
Dp1
Dp2
Dp3
Dp4
Dp5
Dp6
.out File PDV
Example: SDTV2 / DSL / Partially Managed Network
Dp1
Dp2
Dp3
Dp4
Dp5
Dp6
.out File PDV Histograms and CDFs
Example: SDTV2 / DSL / Partially Managed Network
Simulation Results Summary
Example: SDTV2/ DSL / Partially Managed Network
Number
of
Min
Packets Delay
Max
Delay
SDTV2_Down
110327
12.62
15.45
12
Dp2
SDTV2_Down
110207
27.78
45.76
Dp3
SDTV2_Down
110196
53.10
Dp4
SDTV2_Down
109015
Dp5
Dp6
Test
Case
File Name
Dp1
Drop Seq
(Loss) Loss
drop %
(Loss)
seq %
(Loss)
max-min
(Jitter)
0
0.011%
0.000%
2.83
129
0
0.117%
0.000%
17.98
119.95
134
0
0.121%
0.000%
66.85
79.05
213.13
1309
69
1.186%
0.063%
134.09
SDTV2_Down
108813 105.89
375.24
1505
168
1.364%
0.152%
269.35
SDTV2_Down
109009 204.09
338.18
1288
49
1.168%
0.044%
134.09
.pcap file
Example: SDTV1 (With Payload)
.out File Time Series of Packet Loss and Delay
Examples: Managed Bandwidth
HDTV2
HDTV1
SDTV2
SDTV1
VoIP
.out File PDV Histograms
Examples: Managed Bandwidth
HDTV1
HDTV2
SDTV1
SDTV2
VoIP
.out File Time Series of Packet Loss and Delay
Examples: Residual Bandwidth
OTT1
OTT2
Peer-to-Peer
HTTP
FoIP
.out File PDV Histograms
Examples: Residual Bandwidth
OTT1
OTT2
Peer-to-Peer
HTTP
FoIP
Electronic Attachment











ISO 9660 format file that is downloadable from the ITU web site
Part of the Recommendation
Simulation Code – C++ Code
G.1050 Document (PDF)
Input PCAP files (without payloads)
TCL files for 43 Test Case scenarios
.out files
Output PCAPs
PNGs
Results Summary (.csv)
Impairment Combination Table
Possible Uses for
IP Network Impairment Simulation
o Simulate Real-World IP network impairments
 PDV Histogram and Packet Loss characteristics
o Test any type of IP stream(s) (PCAP) under simulated
network conditions
 Standard Test Cases or user define simulated network
conditions
 Test with or without payload
 Capture output PCAP for analysis and comparison
o Test any type of IP stream using Hardware Emulation of
simulated network model
 Standard Test Cases or user define simulated network
conditions
Example CORE-to-LAN Simulation
QoS
Test Stream(s)
2
HD VBR IPTV
Interferers
Bandwidth
MOS Calculated
from captured PCAP
Interferers
PDV & Loss
QoS
1
VoIP Down
2
HD CBR IPTV
2
SD VBR IPTV
7
HTTP
7
OTT1
7
OTT2
Interfering Stream(s)
Example MOS Calculation Derived
from Simulation Output PCAP
Simulation Output PCAP
Description:
Content-Encoding :
Delay Unit:
Dw4-HDTV1
ASCII
ms
Time
Delay
21.33439
21.33571
21.33703
21.33835
21.33967
21.34099
21.34363
21.34363
21.34495
77.69556
77.69556
78.00174
77.69556
77.69556
77.69556
77.69556
77.69556
77.69556
Drop
0
0
0
0
0
0
1
0
0
Simulation .out Packet Delay and Loss
Characteristic can be used to cause
impairments on test streams
Video Stream Analysis:
=============================================
Stream source:
192.168.69.110:49713
Stream destination:
234.5.6.101:2345
Stream duration:
00:09:59.936
Stream CODEC:
H.264
Stream transport:
RTP (SSRC=0x11223344)
Stream transport:
MP2TS (PID=481, Ctrl=0x0000)
Packet counts:
received
2469009
lost
649 (0.00026)
discarded
819 (0.00032)
out-of-seq
6 (0.00000)
duplicate
0 (0.00000)
corrected
0 (0.00000)
MOS-V (min/avg/max/inst):
MOS-AV (min/avg/max/inst):
2.74/3.93/4.56/3.19
2.89/3.82/4.32/3.29
Captured output PCAPs can be use to
analyze and compare competing algorithms
Example MOS V Plots Derived
from Simulation Output PCAP
MOS V (1s Intervals) for HDTV (CBR) Well Managed DLS 1 to 8
MOS V (1s Intervals) for SDTV (VBR) Partially Managed DLS 1 to 6
Hardware Emulation from
IP Network Simulation
Device Under Test A
(Video Server)
Video Stream
•
•
•
Device Under Test B
(Video Client STB)
Impairment Emulator
(.out files)
Select a standard test case
that includes a technology
similar to the test stream
Configure the emulator with
the standard .out file for the
selected test case
Run the test stream through
the emulator, and evaluate
the effect of the network
impairments on the stream
Video Stream
Description:
Content-Encoding :
Delay Unit:
Dw4-HDTV1
ASCII
ms
Time
Delay
21.33439
21.33571
21.33703
21.33835
21.33967
21.34099
21.34363
21.34363
21.34495
77.69556
77.69556
78.00174
77.69556
77.69556
77.69556
77.69556
77.69556
77.69556
Drop
0
0
0
0
0
0
1
0
0
Advanced Use of the Network Model
User-Defined Test Cases
o Replace any of the standard interferer
pcap files with user interfere pcap files
o Change the traffic mix
o Change network conditions




number of switches
bit error ratio
access technology parameters,
etc.
Future TIA-921/G.1050 Work
o Active Network Emulation using Interferer
PCAP files
o Add Cable Access Characteristics
o Add Wireless Access Characteristics
o Update as IP Network evolves
Requests to SG12
o Provide comments and feedback on
G.1050 Revised during session
 Document
 Simulation and Results
 Electronic Attachments
o Consider possible Consent of G.1050
Revised during the January session