Transcript Testing SIP Services Over IP

Testing SIP Services Over IP
Agenda
 SIP testing – advanced scenarios
 SIP testing - Real Life Examples
Test Equipment Requirements
SIP Testing – the basics
 Call simulation
 Call monitoring


Signaling analysis
Media analysis
 Conformance testing
 Load (stress) generation
Advanced SIP Testing
 Advanced testing




 For complex scenarios:
Benchmarking
Performance
Media degradation
Envelope determination





 In terms of a large network…
Many users
Many call flows
Different codecs
Different networking configuration
NAT, Firewall…
Stress Testing??
 Aimed at determining the operational envelope:



Network elements
Service
Certain concept / design
 Why stress test:


Vendors: want to determine performance figures before
shipping
Service Providers: want to find the problems in the lab
Stress Testing!
Not just “number of calls”
 Emulate a network wide environment:



Large number of users
Many network elements (IPs)
Emulate NAT
 Excessive call load
 Many profiles / scenarios
 Many different services
What are we looking for
 Predicting the element behavior in real life:
 How does the UUT (network element / service)
behave in real life (=stress…)
 Where is the “breaking point”
 What happens at the “breaking point”


How are new / existing calls affected?
Is the media degraded?
Stress Factors





Basic call flows (signaling)
RTP streams
Media type (Video, Audio)
Advanced call flows
SIP services
Signaling Stress Requirements
 Generate and respond to SIP service requests
 Simulate User Agent Client / Server communication
procedures (RFC 3261)
 Emulate behavior of one or many SIP phones

different signaling and media parameters for each
Registration Rate
 True emulation of user behaviour

Generate calls only when registered
 Mega-blast generation of registration events
 Full configuration of SIP registration procedures

Mimic real user behaviour
Advanced Testing Requirements (1)
 Multiple users

100,000’s UACs

Configurable groups each with different behavior profiles
 Multiple IPs

1000s of IPs - both media and signaling
 Multiple MACs
 Multiple VLANs
Advanced Testing Requirements -- 2




Full SIP message customization
Video generation
DTMF generation
Different call flows:

Hold, Consultation Hold, Music on Hold,
3-way Conference, Call redirect, Call reject…
 Erroneous flows
Key Traffic Generation
Measurements
 Session success rates and GoS
 SIP method count and response code
 Registration history
 Presence and IM message statistics
 Incoming and outgoing RTP stream counters
Real Life Examples
Common pitfalls
 Registration properties

Tendency to forget the credentials
 Registration rates


Initially takes too long
Server will not withstand load
 Non-standard flows
 Test signaling & media simultaneously
Network Model: Simple Test Lab
Analog call generator
Call
Analysis
IP / ATM / FR
Core 2
UUT
SIP Stress
Generator
Call
Analysis
Core 1
UUT
Test Environment:
•Multi-service solution
•Multi-technology: VoIP & PSTN
SIP Stress
Generator
Network Model: Simple Test Lab (cont.)
 SIP Stress Generator:


Generate different levels of stress including RTP
Voice and video simulation
 Call Analysis:



Signaling and media analysis
Voice quality (intrusive, non-intrusive and subjective)
RTP transport streams
 Analog Call Generator


Connect to PSTN interfaces
Measure voice quality, voice distortion
Testing Options
 Performance - under different levels of stress:



Signaling and media quality evaluation
Call handling
Media degradation
 Interoperability


Different codec models
PSTN and VoIP devices
 Reliability


Quality evaluation
Stability testing
Firewall, SBC, CSCF Testing
Call
Analysis
Call
Analysis
Test bed 1
Soft-Switch
Test bed 2
Soft-Switch
Public IP
SIP Stress
Generator
Session
Boarder
Controller
Session
Boarder
Controller
SIP Stress
Generator
SP1
 Load scenarios



SP2
BHCA
– 1,000,000s per hour
CPS
– hundreds to thousands
Concurrent calls > 100,000s
SIP Stress
Generator
Firewall, SBC & CSCF: Test Lab
 SIP Stress Generation requirements:




Different
Different
Different
Different
levels of stress
services
media
call flows
 QoS analysis:


Voice quality
Transport
Firewall, SBC & CSCF: Testing Needs
 QoS

Delays, Jitter, Packet loss, MOS
 Stability (network elements / services)
 Benchmarking and comparisons
Simultaneous test bed operation
Test Bed 1
Traffic Simulator
Traffic Simulator
Test Bed 2
Traffic Simulator
Traffic Simulator
Test Bed 3
Traffic Simulator
Traffic Simulator
Elegant solution
VLAN1
VLAN2
Traffic
Generator
Test Bed 2
VLAN
switch
VLAN3
Traffic
Generator
Test Bed 1
Test Bed 3