Transcript Analyse Assure Accelerate

Analyse
Assure
Testing WCDMA mobiles
under real-life network
conditions
Rev 2.12
Accelerate
TM
Agenda
• Spirent Communications Overview
• Spirent WCDMA Test Solutions Overview
• Operator Challenges and Solutions

WCDMA vs GSM

Beyond Minimum Conformance Testing

Real-life UE test requirements

Fully automated testing with no scripting

Inter-Operability Testing

Applications and Services Testing
• Summary
Analyse
Assure
TM
Accelerate
Analyse
Assure
Spirent Communications
Overview
Accelerate
TM
Who We Are… The Value We Add
• Spirent Communications is a
worldwide provider of
integrated performance
analysis and service assurance
systems for next-generation
network technologies
Analyse
Assure
TM
Accelerate
Spirent Business Portfolio
LSE / NYSE Listed
Spirent plc 2004 revenue: £475 million ($870 million)
Spirent Communications
Performance Analysis
Solutions Division
Network Products
Service Assurance
Solutions Division
Broadband
Wireless and Positioning
Analyse
Assure
TM
Accelerate
Systems
Broadband
Field Test
Spirent Communications
• One of the top 3 global
telecom test companies
• 1,700 employees worldwide
• £252 million ($460 million)
in annual revenue (2004)
• Headquartered in Rockville,
Maryland, USA
• Parent company: Spirent plc
 LSE: SPT / NYSE: SPM
• More than 1,500 customers
worldwide
Analyse
Assure
TM
Accelerate
Spirent Wireless & Positioning
Spirent is a key contributor to industry standards:
• GCF
• UMTS

3GPP
• RAN 4
• RAN 5
• GERAN 3


SG
CAG
• Others



PTCRB
OMA
Ad-hocs
• CDMA


CDG. Member since 1996
3GPP2. Chair of (IS-2000) Signaling Conformance
Working Group
Analyse
Assure
TM
Accelerate
Enabling 3G Success - In Practice
Leading Carriers
Leading Test Houses
Analyse
Assure
TM
Accelerate
Analyse
Spirent WCDMA Test
Solutions Overview
Assure
Accelerate
TM
Spirent WCDMA Test Solutions
• U-ATS fully-automated Conformance Testing and
Performance Analysis System

TS 34.121 RF and RRM conformance testing

UE performance characterization
• AirAccess WCDMA network emulator

Real-time state machine

6 cells

GSM capability for inter-RAT handover testing
Analyse
Assure
TM
Accelerate
Spirent U-ATS
A WCDMA test
solution which
addresses the needs
of both conformance
and performance
testing markets
A single turnkey system that can provide both RF, RRM and HSDPA
conformance and performance testing
Unique
Attributes
Multi Region (Operating Band) test system (I, II, V and VI)
#1 in validated tests available for Region 2
Provides a wide variety of performance and automation tools for quick
and easy UE benchmarking
Analyse
Assure
TM
Accelerate
U-ATS Performance features
• Flexibility to create a wide variety of user-defined real
world tests for UE benchmarking:

Ability to adjust and vary parameters, levels and test criteria

Characterize UE performance over a sweep of parameters (sweep
to graph feature for each test)

Ability to seek and identify performance breakpoints using
characterization tests
• Industry leading automation capability for easy UE
benchmarking

UE remote control

External equipment control

Fine tuning of execution parameters
Analyse
Assure
TM
Accelerate
Analyse
Assure
Operator Challenges and
Solutions
WCDMA is not GSM!
Accelerate
TM
WCDMA is not GSM!
Most operators deploying 3G networks have a
strong GSM background
• GSM cells have a fixed capacity

GSM mobiles do not impact network capacity or other
users
• WCDMA cells have a variable capacity

A badly-performing WCDMA mobile adversely impacts
cell capacity and the experience of other users
Analyse
Assure
TM
Accelerate
WCDMA is not GSM!
• In order to successfully deploy 3G networks and
services it is vital to ensure that network
performance is not impaired by poor mobile
performance
• The only way to do this is thorough mobile
performance analysis – way beyond minimum
34.121 conformance testing!
Analyse
Assure
TM
Accelerate
Analyse
Assure
Operator Challenges and
Solutions
Going Beyond Minimum
Conformance Testing…
Accelerate
TM
Beyond Minimum Conformance …
Challenge: A traditional validated Conformance Test System
must be “locked” & inflexible for Conformance testing…
… of little use in characterizing UE performance under real
network conditions.
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
Spirent Solution: Spirent’s U-ATS uses a single hardware
platform to run two separate application modes.
Validated Conformance
Testing
Flexible, configurable
Performance testing
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
Spirent Solution: Spirent’s U-ATS uses a single hardware
platform to run two separate application modes.
Validated Conformance
Testing
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
Spirent Solution: Spirent’s U-ATS uses a single hardware
platform to run two separate application modes.
Flexible, configurable
Performance testing
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
Isn’t 34.121 testing enough?
No!
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
Example: In Conformance mode, you might run the Reference
Sensitivity Test from the 34.121 test spec…
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
…but in Performance mode, you can characterize a
UE’s Reference Sensitivity as a function of DPCH...
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
…then store the results in a database and graph them…
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
… and include them in an Adobe Acrobat report…
Analyse
Assure
TM
Accelerate
Beyond Minimum Conformance …
…automatically!
Analyse
Assure
TM
Accelerate
About Minimum Conformance…
My phone may not work
properly, but I’m happy
because it passed
Minimum Conformance
Tests!
Analyse
Assure
TM
Accelerate
Analyse
Assure
Operator Challenges and
Solutions
Real-life UE test requirements
Accelerate
TM
Real-life UE test requirements
Information gained directly from 3G operators:
•
•
Operators are on a steep WCDMA deployment learning curve
•
Testing on live or trial networks does not allow the fine
control needed to ascertain the root causes of these
problems
•
Operators are looking for test tools to help them identify
these root causes.
•
•
Conformance tests do not help!
New problems are being found outside traditional GSM
experience.
Detailed UE evaluation and benchmarking is critical to
WCDMA network capacity and performance
Analyse
Assure
TM
Accelerate
Real-life UE test requirements
Spirent Solution
Create performance tests focusing on characterizing
the RF performance of terminals in real-life
conditions
Allow an operator to quantify the performance
difference between various UE implementations
Provide the flexibility to tailor tests for different
operator’s specific requirements
Analyse
Assure
TM
Accelerate
Real-life UE test requirements
Some test areas of concern:
•
•
•
•
•
•
•
Demodulation with a single radio link
Demodulation with soft handover
Adjacent Channel Interference
Receiver Sensitivity
Maximum Output Power
Measurement Accuracy
Downlink Outer Loop Power Control
Analyse
Assure
TM
Accelerate
Real-life UE test requirements
Divergences from TS 34.121
• Asymmetric data rate testing (e.g. 384 DL, 64 UL) to match
real networks
• Typical Urban multi-path propagation channels

More sophisticated 12-path fading models
• Enable Downlink Power control for tests based on TS 34.121
Section 7

Measure average downlink DPCH Ec/Ior as a test result

See which UEs require the lowest average DL DPCH
levels to maintain a specified quality level
• Vary Ior/Ioc (signal/noise ratio)
• Define own pass/fail limits for tests
Analyse
Assure
TM
Accelerate
Real-life UE test requirements
How do you determine:
Which UE will perform best when far from the base station?
U-ATS Reference sensitivity characterization test!
Which UE will perform best in the presence of interference?
U-ATS Interferer characterization tests!
Which UE will impact network capacity least?
U-ATS Downlink Power Control average DPCH_Ec/Ior tests!
Which UE will perform best in real-life fading conditions?
U-ATS customized fading tests!
Which UE will give the longest battery life in standby and talk time?
U-ATS Energy Management tests!
Analyse
Assure
TM
Accelerate
Analyse
Assure
Operator Challenges and
Solutions
Fully automated testing
with no scripting
Accelerate
TM
Designed with Efficiency in mind
Challenge: Some equipment
and systems require
•an “expert”
•a steep learning curve
•system maintenance that
quickly becomes an
exercise in code control
Analyse
Assure
TM
Accelerate
Designed with Efficiency in mind
Spirent Solution: U-ATS is automated by
TestDrive UMTS software…an intuitive, “quick and
easy-to-learn” test executive .
It requires no scripting, even for automation.
Time is used testing, rather than developing,
debugging and maintaining test scripts.
Analyse
Assure
TM
Accelerate
Designed with Efficiency in mind
Spirent Solution: Spirent’s X-API feature allows control of
environmental equipment…no matter what brand or model.
…and automates control of the UE if resets are necessary.
Analyse
Assure
TM
Accelerate
Analyse
Assure
Accelerate
Inter-Operability Testing
Applications and Services Test
TM
IOT, Applications & Services Testing
• Interoperability testing (IOT):

Network, cell, broadcast and radio channel configuration is
a delicate combination that varies from operator to operator

UE interoperability with different network conditions and
configurations needs to be tested in the lab prior to
deployment
• Applications and services testing:

Test tools need to help identify issues with end-to-end
applications to help manufacturers and operators identify
field issues in the lab prior to deployment

A wide variety of circuit and high-speed packet services
(over an IP connection) need to be tested
Analyse
Assure
TM
Accelerate
UE Performance Benchmarking
• Benchmarking UE functional performance:

With UEs at various stages - from early
development to field trials and deployment, UE
manufacturers need to test updated firmware and
software of current models quickly

Network operators want to benchmark performance
and functions of multiple UE models (and often
multiple versions of each model) accurately and
repeatably to help understand deployment issues

Regional and country-specific variations require a
high degree of flexibility in the test system
Analyse
Assure
TM
Accelerate
Spirent Solution - AirAccess WCDMA
AirAccess WCDMA is fully-configurable, multi-cell “network
in a box” that provides:
• A real-time “active” state
machine with response times
representative of real networks
• Emulation of virtually any multicell deployment scenario (up to
6 cells, 3 nodeBs and 2 RNCs)
• Quick and easy setup without the
need for scripts or programming
• Emulates circuit and high-speed
packet services, including QoS testing
Analyse
Assure
TM
Accelerate
AirAccess WCDMA
Cell 1
NodeB
Cell 2
RNC1
Cell 1
NodeB
Core
Network
Cell 2
UE
RNC2
Cell 1
Cell 2
NodeB
AirAccess WCDMA
Analyse
Assure
TM
Accelerate
Internet
AirAccess WCDMA GUI
Analyse
Assure
TM
Accelerate
AirAccess WCDMA
• For IOT:

AirAccess WCDMA creates a real-time, multi-cell, multifrequency network in the lab with simple setup and recall of
complex network configurations, call processing scenarios,
channel setup and signalling sequences
• For testing new applications and services:

AirAccess WCDMA provides comprehensive emulation of highspeed data services (including QoS testing) without need for
scripting or programming
• For benchmarking UE performance in the lab:


AirAccess WCDMA enables manufacturers and network
operators to test under user-defined proprietary network
conditions
AirAccess is easy to configure for regression testing and
establishing a baseline of UE software/firmware versions
Analyse
Assure
TM
Accelerate
Analyse
Summary
Assure
Accelerate
TM
Summary
Beyond Minimum Conformance testing
• Conformance Mode AND Performance Mode testing
• UE performance analysis under real-life network
conditions
• Flexible TS 34.121-based tests
• Custom tests aimed at quantifying UE performance
differences
• Full automation with no scripting or programming
• UE inter-operability testing
• Applications and Services testing
Analyse
Assure
TM
Accelerate
Analyse
Assure
Analyse | Assure | Accelerate™
All trademarks mentioned herein are the property of their respective owners
Copyright © 2004 Spirent Communications Inc.
Accelerate
TM