Transcript Plenware yleisesite - Tampereen Teknillinen Korkeakoulu

Selecting a Test Automation Tool
for Symbian Environment
Jussi Niutanen
Plenware Group Oy
Jussi Niutanen
Mobiilipäivät 19.12.2005
Presentation Outline
This presentation bases mostly to my
Master of Science Thesis: Test
Automation of Symbian Applications
• Plenware
• Testing and Symbian Testing
• Testing tool evaluation
• Generations
• Verification
• Quick tool check
Jussi Niutanen
Mobiilipäivät 19.12.2005
Plenware Today
Turnover: 26 MEUR (estimate 2005)
Personnel: 350
Offices:
• Tampere, Turku, Espoo and Oulu
Plenware’s service areas are:
• Telecom, Media, Industry, Services and
Quality Assurance Services
More information: www.plenware.com
Jussi Niutanen
Mobiilipäivät 19.12.2005
TELECOMMUNICATION
Symbian
• Innovative intelligent applications
• Solutions to support the communication
between mobile devices and various
enviroments
• Symbian solutions
– Exploiting the technologies of Series 60
platforms, e.g. Bluetooth communication
with the devices in surroundings
– MONA: Motion detecting application
– GINA: Password controlled data security
application
• Symbian Platinum Partner
• Nokia Forum Pro Member
Jussi Niutanen
Mobiilipäivät 19.12.2005
What is Testing?
Specified
functionality
Implemented
functionality
Tested functionality
[Jo02]
Jussi Niutanen
• "Testing is the process of executing a
program or system with the intent of
finding errors." (Myers 1979)
• “Testing is the process of establishing
confidence that a program or system
does what it is supposed to.“ (Hetzel,
1973)
• Operating a system under specified
conditions, observing or recording the
result, and making an evaluation of
some aspect of the system (IEEE, 1990)
Mobiilipäivät 19.12.2005
Testing Symbian Applications
• Number of phones, platforms etc.
• Different types of UI
• Sometimes it is impossible to test
automatically
• GPRS applications
• Microphone
• Voice quality
• Changes during the devolopment
Jussi Niutanen
Mobiilipäivät 19.12.2005
The Evaluation Process
Jussi Niutanen
Mobiilipäivät 19.12.2005
The Five Generations of
Testware Development [FeGr99]
1.
2.
3.
4.
5.
Linear test scripts
Sructured test scripts
Shared test scripts
Data driven test scripts
Keyword-driven test sripts
What means action word testing?
Jussi Niutanen
Mobiilipäivät 19.12.2005
Verification Example in 6630
Test result is a picture that depends on:
• Day
• Time
• Is sim card inserted
• Is phone connected with USB
• Language
Jussi Niutanen
Mobiilipäivät 19.12.2005
System Testing Tools
• Nokia Testing Suite
• Try (Mobileinnovations)
• AppTest (Digia)
• QTP & m-Test (Mercury)
• Pro Script Recorder (TestQuest)
• STS Master (Strategic Test Solutions)
Jussi Niutanen
Mobiilipäivät 19.12.2005
Unit Testing Tools
• Eunit (Digia)
• TestFrame example (Nokia SDK)
• Symbian OS Unit (open source)
• QTP & m-Test (Mercury)
• Simple driver to one project
Jussi Niutanen
Mobiilipäivät 19.12.2005
Summary
• Automation must be done as a project
• Generation and verification
Jussi Niutanen
Mobiilipäivät 19.12.2005
Thank you for listening.
[Jo02]
Paul C. Jorgensen: Software Testing: A Craftsman’s
Approach, second edition, CRC Press, 2002.
[FeGr99]
Mark Fewster & Dorothy Graham: Software Test
Automation. Effective use of test execution tools.
Addison-Wesley, 1999.
Jussi Niutanen
Mobiilipäivät 19.12.2005