Introduction to Rational
Test Suite 2001
Agenda
QA Basics
Introduction to Rational Test Suite
Rational Test Manager
Test implementation with Rational Robot
Summary
Benefit of implementation of automatic test
Obstacles in using Rational Robot
Video Demos
QA Basics
Major Goal of software developing enterprise is
satisfaction of the client by providing qualitative
product.
The major parts of QUALITATIVE PRODUCT are:
Adjustment to Corrected
Client Functionality
Requirements of the Product
SQA Basics
Why qualitative product ?
[Link] Rule
Discovering of product’s defects at latest phase will
cost much more then on earlier.
1:5 Rule
It’s more expensive to find a new client then keep
working with the old one.
SQA Basics
How qualitative product ?
Qualitative System Analyze
Qualitative Design of Product Architecture
Qualitative Product Development
Qualitative Product Testing
SQA Basics
Classic Problem in Testing
?
Quantity
Quality
Introduction to Rational Test Suite
Rational Test Suite is a software solution for
composing, developing, managing, debugging
and run automatic tests.
Rational Test Suite consist of next major
applications :
• Test Manager • Purify • SoDa
• Robot • PureCoverage • Test Factory
• ClearQuest • RequisitePro
Introduction to Rational Test Suite
• ClearQuest - Rational ClearQuest is a defect
tracking and change request
management system.
• PureCoverage - Rational PureCoverage automatically
pinpoints areas of code that have not
been exercised during testing.
• Purify - Rational Purify automatically pinpoints
hard-to-find, run-time errors in your
applications.
Introduction to Rational Test Suite
• SoDa - Rational SoDA provides automatic
generation of software documentation.
SoDA templates support Microsoft Word
95, 97, 98, and 2000.
• RequisitePro - Rational RequisitePro helps teams
organize, prioritize, track, and control
changing requirements of a system or
application.
Introduction to Rational Test Suite
• Test Factory - Rational TestFactory automatically
generates comprehensive test
scripts.
• Test Manager - Rational TestManager is the cornerstone
of Rational’s testing tools, controlling and
managing all test activities.
• Robot - Rational Robot lets you create, modify,
and run automated functional tests on
your applications.
Rational TestManager
Rational TestManager is the one place to manage all testing
activities—planning, design, implementation, execution, and
analysis. TestManager ties together testing with the rest of the
development effort, joining your testing assets and tools to
provide a single point from which to understand the exact state
of your project.
Rational TestManager
Rational TestManager
Plan Test Phase
The purpose of plan test is to identify and describe the
testing that will be implemented and executed. This is
accomplished by generating a test plan which contains the
requirements for test and test strategies. A single test plan
may be developed, describing all the different types of tests
to be implemented and executed, or one test plan per type
of test may be developed. Either is method is acceptable.
• The Test Plan
The test plan contains information about the purpose and
goals of testing within the project. Additionally, the test
plan identifies the strategies to be used to implement and
execute testing and resources needed.
Rational TestManager
Design Test Phase
The purpose of Design Test Phase is to identify, describe
and generate the test model and its reported artifacts (test
procedures and test cases).
• Test Model
The test model is a representation of what will be tested and
how it will be tested. It is a view of the design and
implementation models and includes the collection of the
test cases, test procedures, and test scripts, and their
relationship.
Rational TestManager
Implement Test Phase
The purpose of Implement Test Phase is to implement
(record, generate, or program) the test procedures that were
defined in Design Test. The output artifact is a computer
readable version of the test procedure, referred to as a test
script. The generation of test scripts can be done within the
context of test automation tools or programming
environments. There is an implementation for each test
case defined in test plan.
• Test Case
A test case is a set of test inputs, execution conditions, and
expected results developed for particular objective, such as
to exercise a particular program path or to verify
compliance with a specific requirement.
Rational TestManager
Test
Plan
Scripts Test
Results Cases
Test implementation with Rational Robot
Rational Robot
Rational Robot is a part of Rational Test Suite that lets to
Test Engineer to create, modify, debug and run automated
functional tests on applications under test (AUT).
Test implementation with Rational Robot
Implementation of Test Scripts
They are the computer readable instructions that automate the
execution of a test procedure (or portion of a test procedure). Test
scripts may be created (recorded ) or automatically generated
using test automation tools, programmed using a programming
language, or a combination of recording, generating, and
programming.
In order to check an application under test Script Developer
uses such a “Verification Points” combined with different
“Verification Methods ”
Test implementation with Rational Robot
Verification Points
The location in the instructions where an actual result will be
compared with an expected result.
• Alphanumeric • Window Existence • Region Image
• Clipboard • Window Image • Web Site Scan
• Menu • File Comparison • Web Site Compare
• Object Data • File Existence
• Object Properties • Module Existence
Test implementation with Rational Robot
Verification Method
The machine readable instruction that executes the comparison
between expected and actual results. Different verification
methods exist to verify different attributes.
Test implementation with Rational Robot
Example Case: Check that adding of new agent updates Data Base.
Test implementation with Rational Robot
Test implementation with Rational Robot
Test implementation with Rational Robot
Test implementation with Rational Robot
Test implementation with Rational Robot
Summary : Benefit of implementation
automatic test
Unattended Run Decrease tool time
During run of test cases tester could do his We can use the scripts to run during
other tasks and return only to get results. non working hours (Night Runs)
Written once, runs a lot of times Save the time
You could run the same test script again Automatic test decrease dramatically
and again. test time.
Full Coverage of Inputs Range
Using test script it’s possible to pass over all Valid Input Range and
pass over Invalid Range. This is what regular tester can’t do
Summary : Benefit of implementation
automatic test
STD
STD TESTS
TESTS
STD
STD++Scripts
ScriptsDeveloping
Developing TESTS
TESTS
Time Line
Summary : Obstacles in using Rational
Robot
Image (picture) depended tests Result Log File
The Robot can not capture the live image. Default generated Result Log File doesn’t supply
Therefore Train can not be Automated an easy-to-read and understandable output, so
during developing of the script Tester should
Test Script Updates write by himself to the log file messages that will
make it easy to analyze the outcomes.
Applications could change from build to build,
so test script should be updated too -
maintenance of scripts
External Functions Advanced Script
In order to make script smaller and suitable to In order to make advanced script it’s not enough
our application, we developed an external just record and playback Tester’s action. In this
functions according our needs. This makes script case Tester Engineer should combine between
developing process easier, but someone should recording and code writing.
write those libraries first.