SAP Test Automation Strategy Overview
SAP Test Automation Strategy Overview
<Customer Name>
Table of Contents
Version history.................................................................................................................................4
Sign off..............................................................................................................................................4
1. Introduction...............................................................................................................................5
1.1. Document purpose..............................................................................................................5
1.2. Target audience...................................................................................................................5
5. Automation Methodology.......................................................................................................16
5.1. SAP TAO Process Framework..........................................................................................16
5.1.1. Discovery.................................................................................................................................................. 16
5.1.2. Design...................................................................................................................................................... 16
5.1.3. Construction............................................................................................................................................. 16
5.1.4. Execution.................................................................................................................................................. 17
5.1.5. Analyse..................................................................................................................................................... 17
5.1.6. Optimize................................................................................................................................................... 17
5.2. SAP TAO Workflow...........................................................................................................18
5.2.1. Typical automation workflow....................................................................................................................18
5.3. SAP TAO Benefits & Limitations........................................................................................19
5.3.1. Automated Business Process Testing......................................................................................................19
5.3.2. Lower Risk................................................................................................................................................ 19
5.3.3. Lower Maintenance Costs........................................................................................................................ 19
5.3.4. Integration................................................................................................................................................. 19
5.3.5. Reuse....................................................................................................................................................... 19
5.3.6. Log Report................................................................................................................................................ 19
5.3.7. Easy Automation...................................................................................................................................... 19
5.3.8. Limitations................................................................................................................................................ 19
5.4. Test Deliverables...............................................................................................................20
5.5. Test Maintenance..............................................................................................................20
6. Governance Model..................................................................................................................22
7. Resourcing Model...................................................................................................................23
8. Roles and Responsibilities....................................................................................................24
9. Organization Structure...........................................................................................................26
Appendices.....................................................................................................................................27
Acronyms......................................................................................................................................27
Attachments..................................................................................................................................27
References...................................................................................................................................27
1. Introduction
<Company Name> current understanding of <Customer Name> automation testing
requirement are based on <Customer Name> SAP services direction to access the existing
automation process methodologies and standards to support the current and planned future
SAP landscape.
The key objectives of this initiative include the following,
Support <Customer Name> in implementing and standardizing their automation
testing services for the SAP and Non–SAP applications
To improve application quality through centralized automation processes and
methodologies
To streamline the <Customer Name> SAP and Non-SAP automation teams on
testing methodologies.
To substantially reduce the elapsed time in testing and meeting the release
deadlines
Perspective
Operational
Reduced SDLC
International
Competition Faster Time to
Market
4.3.2. Center of Excellence
Testing team operates across the enterprise and supports individual teams/groups on a
scheduled work queue basis - Certified / Trained Test Professionals
Consistent methodologies, processes, tools, infrastructure and metrics across groups
Predictable and process-driven estimation over a period of time
Leverage resources across teams/groups and manage work centrally.
Shared Infrastructure and tools. Efficient usage of Automation tools and test processes
to provide high quality systems
Cost effective solutions through test framework with repeatability and reusability
Performance metrics measured throughout
Benefits of Testing COE
Industry COE
Norm Result*
Predictability
“IT projects cancelled prior to completion”
30% 3%
Alignment to Business
Gartner
5.1.1. Discovery
During the Discovery stage, the test team works with the client to understand the
nature of the project, and establish an approach that ensures industry best practices
are being implemented. The team works to gather requirements that form the
foundation for a detailed test plan, which outlines the projects scope. Information on
requirements, business process, interfaces, and date setup is gathered and
analyzed to ensure that nothing is overlooked during the construction phase. At the
completion of this stage, the high-level test approach will be defined, a detailed test
plan will be approved by all project stakeholders, and the test environment will be
setup including all testing software and client applications
5.1.2. Design
The Information gathered during discovery stage will be utilized to ensure that the
testing approach covers the key components to the testing engagement, and to
create the folder structures in Quality Center to ensure that application is being
validated according to the correct business requirements
5.1.3. Construction
During the Construction phase, the team creates automated using SAP TAO. These
automated scripts form an automated regression library, which is used to validate
the application during the Execution stage.
During automated script construction stage the <Company Name> test team will
use SAP TAO inspect/UI Scanner to create components against the Transaction
Code. The Inspect/UI scanner will interrogate the application and automatically
create components which will then be uploaded into Quality Center including
screenshots and parameters. The components will be ‘dragged and dropped’ into
sequences that replicate the processes identified for testing. These processes will
be created from an end user perspective, interacting with the application
Each test case will have a spreadsheet, known as the input data sheet, associated
with the test case for parameterization (input, output and calculation) and the
<Company Name> test team will set up this initial data sheet. Test data must be
loaded or populated into the testing environment before automated script creation
can begin. Once the creation of automated scripts is complete, the test engineer
modifies the scripts to make them conform to the testing goals. Script debugging is
accomplished to ensure script integrity, and to verify that the scripts are ready for
full execution. During this process, it is important that no changes to the client
application occur. Any change to the application or application architecture can
cause the scripts to fail.
5.1.4. Execution
During the Execution phase, test scripts will be executed once for completeness
with report logs available for verification purposes. Logs will include ‘PASS’, ‘FAIL’
and ‘WARNING’ messages as well as execution time, elapsed time and
screenshots where relevant. These logs can be compared by business analysts to
verify the automated tests executed as expected against the application. As the
logs have an elapsed and execution time they can be used as benchmarks against
future test execution runs. All defects will be logged into a defect tracking
application and followed through to either a successful retest or a mitigation plan for
release. Once each test case has been executed it will be stored into a relevant
test set inside Quality Center for future execution.
Any tests that fail due to technical issues or data setup will be set up again and re-
executed. <Company Name> team needs the support to get the test data &
technical issues if any. This stage may not be completed in one testing cycle.
Often, new functionality is being testing in parallel to old functionality and defect
fixes are being applied. At the culmination of this stage the test team will have
satisfied all of the exit criteria and provide either a “Go” or “No-Go” decision.
5.1.5. Analyse
During this phase, the test team will gather the results from each test run performed
on the Application under test. A summary will be provided on defects found, defects
fixed, defects open, and defects pending.
At the completion of this phase, all test results will be presented to management
and disseminated to the project stakeholders for review and further action.
5.1.6. Optimize
The final phase in this process is the Optimize stage, during this stage the test team
will complete any manual test cases that were not automated previously due to new
functionality, application changes, or timeline. In addition, the team will also review
all automated test scripts and make updates accordingly to bring the regression
library up-to-date with the latest versions of the application.
At the end of this phase, the client will have a fully functional regression library
ready to execute against the current application version. The team will also set the
library up for long-term maintenance, or support the upkeep of the library depending
on the project scope.
5.2. SAP TAO Workflow
SAP TAO is an advanced SAP testing solution for Regression, E2E & UAT Testing. It
contains Inspect, Consolidator and Import & Export tools. TAO has pre built components
like, Save Record, Launch & Login. There are more than 300 business components are
pre-built and readily available as per the SAP standard regardless of the SAP module.
TAO Inspect tool help us to create the SAP components using SAP Screen number
automatically. This is the only tool having automation creation of components. It drastically
reduced the component creation time. As per the business process, we have to create the
SAP screen components using inspect/UI scanner tool.
To build scripts by drag & drop the Business components using BPT frame work.
Consolidator works on the performance factor. As per the BPT frame work, the test scripts
execution will be run by component and component. Consolidator helps us to consolidate
N number of components to one component. So that loading and unloading of QC –
component server time will be reduced as part of execution. Test scripts, Test Results and
Defect tracking are managed in the Quality Center and traceability from the requirements
to the defects will be achieved.
5.3.4. Integration
Tight integration between SAP Solution Manager, SAP TAO and SAP Quality
Center by HP
5.3.5. Reuse
Eliminates the need of create new tests whenever a SAP screen or business
process changes.
If one component changes in a group of tests, just replace that component and
then re-consolidate the tests
5.3.8. Limitations
SAP TAO is not an independent testing (i.e. works with only on HP tools)
Not suitable for SAP Web/Portal Testing
Conditional test case approach is limited
5.4. Test Deliverables
Test Strategy & plan document
Test Estimation & schedule
Test procedures & scenarios
Test scripts & components delivered in Quality Center
Test Execution reports & Defect reports
Test Summary reports
Test Metrics
Test progress & status reports (Weekly)
Test closure & handover document
Using SAP TAO Inspect/UI Scanner, component creation for the existing screen or new
screen is few minutes maximum. Once component is created and made available in
Quality Center, we can just replace the existing old component to new component in case
of changes to the existing screen. If it’s entirely new screen drag and drop the new
component according the flow in the test and execute.
6. Governance Model
7. Resourcing Model
3 Tier Resourcing approach would be followed to handle the ramp up / ramp down needs of
<Customer Name> applications automation testing
o Tier I resources will be the Automation Experts/SMEs assigned to projects
o Tier II resources will be the <Company Name> Automation Experts supporting other
projects within <Customer Name>
o Tier III resources will be flexible resource team (<Company Name> bench
resources supporting <Customer Name> on need basis)
Any resource requirement for new projects/Applications sourced from <Company Name>
will be Tier I resources. Any additional requirement will be resourced from Tier II,
depending on the work load.
Reallocation and mobilization of resources will be done within <Customer Name> for
resource optimization, depending on work load.
Tier III resources will be utilized if the Tier I and Tier II resources are not available.
8. Roles and Responsibilities
Role Responsibilities & Skills
Automation Responsibilities
Experts / Tool Responsible for tools implementation
Experts Responsible for technical training and support
Build test infrastructure
Design and create test data for automation
SME for all technical testing inquires
Creates automated test components
Executes and debugs the components
Analyze the test results and reports the issues
Skills Needed
Excellent technical experience on Tools
Strong testing Methodology experience & knowledge
Good written and verbal communication skills
People and project management skills
Responsibilities
Functional SME Create Functional scenarios document
Creates functional test cases
Analyses the test results for coverage and completeness
Execute automation tests
Analyse automation tests and run reports
Report issues and defects to integrator team
Skills Needed
SAP Functional expert
Good Experience with HP/Mercury testing tools
Strong written and verbal communication skills
9. Organization Structure
Appendices
Acronyms
No Acronym Expansion
2 QC Quality Center
Attachments
References