Test Evaluation Summary
Table of Contents
This Test Evaluation Report describes the results of the tests in terms of test coverage (both requirements-based and code-based coverage) and defect analysis (i.e. defect density).
This Test Evaluation Report applies to the first Construction Iteration of the . The tests conducted are described in the Test Plan for the first Construction Iteration. This Evaluation Report is to be used for the following:
Definitions, Acronyms and Abbreviations
The test cases defined in the Test Model were executed following the test strategy as defined in the Test Plan. The test defects have been logged and any medium, high, or critical priority defects are currently assigned to the owner for fixing.
Test coverage (see Section 3 below) in terms of covering the use cases and test requirements defined in the Test Plan was 100% complete.
Code coverage was measured using Rational Visual PureCoverage and is described in Section 4.
Analysis of the defects (as shown in Section 6 below) indicates that the majority of found defects tend to be minor problems classified as low or medium in severity. The other significant finding was that software components comprising the interface to the Pager Gateway contained the highest number of defects.
All test cases not relating to advertising content, as defined in the Test Model, were attempted. Of the tests cases executed, 5 tests failed.
The test coverage results are as follows:
The area of tests with the highest failure rate was the Pager Gateway Interface, which failed under high volume testing.
Further detail on test coverage is available using Rational RequisitePro and the Test Case matrix.
Rational Visual PureCoverage was used to measure code coverage of the tests.
Ratio LOC executed = 94,399 / 102,000 = 93%
Approximately, 93% of the code was executed during the testing. This coverage exceeded the target of 90%.
The following actions are recommended to improve performance to an acceptable level: