Guys join a certified program
Test Automation Reporting and Metrics
5 Test Automation Reporting and Metrics:
Keywords
automation code defect density, coverage, traceability matrix, equivalent manual test effort, metrics, test logging, test reporting
Learning Objectives for Test Automation Reporting and Metrics
5.1 Selection of TAS Metrics ALTA-E-5.1.1 (K2)
Classify metrics that can be used to monitor the test automation strategy and effectiveness
5.2 Implementation of Measurement
ALTA-E-5.2.1 (K3) Implement metrics collection methods to support technical and management requirements. Explain how measurement of the test automation can be implemented.
5.3 Logging of the TAS and the SUT
ALTA-E-5.3.1 (K4) Analyze test logging of both TAS and SUT data
5.4 Test Automation Reporting
Selection of TAS Metrics- types 2
The measured TAS metrics typically include the following:
the metrics that can be used to monitor the test automation strategy and the effectiveness and efficiency of the TAS.
1. External TAS metrics
- Automation benefits Effort to build automated tests Effort to analyze automated test incidents Effort to maintain automated tests Ratio of failures to defects Time to execute automated tests Number of automated test cases Number of pass and fail results Number of false-fail and false-pass results Code coverage
2. Internal TAS metrics
- Tool scripting metrics Automation code defect density Speed and efficiency of TAS components
5.2 Implementation of Measurement
- Features of automation that support measurement and report generation
- Integration with other third party tools (spreadsheets, XML, documents, databases, report tools, etc.)
- Visualization of results (dashboards, charts, graphs, etc.)
5.3 Logging of the TAS and the SUT
5.4 Test Automation Reporting
The test logs give detailed information about the execution steps, actions and responses of a test case and/or test suite.
- Content of the reports
- Publishing the reports
No comments:
Post a Comment