Promotion determination based on aggregated code coverage metrics

摘要

Techniques are described for aggregating code coverage data generated from various types of testing of software modules, and automatically determining whether to promote software upwards in a multi-level software deployment hierarchy based on the aggregated code coverage data. In embodiments, a code coverage metric is determined for a software module, and the metric is compared to a set of promotion criteria, including whether the metric meets a predetermined threshold for quality. In some cases, the threshold may be a general threshold, a threshold based on the level of possible promotion, and/or a threshold that is based on an identified category for the software module such as whether the module is a front-end module, a shared module, a legacy module, or a critical module.

主权项

1. A computer-implemented method, comprising:
receiving a plurality of unit code coverage reports that include test data describing lines of code covered by unit tests of one or more software modules; receiving system code coverage reports that include test data describing interactions between the one or more software modules and system software, wherein the one or more software modules are integrated into the system software, and wherein the test data further describes test results from the integration of the one or more software modules into the system software; computing code coverage metrics for the one or more software modules, wherein the code coverage metrics are based at least on both the plurality of unit code coverage reports and the system code coverage reports; promoting at least one of the one or more software modules from a first level to a second level within a software deployment hierarchy, wherein said promoting is based at least in part on a determination that a code coverage metric of the code coverage metrics for the at least one of the one or more software modules satisfies one or more promotion criteria; and reporting at least one other of the one or more software modules, wherein said reporting is based at least in part on a determination that a code coverage metric of the code coverage metrics for the at least one other of the one or more software modules does not satisfy the one or more promotion criteria.