| 主权项 |
1. A test automation system, comprising:
one or more special purpose computers; the one or more special purpose computers including a test automation engine that automatically determines first information related to a test of a software program in response to executing the test, the software program stored in a memory and having a plurality of components, the components tested independently of each other, the first information including a type of test performed on a particular component of the software program; the one or more special purpose computers including a data collection module that automatically collects second information related to the test, the second information received from a source other than the test automation system; the one or more special purpose computers including a test outcome analyzer module that analyzes at least one of the first information and the second information and produces a quality assessment in response to the analysis after the test is run, the quality assessment including analysis data about the components relative to each other, wherein the quality assessment distinguishes a first result generated in response to the type of test performed on the particular component in a first test environment included in a first combination of the first and second information from a second result generated in response to the type of test performed on the particular component in a second test environment included in the second combination of the first and second information, and wherein the particular component in the first test environment is part of a same software release as the particular component in the second test environment, wherein the first and second results each includes a test result and a performance result, wherein the test result includes an indication of whether the test of the software program passes, and wherein the performance result includes an indicator of a comparison between the test and historical test data regardless of whether the test result indicates that the software program passes: the one or more special purpose computers generates a regression result, which identifies whether the test is failing now, but the test previously passed, by comparing the test result of the particular component and one or more previous tests to indicate whether a test failure is a regression, the regression result different than the test result and the performance result; the one or more special purpose computers generates a product quality table that displays an amount of code coverage for the component having the test result, and a percentage of the code coverage passing the test and a percentage of the code coverage failing the test, and that generates a correlation token associated with a thread of execution of the test, wherein the code coverage is tagged with the correlation token for reconstructing a code path of the component having the test result; the one or more special purpose computers prevents a false positive reading of the first and second results by displaying both the performance results and the test results of both the first and second results, and by comparing a performance of the test of the software program against the historical test data including pass/failure data about the test, and establishing that when the test result of the first result and the test result of the second result are the same result, the performance result of the first result is either the same as or different than the performance result of the second result depending on corresponding differences between the first test environment and the second test environment; and the one or more special purpose computers including a report generator that outputs the quality assessment to a display, including each of the test result and the performance result of each of the first and second results of the test preventing the attainment of the false positive reading. |
