Generating a configuration test based on configuration tests of other organizations

摘要

System, method, and non-transitory medium for selecting a test scenario template useful for testing a configuration change involves execution of the following: identifying runs of test scenarios run by users belonging to different organizations implementing configuration changes on software systems; identifying first connections between configuration changes and the runs; clustering the runs into clusters of similar runs; identifying, from the first connections and the clustering, second connections between configuration changes and the clusters; receiving a certain configuration change of a certain user; identifying a certain cluster of similar runs which correspond to the certain configuration change by comparing the certain configuration change with configuration changes that take part in the second connections; generating test scenario templates based on runs belonging to the certain cluster; and selecting, based on number of different organizations associated with the templates, a representative test scenario template to represent the certain cluster.

主权项

1. A computer system configured to select a test scenario template useful for testing a configuration change, comprising:
at least one processor and memory; the at least one processor and the memory cooperating to function as; a test identifier configured to identify runs of test scenarios run by users belonging to different organizations implementing configuration changes on software systems belonging to the different organizations; wherein running the test scenarios is useful for testing at least some of the configuration changes; and wherein each organization of the different organizations has a different composition of shareholders; a first connection analyzer configured to identify first connections between the configuration changes and the runs; a clustering module configured to cluster the runs into clusters of similar runs; a second connection analyzer configured to identify, from the first connections and the clustering, second connections between configuration changes and the clusters; a cluster identifier configured to receive a certain configuration change of a certain user, and to identify a certain cluster of similar runs which correspond to the certain configuration change by comparing the certain configuration change with configuration changes that take part in the second connections; a template generator configured to generate test scenario templates based on runs belonging to the certain cluster; and a template selector configured to select, based on number of different organizations associated with the templates, a representative test scenario template to represent the certain cluster.