Ordered test execution to enable faster feedback

摘要

Methods, systems, and computer-readable media for ordered test execution to enable faster feedback are disclosed. A likelihood of failure is estimated for individual tests in a set of tests. Based at least in part on the likelihood of failure, an ordered sequence is determined for the set of tests, such that the tests are ordered in estimated likelihood of failure. The set of tests is initiated in the ordered sequence, such that one or more computer-executable programs are subjected to individual ones of the tests. A failure of one or more of the tests is determined prior to performing one or more remaining tests in the ordered sequence.

主权项

1. A system, comprising:
one or more computing devices configured to implement a test execution system, wherein the test execution system is configured to:
estimate a respective likelihood of failure for individual tests in a set of tests, wherein the respective likelihood of failure is estimated based at least in part on a plurality of factors, and wherein the plurality of factors comprises a respective failure history for individual ones of the set of tests;determine an ordered sequence for the set of tests, wherein the ordered sequence is determined based at least in part on the respective likelihood of failure for the individual tests, and wherein individual tests in the ordered sequence are ordered in decreasing likelihood of failure;initiate performing the set of tests in the ordered sequence, wherein one or more computer-executable programs are subjected to individual ones of the set of tests in the ordered sequence;determine a failure of one or more tests in the ordered sequence, wherein the failure is determined prior to performing one or more remaining tests in the ordered sequence; andterminate performing the set of tests in the ordered sequence based at least in part on the failure.