SYSTEM AND METHOD OF TEST ITERATION VIA PROPERTY CHAINING

摘要

A new test control structure improves on constructing complex test sequences in a scripting language. The new test control structure iterates over two or more arbitrary values of a test attribute, such as a networking protocol parameter applied at OSI layers 2-7.

主权项

1. A method used by a test harness during a stress test of a system under test, including:
bounding a set of test commands with a transitory iterator command and a transitory iteration-verifier command, wherein the commands are passed to a test harness that is coupled to a system under test and the test commands are expressed in a declarative command language;
wherein the transitory iterator command and the transitory iteration-verifier command are active when they are executed and are inactive when the bounded test commands are active; performing a sequence of network traffic stress tests in which test commands cause the test harness to send test traffic messages to the system under test via one or more network ports and measure performance of the system under test;
wherein the transitory iterator and iteration-verifier commands combine to implement a stability backoff test of stress levels; beginning in an expected failure range that is above an approximately measured pass/fail threshold;
the transitory iterator command backing off an applied stress applied by the bounded test commands; repeating the applied stress a predetermined number of times, which is more than once for the applied stress level;
the iteration-verifier command, evaluating a pass/fail result for the iteration of the applied stress level, and accumulating a pass/fail rate for results of iterations at the applied stress level; and evaluating the accumulated pass/fail rate, after the predetermined number of times iterating at the applied stress level, against a predetermined pass rate, and scoring the applied stress level as passed or failed;
the transitory iterator command terminating the test when the predetermined pass rate has been achieved at a predetermined number of applied stress levels as the transitory iterator progressively backs off the applied stress level; andone or more result commands outside the bounded test commands reporting test results.