System, method, and computer program for generating a fully traceable test design

摘要

A system, method, and computer program product are provided for generating a fully traceable test design. In use, a repository of parameters and associated values that are predefined as valid for the parameters is defined. Activity flows including one or more activities are further graphically defined, and the parameters are mapped to the one or more activities, the mapping functioning to connect the one or more activities to the values that are predefined as valid for the parameters. Further, business rules define incompatible pairings of the values across two or more of the parameters mapped to one or more of the activities. A plurality of test scenarios associated with the activity flows are then determined, and a subset of the plurality of test scenarios are automatically selected based on various predefined criteria. Moreover, test design materials associated with the test design are output.

主权项

1. A method, comprising:
defining a repository of parameters and associated values that are predefined as valid for the parameters, where the parameters may be mapped to one or more activities during test design; graphically defining activity flows including the one or more activities, each of the activity flows including a directed acyclic graph (DAG) including the one or more activities as nodes; mapping the parameters to the one or more activities included in the graphically defined activity flows, the mapping functioning to connect the one or more activities to the values that are predefined as valid for the parameters, thereby defining all permutations of each of the one or more activities and each of the activity flows in the test design; defining business rules that define incompatible pairings of the values associated with two or more of the parameters mapped to one or more of the activities; determining a plurality of test scenarios associated with the activity flows; automatically selecting a subset of the plurality of test scenarios, each of the selected test scenarios being a path where valid values were selected, based on:
the business rules,risk probability including values and combinations of values that historically produced defects,customization level including an amount of effort invested in changing value functionality in the test design,past customer feedback including combinations a customer preferred to include or selected to exclude from tests in the past, andbest combinations determined utilizing a pairwise algorithm; performing a coverage check of the selected test scenarios, the coverage check being operable to identify a test coverage of the selected test scenarios associated with the test design; and outputting test design materials associated with the test design, the test design materials including one or more of a diagram graph, one or more high level use case descriptions of each of the scenarios, and tests associated with the test design.