Software testing capability assessment framework

摘要

An improved testing assessment tool and methodology maps the Testing Maturity Model (TMM) structure to individual test areas, thereby enabling comprehensive and targeted improvement. In this way, the present invention uses the five TMM maturity levels to assess individual areas, rather than merely assigning a single maturity level to the entire organization. Embodiments of the present invention include a quick assessment that includes a relatively small number of questions to be subjectively answered using the TMM hierarchy. Embodiments of the present invention further include a full assessment that includes a relatively large number of questions to be discretely answered, with these results being use to evaluate various testing areas using the TMM hierarchy.

主权项

1. A testing maturity assessment system comprising:
a server connected to a test assessment system for accessing a stored first testing capability questionnaire and a stored second testing capability questionnaire, wherein the first testing capability questionnaire comprises at least one question for each of a plurality of testing capability areas, wherein the second stored capability questionnaire comprises at least one of the questions from the first testing capability questionnaire, and wherein said server provides said stored first testing capability questionnaire and said second stored testing capability questionnaire over a network; a computer connected to the network for (1) receiving test-type selection information, and (2) receiving and displaying the first testing capability questionnaire or the second testing capability questionnaire based on the test-type selection information, wherein said computer accepts a response to each of said questions in said first testing capability questionnaire or second testing capability questionnaire and returns said responses to the server; and a test assessment tool connected to the server for processing the received questionnaire responses, wherein said test assessment tool calculates a testing maturity score for each of the testing capability areas, wherein each of the responses comprises true or false answers for each of the questions, and wherein the test assessment tool comprises predefined logic to calculate the testing maturity score for each of the testing capability areas, wherein said predefined logic comprises tallying the percentage of positive answers to the questions associated with each testing capability area and correlating the tally with a testing capability score for each of the testing capability areas, wherein the testing capability areas correspond to testing maturity criteria used in a Testing Maturity Model, and wherein the testing capability areas comprise a test methodology area, an environment and tools area, an organization and communication area, an approach and planning area, a design and preparation area, an execution and reporting area, a performance testing area, a project management area, a defect management and prevention area, a test data management area, and a requirements management area, the test methodology area relates to an approach used to plan and perform software testing, the environment and tools area relates to infrastructure and facilities used to support the software testing, the organization and communication area relates to people within an organization and software test-related communication between the people, the approach and planning area relates to addressing all major aspects of the test stage that may affect the success of testing, the design and preparation area relates to software test-related artifacts including hardware and software, the execution and reporting area relates to executing the software testing, the performing area relates to identifying and fixing system performance issues before the software testing, the project management area relates to organizing and managing resources to complete the software testing, the defect management and prevention area relates to organizing, managing, and prevent problems in a work product or deliverable related to the software testing, the test data management area relates to a process for data requisition, acquisition, population, and conditioning required for the software testing, and the requirements management area relates to gathering and managing user, business, technical, and function requirements within a product development project.