Progressive black-box testing of computer software applications

摘要

Testing computer software applications by performing a first black-box test on a computer software application, identifying any instructions of the computer software application that were reached by a payload of the first black-box test, determining a degree of success of the first black-box test in accordance with predefined success criteria, determining whether any of the instructions that were reached by the payload changed after performing the first black-box test, deciding whether to perform a second black-box test on the computer software application, where the deciding whether to perform the second black-box test is based on whether any of the instructions that were reached by the payload of the first black-box test changed after performing the first black-box test, and the degree of success of the first black-box test.

主权项

1. A system for testing computer software applications, the system comprising:
a processor; and a memory including instructions, which, when executed on the processor, perform an operation, comprising: a black-box tester configured to perform a first black-box test on a computer software application, a test monitor configured to:
identify any instructions of the computer software application that were reached based on a payload of the first black-box test, anddetermine a degree of success of the first black-box test in accordance with predefined success criteria, a code monitor configured to:
monitor coding tools used to modify the instructions of the computer software application,monitor the instructions of the computer software application for changes after black-box tests are performed on the computer software application,determine, based on the monitored coding tools and the monitored instructions, whether any of the instructions that were reached by the payload changed after performing the first black-box test, and a test controller configured to decide whether to perform a second black-box test on the computer software application, wherein the test controller is configured to decide whether to perform the second black-box test based on:
whether any of the instructions that were reached by the payload of the first black-box test changed after performing the first black-box test, andthe degree of success of the first black-box test.