FUNCTIONAL VALIDATION OF SOFTWARE

摘要

Aspects of the subject matter described herein relate to software validation. In aspects, a baseline may be created by instrumenting code of a software application or runtime, executing the code of the software application a plurality of times to generate a plurality of logs, determining invariant characteristics of the logs, and writing the invariant characteristics to a baseline. When a new version of the software application or runtime is created, the new version may be validated by instrumenting the code of the new version or runtime, executing the code of the new version, and comparing the log generated with the baseline.

主权项

1. A method implemented at least in part by a computer, the method comprising:
selecting a runtime environment; obtaining code of a software application; performing instrumentation to log state information during execution of the code; on the computer, executing the code a number of times using the runtime environment to generate a plurality of logs that include state information obtained from the computer and correspond to each execution of the code using the runtime environment; identifying invariant characteristics of the logs, the invariant characteristics including a particular function that was called during each execution of the code; creating a baseline using the invariant characteristics; and validating the code by comparing the baseline to a log that includes state information obtained from the computer during execution of the code using a different runtime environment.