Capturing information on a rendered user interface including user activatable content

摘要

Provided are a computer program product, method, and system for capturing information on a rendered user interface including user activatable content. A user interface is executed on the computer system. An initial representation is generated of a rendered user interface. A determination is made of locations rendered in the user interface associated with user activatable content, wherein user activatable content is rendered in response to user selection of a location in the user interface associated with the user activatable content. For each determined location, content is captured from the activatable content rendered in response to the user selecting the determined location to create a captured content object having the captured content. The captured content objects and the initial representation are stored. The initial representation and the captured content objects are processed to generate output to render the initial representation of the user interface and the captured content from the captured content objects.

主权项

1. A computer program product for gathering information on a user interface, the computer program product comprising a computer readable storage medium having computer readable program code embodied therein that executes to perform operations within a computer system, the operations comprising:
executing a user interface on the computer system; generating an initial representation of a rendered user interface; determining locations rendered in the user interface associated with user activatable content, wherein the user interface renders the user activatable content in response to user selection of the determined locations associated with the user activatable content, wherein the determined locations comprise regions of coordinates in the rendered interface; determining whether the user activatable content is detected at the determined locations; capturing a representation of the user activatable content detected at the determined locations; generating a captured content object for each instance of capturing the representation of the detected user activatable content; saving the captured content objects and the initial representation; and processing the initial representation and the captured content objects to generate output to render the initial representation of the user interface and the representations of the user activatable content in the captured content objects, wherein the captured representations of the user activatable content are rendered superimposed on the initial representation with respect to the determined locations for the captured representations of the user activatable content in the user interface.