DISPLAY-INDEPENDENT RECOGNITION OF GRAPHICAL USER INTERFACE CONTROL

摘要

A method for display-independent recognition of a graphical user interface (GUI) control, the method comprising capturing a screenshot of a GUI of a computerized application, determining a cursor position in the screenshot, analyzing an area surrounding the cursor position, to identify a GUI control, and storing an image of the GUI control.

主权项

1. A method for automatic extraction of an image of a control in a graphical user interface (GUI), the method comprising:
capturing a first screenshot of a GUI of a computerized application, and automatically analyzing said first screenshot to identify a scroll bar by extracting at least one parameter of the scroll bar from within the first screenshot; if a scrollbar is identified: (1) receiving coordinates of at least one position from a user in said first screenshot; analyzing an area surrounding said at least one position, to identify at least one GUI control; and (2) storing an image of said at least one GUI control substantially in conjunction with at least one parameter of the scroll bar; and if a scrollbar is not identified: (1) receiving coordinates of at least one position from a user in said first screenshot; analyzing an area surrounding said at least one position, to identify at least one GUI control; and (2) storing an image of said at least one GUI control separate from the first screenshot of the GUI from which the image of the GUI control is taken.