Display-independent recognition of graphical user interface control

摘要

A method for display-independent recognition of a graphical user interface (GUI) control, the method comprising capturing a screenshot of a GUI of a computerized application, determining a cursor position in the screenshot, analyzing an area surrounding the cursor position, to identify a GUI control, and storing an image of the GUI control.

主权项

1. A method for automatic extraction of an image of a control in a graphical user interface (GUI), the method comprising:
capturing a first screenshot of a GUI of a computerized application, and automatically analyzing said first screenshot to identify a scroll bar by extracting at least one parameter of the scroll bar from within the first screenshot; automatically operating said scroll bar to reveal a previously-invisible region of said GUI, and capturing a second screenshot of said previously-invisible region; receiving coordinates of at least one position from a user in at least one of said first screenshot and said second screenshot; analyzing an area surrounding said at least one position, to identify at least one GUI control; and storing an image of said at least one GUI control separate from the first screenshot of the GUI or the second screenshot of the GUI from which the image of the GUI control is taken.