Touch Screen Testing Platform for Engaging a Dynamically Positioned Target Feature

摘要

A touch screen testing platform may be used to engage a dynamically positioned target feature being displayed on a touch screen enabled device during a testing protocol. The platform may record imagery displayed by the touch screen device and then analyze the imagery to locate the target feature within a reference coordinate system. The platform may recognize that the target feature is missing from the imagery and respond by causing the touch screen device to scroll through a command menu and/or toggle through virtual screens. Once located, the platform may instruct a robotic device tester to select the target feature by contacting the touch screen at the identified location using a conductive tip designed to simulate a user's fingertip. Prior to running a test, the camera may be focused to a point that is offset from the display screen of the touch screen device.

主权项

1. A method comprising:
determining a plurality of instructions to cause a robot to move a tip to selectively engage a touch screen of a touch screen device to provide the touch screen device with inputs corresponding to a testing protocol, wherein the touch screen is within a field-of-view of a camera, and wherein the inputs simulate user interactions with the touch screen device; executing a first instruction, of the plurality of instructions, to cause the robot to provide the touch screen device with a first input, the first input causing the touch screen device to display imagery that includes at least a target feature; receiving, from the camera, a recording of the imagery that includes at least the target feature; identifying, based on the recording of the imagery, a location of the target feature within the field-of-view of the camera; and based on the identifying the location of the target feature, executing a second instruction to cause the robot to move the tip to selectively engage the touch screen at the location of the target feature thereby providing the touch screen device with a second input that is associated with the target feature.