INPUT CUEING EMMERSION SYSTEM AND METHOD

摘要

An input cueing system and method that allows a user to manually draw an image, input text, interface and gesture on an input surface, which is then brought into a computer such that the visual output from the computer is combined in an overlapping manner with the visual imagery of the user's hands, and then shown on a display. Located above the drawing surface is an image capturing device that captures live video images of the user's hands or other objects placed on the drawing surface. One or more reflectors and/or image repeating devices are disposed between the input surface and the image capturing device to effectively reduce the height and/or focal length so that the visual image is properly aligned and oriented to provide a real ‘live’ view of the users hands and/or action on the display. A combiner module combine the visual action on and/or about the input surface with the visual output from a computer or computing device, so that the resulting combined visual imagery may be simultaneously transmitted and on a display, with the users hands, fingers and/or tools shown in a semi-transparent and/or opaque manner.

主权项

1. An input cueing system for simultaneously viewing in real time the image of a user's hands or fingers positioned over the input device that overlays a virtual input image, the system comprising:
an electronic device; a processing device connected to the electronic device; a display connected to the electronic device and positioned in the user's field of view; an input device coupled to the electronic device, the input device includes an input area in which the user moves at least one hand or at least one finger that creates an input area signal that is transmitted to the electronic device; a software program configured to produces the virtual input image presentational on the display that uses the input area signal from the input device;
an image capturing device coupled to the electronic device disposed below the direct field of view of the display thereby providing the user an unobstructed view of the display and above the input area that produces a realistic real time image of the user's hand or finger in the input area,the image capturing device includes at least 2 cameras as part of an array, that provide imagery of the input area or not or in combination of the input area and area that is not part of the input area, that is assembled as part of a composite view and,
a combiner coupled to the electronic device configured to simultaneously present an overlying image of the user's hands or finger on the display that is aligned and registered over the virtual input image that allows the user to accurately and expediently input information into the electronic device.