Input Cueing Emmersion System and Method

摘要

An input cueing system and method that allows a user to manually draw an image, input text, interface and gesture on an input surface, which is then brought into a computer such that the visual output from the computer is combined in an overlapping manner with the visual imagery of the user's hands, and then shown on a display. Located above the drawing surface is an image capturing device that captures live video images of the user's hands or other objects placed on the drawing surface. One or more reflectors and/or image repeating devices are disposed between the input surface and the image capturing device to effectively reduce the height and/or focal length so that the visual image is properly aligned and oriented to provide a real ‘live’ view of the users hands and/or action on the display. A combiner module combine the visual action on and/or about the input surface with the visual output from a computer or computing device, so that the resulting combined visual imagery may be simultaneously transmitted and on a display, with the users hands, fingers and/or tools shown in a semi-transparent and/or opaque manner.

主权项

1. An input cueing system for simultaneously viewing in real time the image of a user's hands or fingers positioned over the input device that overlays a virtual input image, the system comprising:
an electronic device that includes an electronic controller; a processing device connected to the electronic controller, and a display connected to the electronic device and positioned in the user's field of view; an input device coupled to the electronic controller, the input device includes an input area in which the user moves at least one hand or at least one finger that creates an input area signal that is transmitted to the electronic controller; a software program configured to produces the virtual input image presentational on the display that uses the input area signal from the input device; an image capturing device coupled to the electronic device disposed above and aimed at the input area that produces a realistic real time image of the user's hand or finger in the input area, the image capturing device includes at least one mirror disposed below the direct field of view of the display thereby providing the user an unobstructed view of the display and above the input area and aimed to capture and reflect the image of or about the input area or of or about area that is not part of the input area or a combination of or about the input area and or about area that is not part of the input area in various amounts between with different field of views, areas, sizes and angles in various amounts and combinations, and at least one camera located about the input area and below the direct field of view of the display thereby providing the user an unobstructed view of the display, wherein the camera is aimed at the image capturing device to receive the reflected image from the image capturing device;and,
a combiner coupled to the electronic device configured to simultaneously present an overlying image of the user's hands or finger on the display that is aligned and registered over the virtual input image that allows the user to accurately and expediently input information into the electronic device.