Method, apparatus and system for projecting light for user guidance

摘要

Embodiments of an apparatus, system and method for creating light projection solutions for user guidance are described herein. A user may request that projected light be used to assist in a plurality of operations involving objects in the physical space around the user. A user can use voice commands and hand gestures to request that a projector project light or images on or near objects involved in one or more operations. Embodiments of the disclosure perform an image recognition process to scan the physical space around the user and to identify any user gesture performed (e.g., a user pointing at a plurality of objects, a user holding an object); a steerable projector may be actuated to project light or image data based on the user's request and a plurality of operations associated with the objects.

主权项

1. A method comprising:
analyzing a voice command acquired with an audio sensor to determine that a user is requesting projected light guidance associated with a plurality of objects; analyzing a user gesture acquired with an image sensor to identify with which of the plurality of objects located near the user the request for projected light guidance is associated; receiving first image data from the image sensor of the plurality of objects near the user in response to the user gesture and the voice command; performing an image recognition process on the first image data to associate the plurality of objects with one or more operations involving the plurality of objects; and for each of the operation(s):
identifying one or more of the plurality of objects involved in the operation;actuating a projector towards the object(s) involved in the operation;projecting light on or near the object(s) involved in the operation;receiving second image data from the image sensor of the plurality of objects near the user; anddetermining from the second image data that the respective operation has been completed.