AUGMENTED REALITY VIRTUAL PERSONAL ASSISTANT FOR EXTERNAL REPRESENTATION

摘要

A computing system for virtual personal assistance includes technologies to, among other things, correlate an external representation of an object with a real world view of the object, display virtual elements on the external representation of the object and/or display virtual elements on the real world view of the object, to provide virtual personal assistance in a multi-step activity or another activity that involves the observation or handling of an object and a reference document.

主权项

1. A computing system for virtual personal assistance, the computing system comprising, embodied in one or more computing devices:
a scene understanding module to algorithmically analyze a video depicting a real world scene of a multi-step activity and detect, in the video, a physical object involved in the multi-step activity; a correlation module to determine a correlation between a document comprising an external representation of the physical object with the video depiction of the object in the real world scene; an input understanding module to, using the correlation, interpret user input relating to a step of the multi-step activity and relating to at least a portion of the external representation; and a visual output generator to, in response to the interpreted user input, display a virtual element on one or more of a real world view of the physical object and a view of the document, the virtual element based on the correlation.