Making static printed content dynamic with virtual data

摘要

The technology provides embodiments for making static printed content being viewed through a see-through, mixed reality display device system more dynamic with display of virtual data. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. A task in relation to the printed content selection can also be determined based on physical action user input. Virtual data for the printed content selection is displayed in accordance with the task. Additionally, virtual data can be linked to a work embodied in a printed content item. Furthermore, a virtual version of the printed material may be displayed at a more comfortable reading position and with improved visibility of the content.

主权项

1. A method for making static printed content dynamic with virtual data using a near eye, mixed reality display device comprising:
identifying a real printed content item in a field of view of a near eye, mixed reality display device; identifying user selection of a real printed content selection within the real printed content item based on physical action user input; determining a task requested for the real printed content selection based on physical action user input; performing the task; and displaying virtual data related to the real printed content selection in accordance with the task wherein the task further comprises displaying a virtual version of the real printed content selection at a first position in the field of view of the near-eye, mixed reality display device which is independent of a second position of the real printed content item with respect to the field of view of the display device, and updating display of the virtual version of the real printed content selection responsive to physical action input of the user.