Image-driven view management for annotations

摘要

A mobile device uses an image-driven view management approach for annotating images in real-time. An image-based layout process used by the mobile device computes a saliency map and generates an edge map from a frame of a video stream. The saliency map may be further processed by applying thresholds to reduce the number of saliency levels. The saliency map and edge map are used together to determine a layout position of labels to be rendered over the video stream. The labels are displayed in the layout position until a change of orientation of the camera that exceeds a threshold is detected. Additionally, the representation of the label may be adjusted, e.g., based on a plurality of pixels bounded by an area that is coincident with a layout position for a label in the video frame.

主权项

1. A method comprising:
storing one or more labels to be rendered; capturing a video stream of an environment with a camera; computing a saliency map of at least one frame from the video stream; generating an edge map with edges extracted from the at least one frame; using the saliency map and the edge map together to determine a first layout position of the one or more labels to be rendered over the video stream; rendering the one or more labels over the video stream in the first layout position as the video stream is displayed; detecting a change in orientation of the camera with respect to the orientation in a previous frame that is greater than a threshold; and displaying the one or more labels in the first layout position until the change in orientation of the camera is detected.