Method and apparatus for image processing in augmented reality systems

摘要

Disclosed are a system, apparatus, and method for depth and color camera image synchronization. Depth and color camera input images are received or otherwise obtained unsynchronized and without associated creation timestamps. An image of one type is compared with an image of a different type to determine a match for synchronization. Matches may be determined according to edge detection or depth coordinate detection. When a match is determined a synchronized pair is formed for processing within an augmented reality output. Optionally the synchronized pair may be transformed to improve the match between the image pair.

主权项

1. A method for depth and color camera image synchronization, the method comprising:
obtaining a plurality of input images comprising a first image type and a second image type different from the first image type, wherein an image type is either a depth camera image type or color camera image type, wherein each image type is unsynchronized with respect to images of other types, and wherein each of the plurality of input images of the first image type and of the second image type are without identification of an input image's actual creation time; selecting, from input images of the first image type, a target image; selecting, from input images of the second image type, a comparison image; determining whether the comparison image is compatible for synchronization with the target image; in response to a determination that the comparison image is compatible for synchronization with the target image, identifying the target image and the comparison image as a synchronized image pair; and processing the synchronized image pair comprising the target image of the first image type and the comparison image of the second image type together for use in an augmented reality output.