Heterogeneous image sensor synchronization

摘要

A computer implemented method for synchronizing information from a scene using two heterogeneous sensing devices. Scene capture information is provided by a first sensor and a second sensor. The information comprises video streams including successive frames provided at different frequencies. Each frame is separated by a vertical blanking interval. A video output comprising a stream of successive frames each separated by a vertical blanking interval is rendered based on information in the scene. The method determines whether an adjustment of the first and second video stream relative to the video output stream is required by reference to the video output stream. A correction is then generated to at least one of said vertical blanking intervals.

主权项

1. A computer-readable storage device including instructions for programming a processor to execute the instructions, the instructions when executed comprising:
receiving a first series of image capture frames at a first frequency from a depth image sensor, each frame having first timing information associated with each of the first series, and a second series of image capture frames at a second frequency, different from the first frequency, from a RGB image sensor, each frame having second timing information associated with each of the second series; rendering a video output comprising a series of output frames, each frame in the output series having third timing information and correlated to one or more of the first series of image capture frames and one or more of the second series of image capture frames; determining whether the first timing information, the second timing information, and third timing information require an adjustment between the first sensor, the second sensor and the video output; determining a correction for said adjustment; and applying a one-time correction to increase or decrease a default length of one or more vertical blanking intervals between successive frames in one or more of the first series, the second series or the video output, and resetting the default length to a default value upon receipt of next successive frames.