Method and Apparatus of Video Compression for Non-stitched Panoramic Contents

摘要

Methods and apparatus of compression for non-stitched pictures captured by multiple cameras of a panoramic video capture device are disclosed. According to one embodiment, the system uses a RIBC (Remapped Intra Block Copy) mode, where the block vector (BV) or BV predictor is remapped using calibration data to reduce the search range. The mapped BV or BVP is also more efficient for coding. A color scaling process can be used with the RIBC mode to compensate the color/brightness discrepancy between images from different cameras. A projection-based Inter prediction method is also disclosed. The projection-based Inter prediction method takes into account different perspectives between two images captured from different cameras. Transform matrix is applied to a block candidate to project the block candidate to a position of a target block. The projected block candidate is used as a predictor for the target block.

主权项

1. A method of video encoding of non-stitched pictures for a video encoding system, wherein each non-stitched picture comprises at least two images captured by two cameras of a panoramic video capture device, and wherein two neighboring images captured by two neighboring cameras include at least an overlapped image area, the method comprising:
receiving panoramic video source data comprising a current block in a current non-stitched picture; receiving calibration data associated with the panoramic video capture device from the panoramic video source data, wherein the calibration data comprise camera parameters, feature detection results, or both; and when the calibration data exist, applying an encoding process to the current block by utilizing the calibration data for at least one operation of the encoding process.