Method of encoding and decoding multiview video sequence based on adaptive compensation of local illumination mismatch in inter-frame prediction

摘要

A technology for processing digital signals is provided, and more particularly, a method of encoding or decoding a multiview video sequence based on adaptive compensation of local illumination mismatches between frames of the multiview video sequence is provided. The method may be performed using a correction parameter used to correct a change in illumination. The correction parameter may be computed based on at least one of a first estimate estDi,j, a second estimate estRi,j, a value Ri,j of a pixel of a reference block, and values TDk and TRk of restored pixels.

主权项

1. A method of adaptively compensating for a local illumination mismatch in inter-frame prediction during encoding and decoding of a multiview video sequence, the method being performed by a computer system and comprising:
obtaining a value of a pixel of a current encoded block included in an encoded frame, and a value of a pixel of a reference block included in a reference frame; obtaining values of pixels restored by encoding and then decoding, from a vicinity of the current encoded block, and from a vicinity of the reference block; excluding from consideration a pixel included in the vicinity of the current encoded block and a pixel included in the vicinity of the reference block, the excluded pixels being estimated to be unreliable for computation of a correction parameter used to correct a change in illumination based on at least one preset criterion; determining a numerical ratio between brightness of pixels of the reference block, a numerical ratio between brightness of reliable pixels located in the vicinity of the current encoded block, and a numerical ratio between brightness of reliable pixels located in the vicinity of the reference block; computing the correction parameter based on the determined numerical ratios considering an initial value; and estimating a change in values of pixels of the reference block, wherein, when the change in the values of the pixels is estimated to be essential, the values of the pixels of the reference block are corrected using the computed correction parameter, and wherein the computing of the correction parameter comprises computing a ratio of a first estimate estDi,j for position (i, j) of a pixel of the pixels in the current encoding block and a second estimate estRi,j for position (i, j) of a pixel of the pixels in the reference block, and computing the correction parameter to beαi,j=est⁢⁢Di,jest⁢⁢Ri,j,when the second estimate is not equal to zero, and setting the correction parameter αi,j to “1,” when the second estimate is equal to zero.