ASSESSING PACKET LOSS VISIBILITY IN VIDEO

摘要

The invention presents a new NR-H method for assessment of packet loss visibility measure for a video sequence, where the measure is indicative of the effect on the perceptual quality of the video. Packet loss can occur as a result of the video being transmitted over an imperfect network. The invention combines dynamic modelling of temporal and spatial properties of the decoded pictures with bitstream information revealing location, extent and propagation of any errors. Analysis is performed on blocks of pixels, and preferably the macroblocks defined in the particular video encoding scheme. Knowledge of the error extent from the bitstream information is used to target spatial analysis around the specific error locations. Perceptual impact is estimated by utilising spatio-temporal modelling to predict the properties of a missing block, and comparing those predictions with the actual properties of the missing block.

主权项

1. A method of determining error visibility resulting from packet loss in a video sequence, said video sequence comprising a plurality of frames, each frame comprising a plurality of blocks, said method comprising:
(i) identifying a block affected by packet loss in one of the plurality of frames, wherein the frame containing the identified block is the current frame; (ii) determining an expected temporal measure associated with the identified block based on a temporal difference of the area associated with the identified block across a plurality of the preceding frames; (iii) determining an expected spatial measure associated with the identified block based on a spatial difference between the identified block and one or more blocks neighbouring the identified block, the spatial difference considered over a plurality of preceding frames; (iv) comparing the determined expected temporal measure with the actual temporal measure for the identified block, wherein the actual temporal measure is based on a temporal difference of the area associated with the identified block in the current and at least, one preceding frame; (v) comparing the determined expected spatial measure with the actual spatial measure for the identified block, wherein the actual spatial measure is based on a spatial difference between the identified block and one or more blocks neighbouring the identified block in the current frame; (vi) determining a measure of error visibility of the identified block based on the said comparisons.