VIDEO ADDITIONAL INFORMATION RELATIONSHIP LEARNING DEVICE, METHOD AND PROGRAM

摘要

PROBLEM TO BE SOLVED: To provide a video additional information relationship learning device which uses both image information and acoustic information included in a video and considers their mutual co-occurrence relation, thereby highly accurately learning relationship between those information and linguistic information.

SOLUTION: In a video additional information relationship learning device, an accumulation image feature extraction unit 5 extracts a complete accumulation image feature and an incomplete accumulation image feature from each of a complete accumulation video and an incomplete accumulation video. An accumulation acoustic feature extraction unit 6 extracts a complete accumulation acoustic feature and an incomplete accumulation acoustic feature from each of the complete accumulation video and the incomplete accumulation video. An accumulation additional information feature extraction unit 4 extracts an accumulation additional information feature from each of the accumulation additional information. An accumulation latent variable extraction unit 8 extracts an accumulation latent variable group which is a group of variables for describing relationship between the video and the additional information. An inter-video/additional information relationship learning unit 9 learns a video/additional information relation model which is a model for describing relationship between the video and the additional information.

COPYRIGHT: (C)2013,JPO&INPIT