Signal processing method and apparatus based on multiple textures using video sensor excitation signals

摘要

Disclosed herein is a signal processing apparatus and method based on multiple textures using video sensor excitation signals. For this, an input signal that includes a video signal and a sensor signal is divided into unit component signals, and one is selected from a plurality of frames of each unit component signal as a seed signal. A plurality of texture points are detected from the seed signal. The texture points are tracked from the frames of the unit component signal and then spatio-temporal location transform variables for the texture points are calculated. Texture signals are defined using texture points at which the spatio-temporal location transform variables correspond to one another. Each of the texture signals is defined as a sum of a plurality of texture blocks that are outputs of texture synthesis filters that receive video sensor excitation signals as inputs.

主权项

1. A signal processing method based on multiple textures, comprising:
dividing an input signal that includes a video signal and a sensor signal into unit component signals, and selecting one from a plurality of frames of each unit component signal as a seed signal; detecting a plurality of texture points from the seed signal; tracking the plurality of texture points from the plurality of frames of the unit component signal and then calculating spatio-temporal location transform variables for the respective texture points; defining a plurality of texture signals using texture points at which the spatio-temporal location transform variables correspond to one another; and defining each of the plurality of texture signals as a sum of a plurality of texture blocks that are outputs of texture synthesis filters that respectively receive video sensor excitation signals as inputs.