主权项 |
1. An object motion estimating device that performs image analysis of captured images to estimate motion of an object, the captured images being the images of the object captured by an image capturing unit,
the object motion estimating device comprising an image analyzing unit, the image analyzing unit including a state estimating unit that performs sequential estimation of a state variable in an estimation model or an equation computing unit that solves simultaneous equations, and the image analyzing unit comprises: an intensity gradient computing unit that computes an intensity gradient at a particular point of the captured images; and a temporal gradient computing unit that computes a temporal gradient from the intensity gradient, wherein, in the estimation model, the state variable includes not only an optical flow by assuming that a time invariance that a first-order total differential of intensity of the object in the captured images with respect to time is zero holds as for the optical flow that is a velocity distribution of relative motion between the image capturing unit and the object, but also a spatial gradient of the optical flow by not assuming that translational movement that the object moves on a plane perpendicular to an image capturing axis of the image capturing unit holds, wherein the estimation model includes a measurement equation in which intensity of the spatial neighborhood of a particular point on the captured images is set to a measurement variable, wherein the state estimating unit performs the sequential estimation of the state variable to simultaneously estimate the optical flow and a spatial gradient of the estimated optical flow, wherein the simultaneous equations comprise: the estimation model and a temporal differentiation of the intensity included in the estimation model, and the optical flow, wherein a spatial gradient of the optical flow is set to a variable, and a temporal differentiation of the intensity and intensity gradient and second-order differential coefficients of the intensity and of the intensity gradient with respect to time are set to coefficients, wherein the equation computing unit solves the simultaneous equations to simultaneously estimate the optical flow and a spatial gradient of the estimated optical flow, and wherein the captured images are two-dimensional images having size of at least 3 pixels by 3 pixels, at least the three captured images whose image capturing times differ from one another are stored in a captured image storage unit, the intensity gradient computing unit computes intensity gradients Ix(x0,y0,t), Iy(x0,y0,t), Ixx(x0,y0,t), Ixy(x0,y0,t), and Iyy(x0,y0,t) of intensity I at a particular point P(x0,y0) of the captured images to determine a measurement variable z(t) expressed by an equation (eq1), the temporal gradient computing unit computes temporal gradients It, Itx, Ity, Itxx, Itxy, Ityy, Itt, Ittx, Itty, Ittxx, Ittxy, and Ittyy from the intensity I and the intensity gradients Ix, Iy, Ixx, Ixy, and Iyy, and the equation computing unit solves a linear equation (eq2) to simultaneously estimate the optical flow [u v]T and a spatial gradient [ux vx uy vy]T of the optical flow [u v]T:[Formula1]z(t)=[I(x0,y0,t)Ix(x0,y0,t)Iy(x0,y0,t)Ixx(x0,y0,t)Ixy(x0,y0,t)Iyy(x0,y0,t)](eq1)[ItItxItyItxxItxyItyyIttIttxIttyIttxxIttxyIttyy]=-[IxIy0000IxxIxyIxIy00IxyIyy00IxIy002Ixx2Ixy0000IxyIyyIxxIxy00002Ixy2IyyItxIty0000ItxxItxyItxIty00ItxyItyy00ItxIty002Itxx2Itxy0000ItxyItyyItxxItxy00002Itxy2Ityy][uvuxvxuyvy].(eq2) |