Gaze intent estimation for retargeting of characters

摘要

Any image capturing system, and a method to use same, that includes one or more image capturing devices that have known and fixed positions relative to one another and the eye of a subject, wherein the image capturing devices capture a plurality of images of eye of a subject during a performance is disclosed. The images of the eye, along with the known and fixed relative positions of the image capturing devices are used define eye-lines for the eye of the subject. The eye-lines can then be used to manually or automatically retarget the eye of a rendered or animated figure based on the performance of the subject to retarget the gaze intent of the rendered or animated figure within a scene.

主权项

1. In a computer aided animation system, a method for retargeting the gaze of a rendered image comprising:
determining an eye-line of an eye model using a computer system, wherein the eye model is simulated in virtual space; determining a gaze-object at which the eye model is directed in response to the eye-line using the computer system, wherein the gaze-object is a moving object upon which the gaze is fixed; determining a relative change in position of the gaze-object relative to the eye model using the computer system; adjusting the eye-line of the eye model to remain on the gaze-object to remain on the designated gaze-object during the change in position, wherein the adjusting uses stored data including at least one correlation between an eye-line and an eye image; rendering an image of the eye model in response to the adjusted eye-line of the eye model using the computer system; and displaying the rendered image with an adjusted image of the eye on an output device using the computer system.