| 摘要 |
Method for creating a final real-time photorealistic image of a virtual object, corresponding to a real object arranged on an original photo of a user, in a realistic orientation related to the user's position, includes: detecting the presence of an area for the object in the photo; determining the position of characteristic points of the area for the object in the photo; determining the 3D orientation of the face, the angles Φ and Ψ of the camera having taken the photo relative to the principal plane of the area; selecting the texture to be used for the virtual object, in accordance with the angle-of-view, and generating the view of the virtual object in 3D; creating a first layered rendering in the correct position consistent with the position of the placement area for the object in the original photo; obtaining the photorealistic rendering by adding overlays to obtain the final image. |
| 主权项 |
1. A method for creating a real-time photorealistic image of a virtual object arranged in a realistic orientation related to a position of a user, the method comprising the following steps:
detecting a presence of a placement area for the virtual object in a first photo with a displayed user face, determining a position of characteristic points of the placement area for the virtual object in the first photo, wherein said determining step comprises i) determining a similarity β, to be applied to the first photo, to obtain a face similar to a reference face in magnification and orientation, and ii) determining characteristic points including a position of a precise exterior corner A and a precise interior point B for each eye in the displayed user face of the first photo, and determining a 3D orientation of the displayed user face, including angles Φ and ψ of a camera having taken the first photo relative to a principal plane of the placement area for the virtual object, the virtual object corresponding to a real object, and the angles Φ and ψ of the camera respectively correspond to a angle of rotation around a y-axis and an angle of rotation around an x-axis, selecting a texture to be used for the virtual object, in accordance with an angle-of-view, and generating a view of the virtual object in a 3D (Φ, ψ)/2D (Θ, s) position in question, where “s” represent a scale magnification factor and “Θ” represents a rotation Θ to be applied to an image of the virtual object, creating a first rendering by establishing a layered rendering in a correct position consistent with the position of the placement area for the virtual object in the first photo, and obtaining the photorealistic rendering by adding overlays, referred to as semantic overlays, so as to obtain a final image. |
