Method and devices for visualising a digital model in a real environment

摘要

The invention relates to a method and devices for enabling a user to visualize a virtual model in a real environment. According to the invention, a 2D representation of a 3D virtual object is inserted, in real-time, into the video flows of a camera aimed at a real environment in order to form an enriched video flow. A plurality of cameras generating a plurality of video flows can be simultaneously used to visualize the virtual object in the real environment according to different angles of view. A particular video flow is used to dynamically generate the effects of the real environment on the virtual model. The virtual model can be, for example, a digital copy or virtual enrichments of a real copy. A virtual 2D object, for example the representation of a real person, can be inserted into the enriched video flow.

主权项

1. A method for visualization in real time of a three-dimensional virtual object in a real environment, the method comprising:
reception of at least one video stream comprising a representation of at least one real object different from the virtual object; insertion in real time of a two-dimensional representation of said three-dimensional virtual object into said at least one received video stream while masking a part of the virtual object by the at least one real object as a function of a three-dimensional model associated with the at least one real object and of a position of the at least one real object, and creation of at least one augmented video stream comprising said at least one received video stream into which said two-dimensional representation of said three-dimensional virtual object has been inserted; reception of a video stream of a second type, said at least one video stream being at least one video stream of first type, said video stream of a second type enabling to determine dynamically the reflections of said real environment in said three-dimensional virtual object; update of at least one dynamic environment with data from said video stream of the second type, said data representing changes in the reflections of said real environment on said virtual object, said changes resulting from modification of said real environment or movement of said virtual object; combination of said dynamic management of said reflections with a static management of said reflections by combining said at least one dynamic environment maps with at least one static environment map according to their respective degree of influence; and transmission of said at least one augmented video stream.