Apparatus and method for tutoring in convergence space of real and virtual environment

摘要

An apparatus for tutoring in a convergence space of real and virtual environment, includes a character data processing unit for generating character shape and operation data of a participant or performing rendering on the character shape and operation data; a desk data processing unit for generating desk shape data or perform the rendering on the desk shape data; a voice and sound data processing unit for generating voice or sound data or outputs the voice or sound data; and a virtual space processing unit for generating real space data and providing the generated data to another participant, generating the convergence space data, or generating the character shape data, the operation data, the desk shape data, and the voice or sound data, then providing the generated data to the character data processing unit, the desk data processing unit, and the voice and sound data processing unit.

主权项

1. A method for tutoring using a convergence space, the method comprising:
generating tutor image data from an image of a tutor in a first real space and generating character shape and operation data of a tutor by capturing a character image of the tutor; generating participant image data from an image of a participant in a second real space and generating voice or sound data based on voice or sound generated in a tutoring environment; generating real space data virtualized by using the character shape data and the voice or sound data and providing the generated real space data to the participant through a communication network; providing the tutor image data and the participant image data to the convergence space; generating tutor object data from a first real object in the first real space; generating participant object data from a second real object in the second real space; providing the tutor object data and the participant object data to the convergence space; providing convergence space data to the tutor and the participant, the convergence space data including convergence object data which comprises the first real object data and the second real object data; detecting an alteration to the first real object by the tutor; updating the convergence object data based on the alteration to the first real object by the tutor; and synchronizing the second object with the first object by projecting a first altered object image based on the convergence object data onto the second real object using a projector, wherein a three-dimensional character shape generated by applying a structured from motion method to the character image and three-dimensional operation data is generated by analyzing object deformation configured from the changing three-dimensional shape, wherein the character shape and operation data are transformed by referring to a character selected or preferred by the participant.