| 摘要 |
<p>PROBLEM TO BE SOLVED: To provide a desktop information device to realize a multi-modal operation by seamlessly coupling a real space with a virtual space in desktop environment. SOLUTION: Image and sound information inputted from an image input device 11 and a sound input device 12 is inputted into an operating environment analyzing part 3. The operating environment analyzing part 3 analyzes inputted information by referring to analysis knowledge stored in an environmental information storage part 4 and recognizes the states of the multi-modal user operation and the desktop environment to be changed according to the user operation, etc. Then, an analysis signal is outputted while matching the real space to the virtual space. An application interface part 5 generates representation information consisting of images and sounds on the basis of the inputted analysis signal. A representation information control part 6 provides the representation information to a user by controlling an image projector 13 and sound output devices 14, 15.</p> |
