APPARATUS AND METHOD FOR PERFORMING VIRTUAL MUSICAL INSTRUMENT ON THE BASIS OF FINGER-MOTION

摘要

PURPOSE: A virtual instrument playing device and method based on finger motions are provided to enable a single or multiple users to play an instrument in any space with no physical instrument without constraints of space. CONSTITUTION: A motion acquisition part(200) acquires information about finger motions of a user by processing image data acquired by an image acquisition part(100). A sound information simulation part(300) simulates and stores sound information of an instrument in accordance with a finger posture. A sound information configuration part(400) generates sound information of the instrument for the finger motions by using the acquired information about the finger motions and a neural network where learning is performed by the sound information simulation part. [Reference numerals] (100) Image acquisition part; (200) Motion acquisition part; (300) Sound information simulation part; (400) Sound information configuration part; (500) Sound information output part; (600) Multiple motion management part