Interactive information processing system responsive to user manipulation of physical objects and displayed images

摘要

An information processing system includes a desk with a planar display unit which also accommodates physical objects to be manipulated by the operator. The physical objects are representative of physical objects normally used in office environments when handling paper files. A camera is provided which continuously monitors the desk display surface and is coupled to an electronic computer which can be controlled by the operator by moving the physical objects and the operator hands to simulate paper processing tasks, such as mailing, faxing, filing, opening files, editing and the like. An operator driven menu is provided on the desk display surface for facilitating operator classification and storage of physical object shapes of those physical objects which are to be used.