Authoring multi-finger interactions through demonstration and composition

摘要

A computing device comprises a processor and an authoring tool executing on the processor. The processor receives demonstration data representative of at least one demonstration of a multi-finger gesture and declaration data specifying one or more constraints for the multi-finger gesture. The processor generates, in accordance with the demonstration data and the declaration data, a module to detect the multi-finger gesture within a computer-generated user interface.

主权项

1. A method comprising:
receiving, at a processor of a computing device, first demonstration data representative of a demonstration of a first multi-finger gesture; receiving, at the processor, second demonstration data representative of a demonstration of a second multi-finger gesture; receiving, at the processor, declaration data specifying one or more constraints associated with one or more of the first multi-finger gesture or the second multi-finger gesture; outputting, by the processor and in response to input indicative of selection by the user, a first graphical video clip representation of the first multi-finger gesture along a timeline; outputting, by the processor and in response to input indicative of selection by the user, a second graphical video clip representation of the second multi-finger gesture along the timeline; receiving input temporally arranging the first graphical video clip and the second graphical video clip along the timeline to form a compound multi-finger gesture that includes the first multi-finger gesture and the second multi-finger gesture; and generating, by the processor and in accordance with the first and second demonstration data, the declaration data, and temporal constraints defined by the temporal arrangement of the first graphical video clip and the second graphical video clip along the timeline, a module configured to support the compound multi-finger gesture within a computer-generated user interface.