Scripting Cross-Device Wearable Interaction

摘要

Methods and apparatus for an interaction system specifying cross-device interaction are provided. The interaction system provides application program interfaces (APIs) and a scripting environment that allow development of scripts that combine user input and sensing events and distribute output and across devices to create a range of rich cross-device behaviors with minimal development. The interaction system includes an integrated environment for developers to author and test cross-device behaviors. When a script is ready, the script can be deployed on a network of mobile and wearable computing devices using the interaction system's runtime environment. An interaction system script can. An evaluation of the interaction system with twelve participants revealed that the interaction system significantly reduced developer effort for creating and iterating on cross-device behaviors. The interaction system allowed developers to focus on target interaction behaviors and high-level device capabilities, rather than low-level specifications.

主权项

1. A method, comprising:
receiving a script at an interaction system executing on a particular computing device, wherein the interaction system is configured to communicatively couple to one or more other computing devices; and executing the script using the interaction system, wherein the script, when executed by the interaction system, is configured to cause the interaction system to perform interaction-system functions, and wherein the interaction-system functions comprise:
selecting, by the interaction system, a first set of two or more devices based on one or more first selection criteria provided in the script, wherein the first set of two or more devices is selected from the particular computing device and the one or more other computing devices, and wherein the one or more first selection criteria comprise a body-centric criterion indicating a location on a body,determining, by the interaction system, that a first event has occurred, the first event related to a first designated device of the first set of two or more devices,in response to the first event, determining, by the interaction system, a first operation to perform on the first designated device, andinstructing, by the interaction system, the first designated device to perform the first operation.