Tap to initiate a next action for user requests

摘要

Embodiments may relate to intuitive user-interface features for a head-mountable device (HMD), in the context of a hybrid human and computer-automated response system. An illustrative method may involve a head-mountable device (HMD) that comprises a touchpad: (a) sending a speech-segment message to a hybrid response system, wherein the speech-segment message is indicative of a speech segment that is detected in audio data captured at the HMD, and wherein the speech-segment is associated with a first user-account with the hybrid response system, (b) receiving a response message that includes a response to the speech-segment message and an indication of a next action corresponding to the response to the speech-segment message, (c) displaying a card interface that includes an indication of the response, and (d) while displaying the response, detecting a singular touch gesture and responsively initiating the at least one next action.

主权项

1. A method carried out by a head-mountable device comprising:
sending, a speech-segment message to a hybrid response system in response to detecting a first singular touch gesture on a touchpad of the head-mountable device (HMD),
wherein the HMD comprises a near-eye display, and wherein the touchpad is located on a side-arm of the HMD,wherein the speech-segment message is indicative of a speech-segment detected in audio data captured at the HMD by at least one microphone, wherein the speech-segment is associated with a first user-account with the hybrid response system, and wherein the speech-segment message comprises an initial query; receiving, at the HMD, a response message from the hybrid response system, wherein the response message comprises: both (a) an answer to the initial query and (b) an indication of a next action to be cued in anticipation of the initial query, wherein the next action is an anticipated actionable follow-up request related to the answer of the initial query; and in response to receiving the response message:
displaying, on the HMD, a first card interface that includes an indication of the answer to the initial query; andwhile displaying the first card interface that indicates the answer to the initial query, detecting touchpad data corresponding to a second singular touch gesture on the touchpad and responsively initiating the next action corresponding to the anticipated follow-up request originally indicated in the response message by displaying a second card interface of a cued next action.