Action broker

摘要

Among other things, one or more techniques and/or systems are provided for building an action catalogue, generating an action frame for an action within the action catalogue, and/or executing an action. In an example, an action may be included within the action catalogue based upon descriptive text associated with an application indicating that the application is capable of performing the action (e.g., a movie app may be capable of performing an order movie tickets action). A parameter (e.g., a movie name) and/or an execution endpoint (e.g., a uniform resource identifier used to access movie ticket ordering functionality) may be used to generate an action frame for the action. In this way, user intent to perform an action may be identified from user input (e.g., a spoken command), and the action may be performed (e.g., on behalf of the user with minimal additional user input) by using the action frame.

主权项

1. A computer system, comprising:
one or more processors; and one or more computer-readable media having stored thereon computer-executable instructions that are executable by the one or more processors, and that configure the computer system to provide an action frame utilizing functionality from a plurality of different network-connected computer-executable applications, including computer-executable instructions that configure the computer system to perform at least the following: identify a plurality of different network-connected computer-executable applications that are accessible to the computer system; generate an action catalog identifying, for each of the plurality of different computer-executable applications, one or more corresponding actions, including, for at least a particular computer-executable application of the plurality of different computer-executable applications:
parsing one or more descriptive texts corresponding to the particular computer-executable application, to identify at least one particular action that may be provided by the particular computer-executable application; andpopulating the action catalog with the at least one particular action in association with the particular computer-executable application; based at least on having generated the action catalog, generate an action frame for each of the one or more actions, each action frame identifying how to invoke a fillable form at a corresponding computer-executable application to carry out a corresponding action, including, for the at least one particular action:
identifying at least one fillable form of the particular computer-executable application for carrying out the at least one particular action, the at least one fillable form including one or more parameters for receiving user-supplied values to use as part of carrying out the at least one particular action;extracting the one or more parameters from the at least one fillable form;identifying at least one execution endpoint that is usable for invoking the at least one fillable form of the particular computer-executable application; andpopulating a particular action frame with the one or more parameters and with the at least one execution endpoint; subsequent to generating the action frame, identify a user intent to perform the least one particular action; based at least on identifying the user intent to perform the at least one particular action, identify the particular action frame; and based at least on identifying the particular action frame, invoke the least one execution endpoint over a network using at least one user-supplied value for at least one of the one or more parameters as input to the at least one fillable form.