Interacting with an Assistant Component Based on Captured Stroke Information

摘要

A computer-implemented technique is described herein that receives captured stroke information when a user enters handwritten notes using an input capture device. The technique then automatically performs analysis on the captured stroke information to produce output analysis information. Based on the output analysis information, the technique uses an assistant component to identify a response to the captured stroke information and/or to identify an action to be performed. The technique then presents the response, together with the original captured stroke information. In addition, or alternatively, the technique performs the action. In one case, the response is a text-based response; that text-based response may be presented in a freeform handwriting style to give the user the impression that a virtual assistant is responding to the user's own note. In another case, the response engages the user in an interactive exercise of any type.

主权项

1. A computer-readable storage medium for storing computer-readable instructions, the computer-readable instructions, when executed by one or more processing devices, performing a method that comprises:
receiving captured stroke information from an input capture device, the input capture device producing the captured stroke information in response to capturing freehand ink strokes made by a user on an input surface associated with the input capture device; transforming the captured stroke information into recognized stroke information; automatically performing analysis on the recognized stroke information to generate output analysis information; identifying, without being prompted to do so by the user, a response to the captured stroke information based on the output analysis information, and/or an action to be performed based on the output analysis information; displaying the captured stroke information on a canvas display device; and presenting the response to the user and/or performing the action.