Telestration system for command processing

摘要

In one embodiment, a method detects a user input for a telestration on an image being displayed on a display device and determines a plurality of image portions of the image based on the telestration. The plurality of image portions are determined by a boundary around each image portion based on the telestration. The method then determines a set of tags for the plurality of image portions. The set of tags are determined based on image recognition of content in the plurality of image portions. An operator is determined based on the telestration where the operator characterizes an operation to perform for the plurality of image portions. The method determines a search query based on applying the operator to the set of tags and causes a search to be performed using the search query.

主权项

1. A method comprising:
detecting, by a computing device, a user input for a telestration on an image being displayed on a display device; determining, by the computing device, a plurality of image portions of the image based on the telestration, wherein the plurality of image portions are determined by a boundary around each image portion based on the telestration; determining, by the computing device, a set of tags for the plurality of image portions, wherein the set of tags are determined based on image recognition of content in the plurality of image portions; determining, by the computing device, an operator based on the telestration, wherein the operator characterizes an operation to perform for the plurality of image portions; determining, by the computing device, a search query based on applying the operator to the set of tags; and causing, by the computing device, a search to be performed using the search query.