Techniques for machine language translation of text from an image based on non-textual context information from the image

摘要

A computer-implemented technique can include receiving, at a server from a mobile computing device, the server having one or more processors, an image including a text. The technique can include obtaining, at the server, optical character recognition (OCR) text corresponding to the text, the OCR text having been obtained by performing OCR on the image. The technique can include identifying, at the server, non-textual context information from the image, the non-textual context information (i) representing context information other than the text itself and (ii) being indicative of a context of the image. The technique can include based on the non-textual context information, obtaining, at the server, a translation of the OCR text to a target language to obtain a translated OCR text. The technique can include outputting, from the server to the mobile computing device, the translated OCR text.

主权项

1. A computer-implemented method, comprising:
receiving, at a server from a mobile computing device, the server having one or more processors, an image including a text; obtaining, at the server, optical character recognition (OCR) text corresponding to the text, the OCR text having been obtained by performing OCR on the image; identifying, at the server, non-textual context information from the image, the non-textual context information (i) representing context information other than the text itself, (ii) being indicative of a context of the image, and (iii) including at least a color of an object in the image; based on the color of the object, determining, at the server, whether the image was captured indoors or outdoors; based on (i) the non-textual context information and (ii) whether the image was captured indoors or outdoors, obtaining, at the server, a translation of the OCR text to a target language to obtain a translated OCR text; and outputting, from the server to the mobile computing device, the translated OCR text.