Automatic mobile photo capture using video analysis

摘要

A system creates an electronic file corresponding to a printed artifact by launching a video capture module that causes an imaging sensor of a mobile electronic device to capture a video of a scene that includes the printed artifact. The system analyzes image frames in the video in real time as the video is captured to identify a suitable instance. The suitable instance is a frame or sequence of frames that contains at least a portion of the printed artifact and that also satisfies one or more image quality criteria or other criteria. Upon identification of each suitable instance, the system will automatically cause a photo capture module of the device to capture a still image of the printed artifact. The still image has a resolution that is higher than that of the image frames in the video. The system will save the captured still images to a computer-readable file.

主权项

1. A method of creating an electronic file corresponding to a printed artifact, the method comprising, by one or more processors:
launching a video capture module of a mobile electronic device to capture a video of a scene that includes a printed artifact, wherein the video comprises a series of image frames; analyzing a plurality of the image frames in the series in real time as the video is captured to identify a suitable instance, wherein identifying the suitable instance comprises:
for each analyzed image frame, determining an image quality score for the image frame by:
extracting a set of image patches from the image frame,determining a feature vector for each of the patches from the image frame,pooling the determined feature vectors across the image frame, andretrieving a score for the image frame by processing the pooled features via a classifier; andidentifying a subset of one or more image frames in the series that satisfies one or more image quality criteria, wherein at least one of the criteria comprises a threshold image quality score representing machine readability of the printed artifact such that an image frame satisfies the criteria if it has an image quality score that exceeds the threshold image quality score; in response to identification of the suitable instance, without requiring user input, automatically causing a photo capture module to capture a still image of the printed artifact, wherein the still image has a resolution that is higher than a resolution of the image frames from the video; and saving the still image to a computer-readable file.