System and method for obtaining information relating to video images

摘要

A system and method is provided where, in one aspect, a user signals that the user is interested in a particular image being displayed as part of a video, wherein objects in the image are detected and recognized, and wherein an action is taken based on information associated with the recognized objects. By way of example only, the actions may include recording a show (with or without a user's prior confirmation) or displaying information about a product in the image.

主权项

1. A method for presenting supplemental content, the method comprising:
receiving a request from a remote device to receive supplemental content relating to an item of interest presented in a first video; in response to receiving the request, obtaining a plurality of image data including a video frame of the first video corresponding to a time of the received request, at least one preceding video frame presented before the video frame, and at least one subsequent frame presented after the video frame; comparing, using a hardware processor, the plurality of image data from the video frame, the at least one preceding video frame, and the at least one subsequent frame to determine the item of interest; performing a search query based on the determined item of interest to identify the supplemental content; and transmitting, to the remote device, a response to the request that includes at least a portion of the supplemental content corresponding to the first video.