Finding engaging media with initialized explore-exploit

摘要

Software for initialized explore-exploit creates a plurality of probability distributions. Each of these probability distributions is generated by inputting a quantitative description of one or more features associated with an image into a regression model that outputs a probability distribution for a measure of engagingness for the image. Each of the images is conceptually related to the other images. The software uses the plurality of probability distributions to initialize a multi-armed bandit model that outputs a serving scheme for each of the images. Then the software serves a plurality of the images on a web page displaying search results, based at least in part on the serving scheme.

主权项

1. A method, comprising operations of:
creating a first plurality of probability distributions from a plurality of images that are distinct, wherein each of the probability distributions is generated by inputting a quantitative description of one or more features associated with one of the plurality of images into a regression model that outputs a probability distribution for a measure of engagingness for that image and wherein each of the plurality of images is conceptually related to the other images; using the first plurality of probability distributions to initialize a multi-armed bandit model that outputs a serving scheme for each of the images; serving at least one of the images on a web page displaying search results, based at least in part on the serving scheme; monitoring user feedback on the at least one served image; creating a second plurality of probability distributions based at least in part on the user feedback; updating the multi-armed bandit model with the second plurality of probability distributions; and splitting the regression model into two or more regression models, based at least in part on the user feedback for the at least one served image and image metadata associated with the at least one served image, wherein each of the operations is executed by one or more processors.