ONLINE TEMPORAL DIFFERENCE LEARNING FROM INCOMPLETE CUSTOMER INTERACTION HISTORIES

摘要

In one embodiment, an indication that a decision has been requested, selected, or applied with respect to one or more users may be obtained. After the indication that a decision that has been requested, selected, or applied is obtained, a value function may be updated, where the value function approximates an expected reward associated with the one or more users over time since the decision has been requested, selected, or applied with respect to the one or more users. The value function may be updated by performing or providing one or more updates to the value function, where a time at which each of the one or more updates is performed or provided is independent of activity of the one or more users.

主权项

1. A computer implemented method, comprising:
obtaining an indication that a decision has been requested, selected, or applied with respect to one or more users; and after obtaining the indication, updating a value function, including performing or providing one or more updates to the value function, wherein a time at which each of the one or more updates is performed or provided is independent of activity of the one or more users; wherein the one or more updates to the value function indicate update(s) to one or more weights associated with one or more parameters of the value function, wherein the update(s) to the one or more weights include a modification or replacement value for each of the one or more weights.