Systems and Methods of Distributed Optimization

摘要

Systems and methods of determining a global model are provided. In particular, one or more local updates can be received from a plurality of user devices. Each local update can be determined by the respective user device based at least in part on one or more data examples stored on the user device. The one or more data examples stored on the plurality of user devices are distributed on an uneven basis, such that no user device includes a representative sample of the overall distribution of data examples. The local updates can then be aggregated to determine a global model.

主权项

1. A computer-implemented method of updating a global model based on unevenly distributed data, the method comprising:
providing, by one or more computing devices, a current global model to a plurality of user devices; receiving, by the one or more computing devices, one or more local updates from the plurality of user devices, each local update being determined by the respective user device based at least in part on one or more data examples stored on the respective user device, wherein the one or more data examples stored on the plurality of user devices are distributed on an uneven basis, such that no user device includes a representative sample of an overall distribution of data examples; and aggregating, by the one or more computing devices, the received local updates to determine an updated global model.