DISTRIBUTED AND PRIVACY-PRESERVING PREDICTION METHOD

摘要

Each computer of a peer-to-peer (P2P) network performs an iterative computer-based modeling task defined by a set of training data including at least some training data that are not accessible to the other computers of the P2P network, and by a set of parameters including a shared parameter. The modeling task optimizes an objective function comparing a model parameterized by the set of parameters with the training data. Each iteration includes: performing an iterative gradient step update of parameter values stored at the computer based on the objective function; receiving parameter values of the shared parameter from other computers of the P2P network; adjusting the parameter value of the shared parameter stored at the computer by averaging the received parameter values; and sending the parameter value of the shared parameter stored at the computer to other computers of the P2P network.

主权项

1. A non-transitory storage medium storing instructions executable by a local computer to perform iterative computer-based modeling in conjunction with an electronic communication system configured to send parameter values of shared parameters from the local computer to remote computer-based modeling systems and to receive at the local computer parameter values of the shared parameters from remote computer-based modeling systems, the iterative computer-based modeling including the operations of:
performing a gradient step to update parameter values of a set of parameters including at least parameter values of the shared parameters stored at the local computer, the iterative gradient step updates operating to optimize an objective function that is functionally dependent upon the set of parameters wherein the objective function quantitatively compares a model with a set of training data including at least some training data accessible by the local computer that are not accessible by the remote computer-based modeling systems; adjusting the parameter values of the shared parameters stored at the local computer by averaging parameter values of the shared parameters received at the local computer from remote computer-based modeling systems via the electronic communication system; and sending the parameter values of the shared parameters stored at the local computer from the local computer to remote computer-based modeling systems via the electronic communication system.