Distributed caching system

摘要

Embodiments of a distributed caching system are disclosed that cache data across multiple computing devices on a network. In one embodiment, a first cache system serves as a caching front-end to a distributed cluster of additional cache systems. The first cache system can distribute cache requests to the additional cache systems. The first distributed caching system can also serve as a cache server itself, by storing data on its own internal cache. For example, the first cache system can first attempt to find a requested data item on the internal cache, but, if the lookup results in a cache miss, the first cache system can search the additional cache systems for the data. In some embodiments, the first cache system is configured to identify additional requests for the first data item and duplicate the requested data item in order to respond to the additional requests, which allows for greater responsiveness to requests.

主权项

1. A system associated with a local cache and independent from an external cache, the system comprising:
an inter-process communication interface for receiving cache requests, the cache requests including a first cache request for a data item from a first requestor; computer memory for storing the local cache; and one or more processors configured to:
determine whether the data item is stored in the local cache;in response to determining that the data item is not on the local cache, determine the external cache from a plurality of external caches, the external cache designated to store the data item;transmit the first cache request for the data item to the external cache;determine whether a second requestor has requested the data item;in response to determining that a second requestor has requested the data item:
transmit a second cache request for the data item from the one or more processors to the external cache prior to the one or more processors receiving a cache response to the first cache request for the data item from the external cache;receive the data item from the external cache responsive to either the first cache request or the second cache request;process the data item received first from the external cache; andprovide the data item to the first requestor and the second requestor; andin response to determining that a second requestor has not requested the data item:
receive the data item from the external cache; andprovide the data item to the first requestor.