Intelligent High-Volume Cloud Application Programming Interface Request Caching

摘要

A system for processing requests handled by an application programming interface is disclosed. The system may receive a plurality of requests which call functions that are hosted by the application programming interface. Once the plurality of requests are received, the system may group a subset of the requests into a pool of requests if the subset of requests call similar functions hosted by the application programming interface. Additionally, the system may combine a set of requests from the pool of requests into a set of calls if the set of requests in the pool of requests are received by the system during a specified time interval. Furthermore, the system may include pushing the set of calls to a database to obtain a result set for the set of requests in the set of calls. The system may then receive the result set in response to the set of calls.

主权项

1. A system, comprising:
a memory that stores instructions; a processor that executes the instructions to perform operations, the operations comprising:
receiving a plurality of requests that each call a function of a plurality of functions;assigning a priority level to each request based on a type of device making each request, wherein the priority level indicates a position that each request has in a queue for processing the plurality of requests relative to other requests of the plurality of requests in the queue;grouping, based on the priority level assigned to each request, a subset of requests of the plurality of requests into a pool of requests if the subset of requests call similar functions of the plurality of functions, wherein each function of the similar functions is different from other functions of the similar functions, but has a parameter in common with the other functions;combining a set of requests of the pool of requests into a set of calls if the set of requests in the pool of requests are received during a time interval; andtransmitting, to a database, the set of calls to obtain a result set for the set of requests in the set of calls.