Exchange of server health and client information through headers for request management

摘要

Server health and client information are exchanged through headers for request management. Headers in standardized or proprietary protocol communication between servers and a request management module and/or clients and the request management module may be used to exchange server health and client information. The exchanged server health and/or client information may be employed in throttling, routing, and/or load balancing the incoming requests. Rules specified by the client through the header exchange may also be used for throttling, routing, and/or load balancing decisions.

主权项

1. A method executed on a computing device for exchange of server health and client information through headers in request management, the method comprising:
receiving server health information in headers of service communication from one or more servers at one or more request managers in a service infrastructure; receiving a request from a client at the one or more request managers, wherein the request includes client type information in a header of the request, the client type information including an indication of the client, wherein the one or more request managers are:
dedicated to perform request management tasks if a configuration of the service infrastructure is in a dedicated mode deployment, andintegrated to the one or more servers if the configuration of the service infrastructure is in an integrated mode deployment; selecting a server at the one or more request managers from the one or more servers for the received request to be routed based on at least one of the received server health information and the client type information, wherein selecting the server based on the client type information includes, blocking or sending the request to a low health server, and sending the request to a server with high priority based on the client type information; and performing one or more of the following actions at the one or more request managers:
routing the request to the selected server,throttling the request, andload balancing the request.