Managing test services in a distributed production service environment

摘要

Systems and methods are described for a storage processing service that processes multiple storage commands. The storage processing service uses tags from test storage commands to determine whether a test storage service is to be instantiated that reflects a corresponding production service. Test storage commands with the same tag are tested on that test service. Additionally, the storage processing service determines a strategy for testing processes on production services when the storage system is overloaded. In one embodiment, the test service manager can determine to stop testing processes for a period of time, and issue a shed command that queues or sheds test storage commands. Advantageously, a shed command, while active at a storage processing service, may alleviate the overload on production services. The test service manager can continue to monitor the storage system to determine whether the overload continues to exist.

主权项

1. A system comprising:
a storage processing service comprising at least one production storage volume and at least one test storage volume, the storage processing service executed on one or more storage computing devices and configured to:
obtain a first storage request from one of a plurality of virtual computing instances, the first storage request comprising at least one production storage request or at least one test storage request;determine that the first storage request includes a tag indicative that a production service is to be instantiated for further processing of the first storage request;route the first storage request to the instantiated production service;process the first storage request on the instantiated storage production service to generate a first production storage processing result, wherein the instantiated production service is a modification to the production service or another production service, and the test storage command is implemented, at least in part, by resources on the production computing environment;obtain a second storage request from one of the plurality of virtual computing instances, the second storage request comprising at least one production storage request or at least one test storage request;determine that second storage request includes a tag indicative that a non-test production storage service is to be instantiated for further processing of the second storage request;route the second storage request to the instantiated non-test production storage service; andprocess the second storage request to generate a second production storage processing result.