| 摘要 |
Techniques are described for automatically testing network-accessible functionality, such as in at least some situations based on automated operations of a distributed automated functionality testing system. In at least some such situations, the network-accessible functionality may be provided by an online service, such as if the provider of the online service is a client of the distributed automated functionality testing system. In addition, in at least some situations, the testing performed by the distributed automated functionality testing system uses numerous member computing devices that are owned or otherwise controlled by various users who are not part of the distributed automated functionality testing system or otherwise affiliated with each other, but who register the member computing devices with the distributed automated functionality testing system as being available for later use in performing testing actions, such as in return for monetary fees or other compensation. |
| 主权项 |
1. A computer-implemented method, comprising:
receiving, by one or more configured computing systems of a distributed automated functionality testing system that has a plurality of registered member computing devices available to perform functionality testing tasks, information about indicated functionality of a target online service that is to be tested, the member computing devices being owned by a plurality of users who are not associated with each other or with the distributed automated functionality testing system other than by registering the member computing devices with the distributed automated functionality testing system as being available for later use; determining, by the one or more configured computing systems, a plurality of functionality testing tasks to be performed to assess one or more performance criteria for the indicated functionality of the target online service; configuring, by the one or more configured computing systems, at least some of the plurality of registered member computing devices to perform the plurality of functionality testing tasks by having each configured member computing device automatically perform one or more of the plurality of functionality testing tasks, and initiating performing of the plurality of functionality testing tasks on the configured member computing devices, the performing of the plurality of functionality testing tasks by the configured member computing devices including interacting with one or more server computing systems of the target online service by sending a plurality of requests in a distributed manner over one or more computer networks from the configured member computing devices to the one or more server computing systems and by receiving a plurality of responses from the one or more server computing systems over the one or more computer networks to the sent plurality of requests; after obtaining results from the performing of the plurality of functionality testing tasks on the configured member computing devices, assessing, by the one or more configured computing systems, the one or more performance criteria for the indicated functionality of the target online service based on an aggregation of the obtained results, wherein the obtained results are based at least in part on the received plurality of responses, and wherein the assessed one or more performance criteria are based at least in part on performance of the one or more server computing systems in responding to the sent plurality of requests; and providing one or more indications of the assessed one or more performance criteria for the indicated functionality of the target online service. |
