Detecting and alerting performance degradation during features ramp-up

摘要

Computerized techniques are described for detecting performance degradation during features ramp up. A first version of web content is sent to first client devices. The first version of the web content lacks a particular feature. First performance data that indicates performance of each first client device with respect to processing the web content is received. A second version of the web content is sent to second client devices. The second version of the web content has the particular feature. Second performance data that indicates performance of each second client device with respect to processing the web content is received. The first performance data is compared with the second performance data to determine a difference between a processing metric associated with the first version of the web content and a processing metric associated with the second version of the web content.

主权项

1. A method comprising:
receiving a deployment comprising a feature and client instrumentation to measure and report load time of web content that has the feature, wherein the feature is disabled; enabling the feature for a subset of client users; repeatedly adding client users to the subset; from the client instrumentation, receiving timing reports, wherein each timing report comprises a content load duration and a classifier of a client user; processing the classifier to determine whether the feature is enabled for the client user; based on the timing reports, calculating a degradation degree that statistically quantifies an additional duration that clients spend loading the web content if the feature is enabled for the client user; generating an alert if the degradation degree exceeds a threshold; wherein the method is performed by one or more computing devices.