ORTHOGONAL EXPERIMENTATION IN A COMPUTING ENVIRONMENT

摘要

Various embodiments include at least one of systems, methods, and software to receive input configuring tests within a computing environment to expose users to standard application or website experiences or test experiences. In some embodiments, multiple tests may be configured to run orthogonally within user experiences without affecting the results of one another. Some such embodiments preserve the ability to execute certain tests in a non-orthogonal manner while other tests are allowed to execute orthogonally.

主权项

1. A system comprising:
at least one processor: at least one memory device; at least one network interface device; and instructions held in the at least one memory device, the instructions retrievable from the at least one memory device and executable by the at least one processor to cause the system to perform a method comprising:
receiving a selection of a website experiment to be implemented within a computing environment accessible via the at least one network interface device;receiving data designating the experiment to be implemented individually within a user experience or with an option to coexist with other experiments within a single user experience;receiving data including a command to provide one or more treatments of the Experiment, the data including a command for each treatment added including:
data identifying the treatment; anddata identifying a portion of website traffic to which the treatment will be exposed;storing the received data in an experiment database on a data storage device accessible by computing resources within the computing environment;receiving, via the at least one network interface device, a request for webpage related content;querying the experiment database based at least in part on a user identifier of a user from which the request was received to identify an experiment to which the user is to be exposed; andprocessing the request for the webpage related content according to any identified experiment.