Dynamic provisioning of a virtual test environment

Abstract

At least one test of a first computing system is launched utilizing a second computing system that includes a first set of computing devices. Progress of the test is monitored during a first period of time. Performance of the second computing system is also monitored during the first period. An additional second set of computing devices is automatically provisioned for inclusion in the second computing system based at least in part on the monitoring of the test progress and monitoring of the performance of the computing system during the first time period. The test can utilize the first and second sets of computing devices during a second period of time subsequent to the first period.

What is claimed is: 
     
         1 . A computer-implemented method comprising:
 launching at least one test of a first computing system utilizing a second computing system including a first set of computing devices;   monitoring progress of the test during a first period of time;   monitoring performance of the second computing system during the first period;   automatically provisioning an additional, second set of computing devices for inclusion in the second computing system based at least in part on the monitoring of the test progress and monitoring of the performance of the computing system during the first time period; and   wherein the test utilizes the first and second sets of computing devices during a second period of time subsequent to the first period.   
     
     
         2 . The method of  claim 1 , wherein the first and second sets of computing devices are remote from the first computing system. 
     
     
         3 . The method of  claim 1 , wherein the second computing system executes at least one instance of a virtual test lab configured to simulate a set of interactions with the first computing system, and the virtual test lab is executed on at least one of the first set of computing devices and automatically provisioning the second set of computing devices includes replicating instances of the virtual test lab on at least some of the second set of computing devices. 
     
     
         4 . The method of  claim 3 , wherein each instance of the virtual test lab is executed using at least one first virtual machine and a virtual instance of the first computing system is tested, the virtual instance of the first computing system executed using at least one second virtual machine. 
     
     
         5 . The method of  claim 1 , wherein monitoring the test during the first time period includes predicting requirements of the test in the second period of time and the second set of computing devices are provisioned based, at least in part, on the predicted requirements of the test. 
     
     
         6 . The method of  claim 1 , wherein monitoring performance of the second computing system includes monitoring computing capacity of the first set of computing devices. 
     
     
         7 . The method of  claim 6 , wherein computing capacity includes at least one of processing capacity of computing devices in the second computing system, available network bandwidth within the second computing system, and available memory of computing devices in the second computing system. 
     
     
         8 . The method of  claim 1 , wherein the first and second sets of computing devices are provisioned from a plurality of cloud-based server devices. 
     
     
         9 . The method of  claim 1 , further comprising:
 monitoring performance of the second computing system during the second period, the second computing system including the first and second sets of computing devices; and   determining, based at least in part on monitoring performance of the second computing system during the second period, whether additional computing devices should be added to the second computing system in a third period subsequent to the second period.   
     
     
         10 . The method of  claim 9 , further comprising determining, based on the monitoring of the second computing system during the second period, that at least a portion of the computing devices provisioned to the second computing system be at least temporarily de-allocated from the second computing system. 
     
     
         11 . The method of  claim 1 , wherein at least one particular computing device, remote from the first computing system and within the second computing system, executes at least one test coordinator engine managing the test. 
     
     
         12 . The method of  claim 11 , wherein the at least one test coordinator engine monitors the test, monitors performance of the second computing system, and initiates dynamic provisioning of additional computing devices for inclusion within the second computing system during the test. 
     
     
         13 . The method of  claim 1 , further comprising identifying user-defined parameters for the test, wherein dynamic provisioning of additional computing devices for inclusion within the second computing system during the test is based at least in part on the parameters. 
     
     
         14 . The method of  claim 13 , wherein the parameters include at least one of:
 a monitoring rate defining when performance of the second computing system should be monitored in connection with a decisions to initiate dynamic provisioning of addition computing devices for inclusion within the second computing system during the test;   an initial system size for the second computing system; and   a maximum system size for the second computing system, wherein the second computing system will not be automatically provisioned with additional computing devices in excess of the maximum system size.   
     
     
         15 . The method of  claim 1 , wherein the at least one test includes a plurality of tests, the plurality of tests including a first test and a second test executed at least partially in parallel, wherein each test in the plurality of tests has a corresponding test coordinator engine executed on the second computing system. 
     
     
         16 . The method of  claim 15 , wherein monitoring of the at least one test includes determining whether additional computing devices should be automatically provisioned to accommodate execution of test coordinator engines for at least the first and second tests. 
     
     
         17 . The method of  claim 15 , further comprising:
 identifying user-defined parameters for the at least one test, the parameters including instructions for completing each of the plurality of tests within a particular time period, the particular time period including at least the first and second periods of time,   wherein the performance of the second computing system during the first period is monitored to determine whether additional computing devices should be automatically provisioned for inclusion in the second computing system in order to the plurality of tests within the particular time period.   
     
     
         18 . The method of  claim 1 , wherein performance of the second computing system is monitored substantially continuously during the test and decisions to automatically provision the second computing system with additional computing devices are made substantially periodically. 
     
     
         19 . An article comprising a non-transitory, machine-readable storage device storing instructions operable to cause at least one processor to perform operations comprising:
 launching at least one test of a first computing system utilizing a second computing system including a first set of computing devices;   monitoring progress of the test during a first period of time;   monitoring performance of the second computing system during the first period;   automatically provisioning an additional, second set of computing devices for inclusion in the second computing system based at least in part on the monitoring of the test progress and monitoring of the performance of the computing system during the first time period; and   wherein the test utilizes the first and second sets of computing devices during a second period of time subsequent to the first period.   
     
     
         20 . A system comprising:
 a memory element storing data;   a processor operable to execute instructions associated with the stored data; and   at least one test management engine configured to:
 launch at least one test of a first computing system utilizing a second computing system including a first set of computing devices; 
 monitor progress of the test during a first period of time; 
 monitor performance of the second computing system during the first period; and 
 automatically provision an additional, second set of computing devices for inclusion in the second computing system based at least in part on the monitoring of the test progress and monitoring of the performance of the computing system during the first time period; and 
   wherein the test utilizes the first and second sets of computing devices during a second period of time subsequent to the first period.