Distributed website load testing system running on mobile devices

Abstract

An instruction to perform load testing is sent to a mobile device where an application running on the mobile device determines whether the mobile device is in a state where load testing is permitted. In response to receiving the instruction, the application running on the mobile device performs load testing on a web server if the mobile device is in the state where load testing is permitted. Performance information associated with the load testing is received from the application running on the mobile device and the performance information associated with the load testing is displayed.

1 . A system for load testing, comprising:
 a processor; and   a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:
 determine a set of mobile devices to perform load testing; 
 send an instruction to perform load testing to at least one mobile device in the set of mobile devices, wherein:
 the at least one mobile device is in a state where load testing is permitted; and 
 in response to receiving the instruction, an application running on the at least one mobile device performs load testing on a web server; 
 
 receive, from the application running on the at least one mobile device:
 performance information associated with the load testing; and 
 geographic information associated with the at least one mobile device; and 
 
 display the performance information associated with the load testing including by: 
   displaying a first set of performance information associated with a first set of one or more mobile devices located in a first geographic area and a second set of performance information associated with a second set of one or more mobile devices located in a second geographic area.   
     
     
         2 . The system recited in  claim 1 , wherein the at least one mobile device includes one or more of the following: a mobile telephone or a tablet. 
     
     
         3 . The system recited in  claim 1 , wherein the application running on the at least one mobile device determines that the at least one mobile device is in the state where load testing is permitted, including by:
 determining that the at least one mobile device is connected to a Wi-Fi network;   determining that the at least one mobile device is connected to a charger; and   in response to the determination that the at least one mobile device is connected to a Wi-Fi network and the at least one mobile device is connected to a charger, determining that the at least one mobile device is in a state where the at least one mobile device is permitted to perform load testing.   
     
     
         4 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 record, for the set of mobile devices, information associated with when the set of mobile devices are in the state where load testing is permitted;   determine, based at least in part on the recorded information, a window of time associated with a maximum number of mobile devices in the set of mobile devices being in the state where load testing is permitted; and   select, during the determined window of time, a subset of mobile devices from the set of mobile devices to perform load testing.   
     
     
         5 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 receive a specification of geographic coverage which includes one or more required coverage areas and one or more optional coverage areas;   determine when a set of mobile devices are all in the state where load testing is permitted such that the specification of geographic coverage is satisfied; and   in response to the determination that the set of mobile devices are all in the state where load testing is permitted such that the specification of geographic coverage is satisfied, select the set of mobile devices to perform load testing.   
     
     
         6 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 send a query to the at least one mobile device;   receive, from the at least one mobile device, a response to the query which includes a property associated with the at least one mobile device; and   evaluate the property associated with the at least one mobile device in order to determine that the at least one mobile device is acceptable for load testing.   
     
     
         7 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 instruct the at least one mobile device to perform an operation; and   evaluate the performance of the operation by the at least one mobile device in order to determine that the at least one mobile device is acceptable for load testing.   
     
     
         8 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 select a subset of mobile devices from the set of mobile devices;   instruct the subset of mobile devices to individually perform load testing in order to obtain individual performance information for each mobile device in the subset;   instruct the subset of mobile devices to simultaneously perform load testing in order to obtain simultaneous performance information for each mobile device in the subset; and   compare the individual performance information and the simultaneous performance information in order to determine that the subset of mobile devices are acceptable for load testing, including by comparing a difference metric between the individual performance information and the simultaneous performance information to a threshold.   
     
     
         9 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 select a subset of mobile devices from the set of mobile devices, including by:
 receiving account information for a mobile device being registered; 
 identifying any other mobile devices with the same account information as the mobile device being registered; and 
 including the mobile device being registered and the identified mobile devices with the same account information in the subset of mobile devices; 
   instruct the subset of mobile devices to individually perform load testing in order to obtain individual performance information for each mobile device in the subset;   instruct the subset of mobile devices to simultaneously perform load testing in order to obtain simultaneous performance information for each mobile device in the subset; and   compare the individual performance information and the simultaneous performance information in order to determine that the subset of mobile devices are acceptable for load testing, including by comparing a difference metric between the individual performance information and the simultaneous performance information to a threshold.   
     
     
         10 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 select a subset of mobile devices from the set of mobile devices, including by:
 receiving a registration time associated with a mobile device being registered; 
 identifying any other mobile devices with registration times within a window of time from the registration time associated with a mobile device being registered; and 
 including the mobile device being registered and the identified mobile devices with registration times within the window of time in the subset of mobile devices; 
   instruct the subset of mobile devices to individually perform load testing in order to obtain individual performance information for each mobile device in the subset;   instruct the subset of mobile devices to simultaneously perform load testing in order to obtain simultaneous performance information for each mobile device in the subset; and   compare the individual performance information and the simultaneous performance information in order to determine that the subset of mobile devices are acceptable for load testing, including by comparing a difference metric between the individual performance information and the simultaneous performance information to a threshold.   
     
     
         11 . The system recited in  claim 1 , wherein the memory is further configured to provide the processor with instructions which when executed cause the processor to:
 select a subset of mobile devices from the set of mobile devices, including by:
 receiving wireless network information associated with a mobile device being registered; 
 identifying any other mobile devices with the same wireless network information as the mobile device being registered; and 
 including the mobile device being registered and the identified mobile devices with the same wireless network information in the subset of mobile devices; 
   instruct the subset of mobile devices to individually perform load testing in order to obtain individual performance information for each mobile device in the subset;   instruct the subset of mobile devices to simultaneously perform load testing in order to obtain simultaneous performance information for each mobile device in the subset; and   compare the individual performance information and the simultaneous performance information in order to determine that the subset of mobile devices are acceptable for load testing, including by comparing a difference metric between the individual performance information and the simultaneous performance information to a threshold.   
     
     
         12 . A method for load testing, comprising:
 determining a set of mobile devices to perform load testing;   sending an instruction to perform load testing to at least one mobile device in the set of mobile devices, wherein:
 an application running on the at least one mobile device determines whether the at least one mobile device is in a state where load testing is permitted; and 
 in response to receiving the instruction, an application running on the at least one mobile device performs load testing on a web server if the at least one mobile device is in the state where load testing is permitted; 
   receiving, from the application running on the at least one mobile device:
 performance information associated with the load testing; and 
 geographic information associated with the at least one mobile device; and 
   displaying the performance information associated with the load testing including by:   
       displaying a first set of performance information associated with a first set of one or more mobile devices located in a first geographic area and a second set of performance information associated with a second set of one or more mobile devices located in a second geographic area. 
     
     
         13 . The method recited in  claim 12 , wherein the at least one mobile device includes one or more of the following: a mobile telephone or a tablet. 
     
     
         14 . The method recited in  claim 12 , further comprising:
 recording, for the set of mobile devices, information associated with when the set of mobile devices are in the state where load testing is permitted;   determining, based at least in part on the recorded information, a window of time associated with a maximum number of mobile devices in the set of mobile devices being in the state where load testing is permitted; and   selecting, during the determined window of time, a subset of mobile devices from the set of mobile devices to perform load testing.   
     
     
         15 . The method recited in  claim 12 , further comprising:
 receiving a specification of geographic coverage which includes one or more required coverage areas and one or more optional coverage areas;   determining when a set of mobile devices are all in the state where load testing is permitted such that the specification of geographic coverage is satisfied; and   in response to the determination that the set of mobile devices are all in the state where load testing is permitted such that the specification of geographic coverage is satisfied, selecting the set of mobile devices to perform load testing.   
     
     
         16 . The method recited in  claim 12 , further comprising:
 sending a query to the at least one mobile device;   receiving, from the at least one mobile device, a response to the query which includes a property associated with the at least one mobile device; and   evaluating the property associated with the at least one mobile device in order to determine that the at least one mobile device is acceptable for load testing.   
     
     
         17 . A computer program product embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
 determining a set of mobile devices to perform load testing;   sending an instruction to perform load testing to at least one mobile device in the set of mobile devices, wherein:
 an application running on the at least one mobile device determines whether the at least one mobile device is in a state where load testing is permitted; and 
 in response to receiving the instruction, an application running on the at least one mobile device performs load testing on a web server if the at least one mobile device is in the state where load testing is permitted; 
   receiving, from the application running on the at least one mobile device:
 performance information associated with the load testing; and 
 geographic information associated with the at least one mobile device; and 
   displaying the performance information associated with the load testing including by:   
       displaying a first set of performance information associated with a first set of one or more mobile devices located in a first geographic area and a second set of performance information associated with a second set of one or more mobile devices located in a second geographic area. 
     
     
         18 . The computer program product recited in  claim 17 , wherein the at least one mobile device includes one or more of the following: a mobile telephone or a tablet. 
     
     
         19 . The computer program product recited in  claim 17 , wherein the computer program product further includes computer instructions for:
 recording, for the set of mobile devices, information associated with when the set of mobile devices are in the state where load testing is permitted;   determining, based at least in part on the recorded information, a window of time associated with a maximum number of mobile devices in the set of mobile devices being in the state where load testing is permitted; and   selecting, during the determined window of time, a subset of mobile devices from the set of mobile devices to perform load testing.   
     
     
         20 . The computer program product recited in  claim 17 , wherein the computer program product further includes computer instructions for:
 receiving a specification of geographic coverage which includes one or more required coverage areas and one or more optional coverage areas;   determining when a set of mobile devices are all in the state where load testing is permitted such that the specification of geographic coverage is satisfied; and   in response to the determination that the set of mobile devices are all in the state where load testing is permitted such that the specification of geographic coverage is satisfied, selecting the set of mobile devices to perform load testing.