System for providing test environments for executing and analysing test routines

Abstract

A system is operable to provide one or more test environments for executing and analysing test routine. The system includes one or more user interfaces coupled via a communication network to a server arrangement for hosting a plurality of emulations of wireless communication devices or terminals. The server arrangement is operable to receive one or more software applications for execution upon the wireless communication devices or terminals, and one or more test routines for use in testing the wireless communication devices or terminals. Moreover, the server arrangement is operable to execute one or more the software applications and apply the one or more test routines thereto. Furthermore, the server arrangement is operable to monitor operation of the wireless communication devices or terminals and to provide corresponding test results to the one or more user interfaces.

1 - 15 . (canceled) 
     
     
         16 . A server system for providing one or more test environments for executing and analyzing test routines for a plurality of wireless communication devices, comprising:
 a processor and a memory comprising software, the processor and memory with the software configured to cause the server system to:   receive at least one software application for execution upon the plurality of wireless communication devices, and receive a plurality of test routines for use in testing the wireless communication devices;   control execution of the at least one software application in the wireless communication devices and control application of the plurality of test routines thereto, wherein a set of the plurality of wireless communication devices is operated concurrently and arranged to execute mutually different test routines for the same software application; and   monitor operation of the physical wireless communication devices and provide corresponding test results to one or more user interfaces.   
     
     
         17 . The server system of  claim 16 , wherein the processor and memory with the software are further configured to use the plurality of test routines to determine at least one of: software application execution speed on the wireless communication devices and operating system compatibility for the wireless communication devices. 
     
     
         18 . The server system of  claim 16 , wherein the plurality of wireless communication devices comprise simulated wireless communication devices 
     
     
         19 . The server system of  claim 16 , wherein the plurality of wireless communication devices comprise physical wireless communication devices. 
     
     
         20 . The server system of  claim 16 , wherein the plurality of test routines include routines pertaining to one or more of software security, software functionality, software performance, software usability, software interoperability, software stress testing, and testing software interactions between users and the wireless communications devices. 
     
     
         21 . The server system of  claim 16 , wherein at least a portion of the test results causes the at least one software application to be published to one or more of the wireless communication devices or one or more application stores. 
     
     
         22 . The server system of  claim 16 , wherein the processor and memory with the software are further configured to allow modification and re-application of the plurality of test routines for implementing adjustments to the at least one software application. 
     
     
         23 . The server system of  claim 16 , wherein the modification of the plurality of test routines is determined from previous test results. 
     
     
         24 . The server system of  claim 16 , wherein the processor and memory with the software are further configured to trigger application of the plurality of test routines automatically upon one or more of an amendment to a software application source code, a change of configuration of any of the wireless communication devices, and a trigger originating from a system connected to the server system. 
     
     
         25 . A method of using a server system for providing one or more test environments for executing and analyzing test routines for a plurality of wireless communication devices, comprising:
 receiving, using computing hardware of the server system, least one software application for execution upon the plurality of wireless communication devices, and receiving a plurality of test routines for use in testing the wireless communication devices;   executing the at least software application and applying the plurality of test routines thereto, via the computing hardware of the server system, wherein a set of the plurality of wireless communication devices is operated concurrently and arranged to execute mutually different test routines for the same software application; and   monitoring operation of the wireless communication devices for providing corresponding test results to one or more user interfaces.   
     
     
         26 . The method of  claim 25 , comprising using the plurality of test routines to determine at least one of: software application execution speed on the wireless communication devices and operating system compatibility for the wireless communication devices. 
     
     
         27 . The method of  claim 25 , wherein the plurality of wireless communication devices comprise simulated wireless communication devices 
     
     
         28 . The method of  claim 25 , wherein the plurality of wireless communication devices comprise physical wireless communication devices. 
     
     
         29 . The method of  claim 25 , wherein the plurality of test routines include routines pertaining to one or more of software security, software performance, software usability, software interoperability, software stress testing, and testing software interactions between users and the wireless communications devices. 
     
     
         30 . The method of  claim 25 , wherein at least a portion of the test results causes the at least one software application to be published to one or more of the wireless communication devices. 
     
     
         31 . The method of  claim 25 , further comprising allowing modification and re-application of the plurality of test routines for implementing adjustments to the at least one software application. 
     
     
         32 . The method of  claim 25 , further comprising allowing modification of the plurality of test routines based on previous test results. 
     
     
         33 . The method of  claim 25 , comprising triggering application of the plurality of test routines automatically upon one or more of an amendment to a software application source code, a change of configuration of any of the wireless communication devices, and a trigger originating from a system connected to the server system. 
     
     
         34 . The method of  claim 25 , implemented as a software product recorded on non-transitory machine-readable data storage media wherein the software product is executable upon the computing hardware.