Test Executive System With Process Model Plug-ins

Abstract

Test executive system and method of use. The system includes a test executive engine, configured to execute at least one test executive sequence to test at least one unit under test (UUT), a process model that specifies one or more function sequences for pre-test or post-test functionality for the test executive sequences, and a plug-in framework, configured to selectively incorporate one or more process model plug-in instances in the process model. Each process model plug-in instance specifies at least one respective function sequence for pre-test or post-test functionality for the test executive sequences.

We claim: 
     
         1 . A method comprising:
 creating a test executive sequence, wherein the test executive sequence includes a first plurality of steps to be performed by a test executive engine to test a unit under test (UUT); and   configuring the test executive sequence with a process model, wherein the process model includes a second plurality of steps to be performed by the test executive engine before and/or after executing the first plurality of steps, wherein the process model is configured to accept process model plug-ins to define the second plurality of steps, wherein said configuring the test executive sequence with the process model comprises selecting one or more process model plug-ins for the process model, wherein each process model plug-in includes two or more of the second plurality of steps.   
     
     
         2 . The method of  claim 1 ,
 wherein each of the one or more process model plug-ins is stored in a respective file, wherein the method further comprises reading the steps of each selected process model plug-in from its respective file.   
     
     
         3 . The method of  claim 1 , further comprising:
 receiving user input via a graphical user interface selecting each of the one or more process model plug-ins for the process model.   
     
     
         4 . The method of  claim 1 , further comprising:
 prior to said selecting the one or more process model plug-ins, creating each of the process model plug-ins in response to user input;   wherein said creating each respective process model plug-in comprises receiving user input selecting each of the steps to be included in the process model plug-in.   
     
     
         5 . The method of  claim 4 , wherein said creating each respective process model plug-in further comprises creating a respective process model plug-in file and storing information defining the steps of the respective process model plug-in in the respective process model plug-in file. 
     
     
         6 . The method of  claim 1 ,
 wherein said selecting the one or more process model plug-ins for the process model comprises selecting a first process model plug-in, wherein the first process model plug-in includes two or more steps configured to receive test results generated by the first plurality of steps when testing the UUT and generate a report indicating the test results.   
     
     
         7 . The method of  claim 1 ,
 wherein said selecting the one or more process model plug-ins for the process model comprises selecting a first process model plug-in, wherein the first process model plug-in includes two or more steps configured to receive test results generated by the first plurality of steps when testing the UUT and log the test results in one or more of a file or database.   
     
     
         8 . The method of  claim 1 ,
 wherein the process model includes a plurality of entry points, wherein each of the one or more process model plug-ins is associated with a respective one of the entry points.   
     
     
         9 . The method of  claim 1 , further comprising:
 testing the UUT, wherein said testing comprises executing each of the process model plug-ins.   
     
     
         10 . The method of  claim 9 , wherein the one or more process model plug-ins includes a first process model plug-in configured to store test result data, wherein said executing comprises dispatching the test result data to the first process model plug-in in chunks, wherein a chunk size defining a size of the chunks is configurable by user input. 
     
     
         11 . A non-transitory computer-accessible memory medium that stores program instructions executable by one or more processors to implement:
 creating a test executive sequence, wherein the test executive sequence includes a first plurality of steps to be performed by a test executive engine to test a unit under test (UUT); and   configuring the test executive sequence with a process model, wherein the process model includes a second plurality of steps to be performed by the test executive engine before and/or after executing the first plurality of steps, wherein the process model is configured to accept process model plug-ins to define the second plurality of steps, wherein said configuring the test executive sequence with the process model comprises selecting one or more process model plug-ins for the process model, wherein each process model plug-in includes two or more of the second plurality of steps.   
     
     
         12 . The non-transitory computer-accessible memory medium of  claim 11 ,
 wherein each of the one or more process model plug-ins is stored in a respective file, wherein the program instructions are further executable by the one or more processors to read the steps of each selected process model plug-in from its respective file.   
     
     
         13 . The non-transitory computer-accessible memory medium of  claim 1 , wherein the program instructions are further executable by the one or more processors to implement:
 prior to said selecting the one or more process model plug-ins, creating each of the process model plug-ins in response to user input;   wherein said creating each respective process model plug-in comprises receiving user input selecting each of the steps to be included in the process model plug-in.   
     
     
         14 . The non-transitory computer-accessible memory medium of  claim 13 , wherein said creating each respective process model plug-in further comprises creating a respective process model plug-in file and storing information defining the steps of the respective process model plug-in in the respective process model plug-in file. 
     
     
         15 . The non-transitory computer-accessible memory medium of  claim 11 ,
 wherein said selecting the one or more process model plug-ins for the process model comprises selecting a first process model plug-in, wherein the first process model plug-in includes two or more steps configured to receive test results generated by the first plurality of steps when testing the UUT and generate a report indicating the test results.   
     
     
         16 . The non-transitory computer-accessible memory medium of  claim 11 ,
 wherein said selecting the one or more process model plug-ins for the process model comprises selecting a first process model plug-in, wherein the first process model plug-in includes two or more steps configured to receive test results generated by the first plurality of steps when testing the UUT and log the test results in one or more of a file or database.   
     
     
         17 . The non-transitory computer-accessible memory medium of  claim 11 ,
 wherein the process model includes a plurality of entry points, wherein each of the one or more process model plug-ins is associated with a respective one of the entry points.   
     
     
         18 . A system comprising:
 one or more processors; and   memory storing program instructions, wherein the program instructions are executable by the one or more processors to implement:   creating a test executive sequence, wherein the test executive sequence includes a first plurality of steps to be performed by a test executive engine to test a unit under test (UUT); and   configuring the test executive sequence with a process model, wherein the process model includes a second plurality of steps to be performed by the test executive engine before and/or after executing the first plurality of steps, wherein the process model is configured to accept process model plug-ins to define the second plurality of steps, wherein said configuring the test executive sequence with the process model comprises selecting one or more process model plug-ins for the process model, wherein each process model plug-in includes two or more of the second plurality of steps.