Method for ranking analysis tools

Abstract

Analysis tools are used for resolving a service request for software performance problems. Ranking of the analysis tools includes measuring a plurality of times to resolution of a plurality of service requests for software performance problems after runnings of a plurality of analysis tools are initiated; capturing sets of errors in the plurality of service requests; storing identities of the plurality of analysis tools with the times to resolution of the service requests and the sets of errors; determining an average time to resolution of each of the plurality of analysis tools for each set of errors; organizing the plurality of analysis tools into one or more categories using the sets of errors; and ranking the analysis tools within each category using the average times to resolution of the analysis tools within the category.

What is claimed is: 
     
         1 . A method for ranking analysis tools by a computing system comprising a processor, comprising:
 measuring by the processor a time to resolution of a given software performance problem for each run of any of a plurality of analysis tools;   determining, by the processor, an average time to resolution of the given software performance problem for each of the plurality of analysis tools; and   ranking, by the processor, the plurality of analysis tools using the average times to resolution of the given software performance problems for the plurality of analysis tools.   
     
     
         2 . The method of  claim 1 , wherein the measuring the time to resolution of the given software performance problem for each run of any of the plurality of analysis tools comprises:
 receiving a service request for the software performance problem, wherein the service request includes one or more files;   initiating a running of a given analysis tool of the plurality of analysis tools;   measuring a time to resolution of the service request from a predetermined time after the given analysis tool is initiated;   capturing a set of errors in the one or more files of the service request; and   storing an identity of the given analysis tool with the time to resolution of the service request and the set of errors.   
     
     
         3 . The method of  claim 2 , wherein the determining the average time to resolution of the given software performance problem for each of the plurality of analysis tools comprises:
 aggregating the stored identity of the given analysis tool with the time to resolution of the service request and the set of errors across a plurality of service requests; and   determining an average time to resolution of each of the plurality of analysis tools for each set of errors.   
     
     
         4 . The method of  claim 3 , wherein the ranking the plurality of analysis tools using the average times to resolution of the given software performance problems for the plurality of analysis tools comprises:
 organizing the plurality of analysis tools into one or more categories using the sets of errors aggregated across the plurality of service requests; and   ranking analysis tools within each category using the average times to resolution of the analysis tools within the category.   
     
     
         5 . The method of  claim 4 , further comprising:
 receiving a second service request for a second software performance problem, wherein the second service request includes one or more files;   capturing a second set of errors in the second service request files;   determining a given category of analysis tools using the second set of errors; and   recommending one or more analysis tools in the given category based on the rankings of the analysis tools within the given category.   
     
     
         6 . A method for ranking analysis tools by a computing system comprising a processor, comprising:
 measuring, by the processor, a plurality of times to resolution of a plurality of service requests for software performance problems after runnings of a plurality of analysis tools are initiated;   capturing, by the processor, sets of errors in the plurality of service requests;   storing, by the processor, identities of the plurality of analysis tools with the times to resolution of the service requests and the sets of errors;   determining, by the processor, an average time to resolution of each of the plurality of analysis tools for each set of errors;   organizing, by the processor, the plurality of analysis tools into one or more categories using the sets of errors; and   ranking, by the processor, the analysis tools within each category using the average times to resolution of the analysis tools within the category.   
     
     
         7 . The method of  claim 6 , further comprising:
 receiving a given service request for a given software performance problem, wherein the given service request includes one or more files;   capturing a given set of errors in the given service request files;   determining a given category of analysis tools using the given set of errors; and   recommending one or more analysis tools in the given category based on the rankings of the analysis tools within the given category.