Optimizing automated interactions with computer software applications

Abstract

Performing an automated interaction with a computer software application by identifying, among a plurality of regions of an interface of a computer software application, a region for which a region-level measure exists of user interaction that occurred within the region of the interface, determining if the region-level measure meets or exceeds a predefined minimum level of user interaction, and performing an automated interaction with an element at least partly found within the region if the region-level measure meets or exceeds the predefined minimum level of user interaction.

1 - 20 . (canceled) 
     
     
         21 . A computer-implemented method for performing an automated interaction with a computer software application, comprising:
 identifying, among a plurality of regions of an interface of a computer software application, a region for which a region-level measure exists of user interaction that occurred within the region of the interface;   making a determination that the region-level measure meets or exceeds a predefined minimum level of user interaction; and   performing, upon the determination, an automated interaction with an element at least partly found within the region, wherein   the interaction is an action with the element and a reciprocal action from the element.   
     
     
         22 . The method of  claim 21 , wherein
 the region-level measure is determined for any of the plurality of regions.   
     
     
         23 . The method of  claim 22 , wherein
 the region-level measure is determined in which the user interaction is selecting any element of the interface within the region with a pointing device when the interface is displayed on a computer display.   
     
     
         24 . The method of  claim 22 , wherein
 the region-level measure is determined in which the user interaction is interacting with any element of the interface within the region using a keyboard when the interface is displayed on a computer display.   
     
     
         25 . The method of  claim 21 , wherein
 the regions are defined when the interface is displayed on a computer display.   
     
     
         26 . The method of  claim 25 , wherein
 the regions are defined by programmatically dividing the display area of the computer display on which the interface is displayed into a plurality of virtual regions, and   each of the plurality of regions of the interface displayed on the computer display lies within one of the virtual regions.   
     
     
         27 . A computer hardware system for performing an automated interaction with a computer software application, comprising:
 a hardware processor configured to initiate the following executable operations:
 identifying, among a plurality of regions of an interface of a computer software application, a region for which a region-level measure exists of user interaction that occurred within the region of the interface; 
 making a determination that the region-level measure meets or exceeds a predefined minimum level of user interaction; and 
 performing, upon the determination, an automated interaction with an element at least partly found within the region, wherein 
   
       the interaction is an action with the element and a reciprocal action from the element. 
     
     
         28 . The system of  claim 27 , wherein
 the region-level measure is determined for any of the plurality of regions.   
     
     
         29 . The system of  claim 28 , wherein
 the region-level measure is determined in which the user interaction is selecting any element of the interface within the region with a pointing device when the interface is displayed on a computer display.   
     
     
         30 . The system of  claim 28 , wherein
 the region-level measure is determined in which the user interaction is interacting with any element of the interface within the region using a keyboard when the interface is displayed on a computer display.   
     
     
         31 . The system of  claim 27 , wherein
 the regions are defined when the interface is displayed on a computer display.   
     
     
         32 . The system of  claim 31 , wherein
 the regions are defined by programmatically dividing the display area of the computer display on which the interface is displayed into a plurality of virtual regions, and   each of the plurality of regions of the interface displayed on the computer display lies within one of the virtual regions.   
     
     
         33 . A computer program product, comprising
 a hardware storage device having stored therein computer readable program code for performing an automated interaction with a computer software application,   the computer readable program code, which when executed by a computer hardware system, causes the computer hardware system to perform:
 identifying, among a plurality of regions of an interface of a computer software application, a region for which a region-level measure exists of user interaction that occurred within the region of the interface; 
 making a determination that the region-level measure meets or exceeds a predefined minimum level of user interaction; and 
 performing, upon the determination, an automated interaction with an element at least partly found within the region, wherein 
   the interaction is an action with the element and a reciprocal action from the element.   
     
     
         34 . The computer program product of  claim 33 , wherein
 the region-level measure is determined for any of the plurality of regions.   
     
     
         35 . The computer program product of  claim 34 , wherein
 the region-level measure is determined in which the user interaction is selecting any element of the interface within the region with a pointing device when the interface is displayed on a computer display.   
     
     
         36 . The computer program product of  claim 34 , wherein
 the region-level measure is determined in which the user interaction is interacting with any element of the interface within the region using a keyboard when the interface is displayed on a computer display.   
     
     
         37 . The computer program product of  claim 33 , wherein
 the regions are defined when the interface is displayed on a computer display.   
     
     
         38 . The computer program product of  claim 37 , wherein
 the regions are defined by programmatically dividing the display area of the computer display on which the interface is displayed into a plurality of virtual regions, and   each of the plurality of regions of the interface displayed on the computer display lies within one of the virtual regions.