Integrated configuration engine for interference mitigation in cloud computing

Abstract

A cloud computing system which is configured to monitor operating status of a plurality of virtual computing machines running on a physical computing machine, wherein said monitoring includes monitoring a cycles per instruction (CPI) parameter and a cache miss rate (CMR) parameter of at least one of the plurality of virtual computing machines. The system detects interference in the operation of the at least one virtual machine, with the detection including determining when at least one of the CPI and CMR values exceed a predetermined threshold. When interference is detected, the system reconfigures a load balancing module associated with the virtual machine in question to send fewer requests to the virtual machine.

1 . A cloud computing system, comprising:
 a) a computing engine configured to:
 i) monitor operating status of a plurality of virtual computing machines running on a physical computing machine, wherein said monitoring includes monitoring a cycles per instruction (CPI) parameter and a cache miss rate (CMR) parameter of at least one of the plurality of virtual computing machines; 
 ii) detect interference in the operation of the at least one virtual machine, said detection including determining when at least one of said CPI and CMR values exceed a predetermined threshold; and 
 iii) reconfigure a load balancing module associated with the at least one virtual machine to send fewer requests to said one of said virtual machines when said interference is detected. 
   
     
     
         2 . The system of  claim 1 , wherein said reconfiguring the load balancing module comprises reducing a request scheduling weight associated with said virtual machine in said load balancing module. 
     
     
         3 . The system of  claim 2 , wherein said reconfiguring the load balancing module comprises determining an estimated processor utilization of a web server running on said virtual computing machine, determining a request rate for the virtual machine that will reduce the processor utilization below a utilization threshold, and reducing said request scheduling weight to achieve said request rate. 
     
     
         4 . The system of  claim 1 , wherein the computing engine is further configured to:
 i) collect training data relating to the at least one virtual machine; and   ii) utilize said training data to determine said estimated processor utilization.   
     
     
         5 . The system of  claim 1 , wherein the computing engine is further configured to:
 i) reconfigure a web server associated with the at least one virtual machine to improve performance of the at least one virtual machine if the interference exceeds a predetermined interference duration.   
     
     
         6 . The system of  claim 5 , wherein said reconfiguration comprises reducing a maximum clients parameter of said web server, said maximum clients parameter representing a maximum number of worker threads that the web server can initiate. 
     
     
         7 . The system of  claim 6 , wherein said reconfiguration further comprises increasing a keep alive timeout parameter of said web server, said keep alive timeout parameter representing a duration a client connection to the web server is persisted in an idle state before being terminated. 
     
     
         8 . A cloud computing system, comprising:
 a plurality of physical computing machines having a processor and a memory, each of the physical computing machines comprising a plurality of virtual computing machines, each of the virtual computing machines running a web server module;   a computing engine, the computing engine configured to:
 monitor operating status of a plurality of virtual computing machines running on a physical computing machine, wherein said monitoring includes monitoring a cycles per instruction (CPI) parameter and a cache miss rate (CMR) parameter of at least one of the plurality of virtual computing machines; 
 detect interference in the operation of the at least one virtual machine, said detection including determining when at least one of said CPI and CMR values exceed a predetermined threshold; and 
 reconfigure a load balancing module associated with the at least one virtual machine to send fewer requests to said one of said virtual machines when said interference is detected. 
   
     
     
         9 . The system of  claim 8 , wherein said reconfiguring the load balancing module comprises reducing a request scheduling weight associated with said virtual machine in said load balancing module. 
     
     
         10 . The system of  claim 9 , wherein said reconfiguring the load balancing module comprises determining an estimated processor utilization of a web server running on said virtual computing machine, determining a request rate for the virtual machine that will reduce the processor utilization below a utilization threshold, and reducing said request scheduling weight to achieve said request rate. 
     
     
         11 . The system of  claim 8 , wherein the computing engine is further configured to:
 i) collect training data relating to the at least one virtual machine; and   ii) utilize said training data to determine said estimated processor utilization.   
     
     
         12 . The system of  claim 8 , wherein
 i) reconfigure a web server associated with the at least one virtual machine to improve performance of the at least one virtual machine if the interference exceeds a predetermined interference duration.   
     
     
         13 . The system of  claim 12 , wherein said reconfiguration comprises reducing a maximum clients parameter of said web server, said maximum clients parameter representing a maximum number of worker threads that the web server can initiate. 
     
     
         14 . The system of  claim 13 , wherein said reconfiguration further comprises increasing a keep alive timeout parameter of said web server, said keep alive timeout parameter representing a duration a client connection to the web server is persisted in an idle state before being terminated.