Method and apparatus for monitoring and logging the operation of a distributed processing system

Abstract

Method and apparatus for monitoring and logging the operation of a distributed processing system. A method for monitoring the operation of a distributed transaction system that is operable to process one or more transactions, each of which is comprised of a plurality of discrete processes, and which transaction as a whole is operable to perform a transaction on data when transferring data from a first location on a network to a second location on the network and the transaction comprised of operating on the data at intermediate nodes in the system with one or more of the plurality of processes during the transaction. First, a determination is made as to when a transaction has been initiated from the first location and has been transferred to the one of the intermediate nodes in the network. The initiation of the transaction is then logged at a central location on the network. A determination is then made as to when the initiated transaction has been completed by transfer of the processed data to the second location on the network from the last of the intermediate nodes in the network that has operated on the data. Completion of the transaction is then logged at the central location on the network.

1 : A method for monitoring the operation of a distributed transaction system that is operable to process one or more transactions, each of which is comprised of a plurality of discrete processes each operating independent of each other and operating independent of the entire transaction, and which transaction as a whole is operable to perform a transaction on data when transferring data from a first location on a network to a second location on the network and the transaction comprised of operating on the data at intermediate nodes in the system with one or more of the plurality of discrete processes during the transaction wherein each of the discrete processes requires information and data from another previously executed one of the discrete processes prior to transferring data therefrom, comprising the steps of: 
 determining when a transaction has been initiated from the first location and has been transferred to the one of the intermediate nodes in the network;    logging the initiation of the transaction at a central location on the network;    determining when the initiated transaction has been completed by transfer of the processed data to the second location on the network from the last of the intermediate nodes in the network that has operated on the data;    monitoring the length of time that the initiated one of the plurality of processes requires for completion at a given one of the intermediate nodes; and    logging the completion of the transaction at the central location on the network in addition to the time information determined in the step of monitoring.    
   
   
       2 : The method of  claim 1 , and further comprising the steps of: 
 determining when one of the plurality of processes associated with the initiated transaction has been initiated on the given one of the intermediate nodes associated with the initiated transaction;    logging the initiation of the one of the plurality of processes that has been initiated at a local location on the network;    determining when the initiated one of the plurality of processes has been completed on the given intermediate node; and    logging the completion of the initiated one of the plurality of processes at the local location on the network.    
   
   
       3 : The method of  claim 3 , wherein the step of monitoring the length of time that the initiated one of the plurality of processes requires for completion at the given one of the intermediate nodes comprises the steps of: 
 initiating a process timer when the initiated one of the plurality of processes has been initiated;    comparing the value of the timer with a predetermined process completion time for the initiated one of the plurality of processes to be completed;    if not completed, logging an error message to the central location that the initiated one of the plurality of processes has not been completed within the predetermined process completion time.    
   
   
       4 : The method of  claim 4 , wherein the step of logging the error message further includes sending a notification to a predetermined location that the initiated one of the processes has not been completed during the predetermined process completion time.  
   
   
       5 : The method of  claim 4 , and further comprising the step of determining if the initiated one of the plurality of processes is still running on the given one of the intermediate nodes after a determination of not complete and, if so, then resetting the process timer back by a predetermined amount of time prior to the step of logging the error message to the central location.  
   
   
       6 : The method of  claim 4 , and further comprising the step of monitoring the process through each step of the process and logging predetermined information regarding each step of the initiated one of the plurality of processes as to progress of the initiated one of the plurality of processes at the given node.  
   
   
       7 : The method of  claim 7 , wherein the step of logging the error message further comprises the step of logging the predetermined process step wherein the initiated one of the plurality of processes was determined to have not been completed during the predetermined process completion time.  
   
   
       8 : The method of  claim 8 , and further comprising the steps of: 
 storing information regarding the initiated one of the plurality of processes, such that the initiated one of the plurality of processes can be reinitiated at the given one of the nodes; and    reinitiating the initiated one of the plurality of processes determined to have not been completed during the predetermined process completion.    
   
   
       9 : The method of  claim 1 , and further comprising the step of monitoring the length of time that the initiated one of the transactions requires for completion.  
   
   
       10 : The method of  claim 10 , wherein the step of monitoring the length of time that the transaction requires for completion comprises the steps of: 
 initiating a process timer when the initiated one of transactions has been initiated;    comparing the value of the timer with a predetermined transaction completion time for the initiated one of the transactions;    if not completed, logging an error message to the central location that the initiated one of the transactions has not been completed within the predetermined transaction completion time.    
   
   
       11 : The method of  claim 11 , wherein the step of logging the error message further includes sending a notification to a predetermined location that the initiated one of the transactions has not been completed during the predetermined transaction completion time.  
   
   
       12 : The method of  claim 1 , where there is a plurality of data associated with each of the transactions and transaction parameters associated therewith to define the transaction in the system, and further comprising the step of storing the plurality of data associated with each of the transactions and transaction parameters associated therewith in an archive.  
   
   
       13 : The method of  claim 13 , and wherein the step of logging comprises logging a pointer to the plurality of data associated with each of the transactions and transaction parameters associated therewith stored in the archive and information associated with the progress of the transaction on each of the intermediate nodes.  
   
   
       14 : The method of  claim 14 , and further comprising filtering the logged information and storing the filtered logged information in an external log and allowing restricted access thereto by an external system for review thereof.