Automatic Control Loop Grading and Data Labeling

Abstract

Concepts and technologies disclosed herein are directed to automated control loop grading and data labeling (“ACLGDL”). An ACLGDL system analyzes results of an execution, by a control loop system, of a control loop. The ACLGDL system can grade the results. The ACLGDL system also can instruct, based at least in part upon the grade of the results of the execution, the control loop system to collect additional data. The ACLGDL system can label the additional data for use by an output system. The ACLGDL system can establish plurality of policies including a grading-analysis policy, a grading-results policy, a labeling-collection policy, a labeling policy, a publishing policy, and a notification policy. The ACLGDL system can publish the data labeled in accordance with the labeling policy based, at least in part, upon the publishing policy. The ACLGDL system can notify the output system based, at least in part, upon the notification policy.

1 . A method comprising:
 determining, by an automated control loop grading and data labeling (“ACLGDL”) system, via a processor, that a control loop system has executed a control loop and has generated a result;   analyzing, by the ACLGDL system, the result of the control loop to evaluate a performance of the control loop;   determining, by the ACLGDL system, a grade for the performance of the control loop; and   providing, by the ACLGDL system, the grade to an output system.   
     
     
         2 . The method of  claim 1 , further comprising defining, by ACLGDL system executing, via the processor, a plurality of policies. 
     
     
         3 . The method of  claim 1 , further comprising activating the ACLGDL system for the control loop to be executed by the control loop system. 
     
     
         4 . The method of  claim 1 , further comprising:
 instructing, by the ACLGDL system, the control loop system to collect data from a domain;   preparing, by the ACLGDL system, the data for labeling; and   labeling, by the ACLGDL system, the data for use by the output system, thereby creating labeled data.   
     
     
         5 . The method of  claim 4 , wherein the labeled data comprises a label indicative of a failure; and further comprising proactively notifying, by the ACLGDL system, a mitigation entity of the label indicative of the failure. 
     
     
         6 . The method of  claim 1 , wherein the output system comprises a machine learning system or a system operated by a user. 
     
     
         7 . The method of  claim 1 , further comprising determining whether or not to deactivate the ACLGDL. 
     
     
         8 . The method of  claim 7 , wherein determining to deactivate the ACLGDL is based upon the grade for the performance of the control loop achieving an acceptable grade. 
     
     
         9 . A computer-readable storage medium comprising computer-executable instructions that, when executed by a processor of an automated control loop grading and data labeling (“ACLGDL”) system, cause the processor to perform operations comprising:
 determining that a control loop system has executed a control loop and has generated a result; 
 analyzing the result of the control loop to evaluate a performance of the control loop; 
 determining a grade for the performance of the control loop; and 
 providing the grade to an output system. 
 
     
     
         10 . The computer-readable storage medium of  claim 9 , wherein the operations further comprise defining a plurality of policies. 
     
     
         11 . The computer-readable storage medium of  claim 9 , wherein the operations further comprise activating the ACLGDL system for the control loop to be executed by the control loop system. 
     
     
         12 . The computer-readable storage medium of  claim 9 , wherein the operations further comprise:
 instructing the control loop system to collect data from a domain;   preparing the data for labeling; and   labeling the data for use by the output system, thereby creating labeled data.   
     
     
         13 . The computer-readable storage medium of  claim 12 , wherein the labeled data comprises a label indicative of a failure; and wherein the operations further comprise proactively notifying a mitigation entity of the label indicative of the failure. 
     
     
         14 . The computer-readable storage medium of  claim 9 , wherein the operations further comprise determining whether or not to deactivate the ACLGDL. 
     
     
         15 . The computer-readable storage medium of  claim 14 , wherein determining to deactivate the ACLGDL is based upon the grade for the performance of the control loop achieving an acceptable grade. 
     
     
         16 . An automated control loop grading and data labeling (“ACLGDL”) system comprising:
 a processor; and 
 a memory comprising computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising
 determining that a control loop system has executed a control loop and has generated a result, 
 analyzing the result of the control loop to evaluate a performance of the control loop, 
 determining a grade for the performance of the control loop, and 
 providing the grade to an output system. 
 
 
     
     
         17 . The ACLGDL system of  claim 16 , wherein the operations further comprise defining a plurality of policies. 
     
     
         18 . The ACLGDL system of  claim 16 , wherein the operations further comprise:
 instructing the control loop system to collect data from a domain;   preparing the data for labeling; and   labeling the data for use by the output system, thereby creating labeled data.   
     
     
         19 . The ACLGDL system of  claim 18 , wherein the labeled data comprises a label indicative of a failure; and wherein the operations further comprise proactively notifying a mitigation entity of the label indicative of the failure. 
     
     
         20 . The ACLGDL system of  claim 16 , wherein the operations further comprise determining whether or not to deactivate the ACLGDL.