Evaluation of documentation of a system or portion thereof

Abstract

A method for execution by an analysis unit includes: obtaining a collection of data for an evaluation of documentation of a system aspect of a system; acquiring data analysis parameters regarding the evaluation of the documentation of the system aspect; determining one or more evaluation perspectives based on the data analysis parameters; determining one or more evaluation modalities based on the data analysis parameters; and evaluating the collection of data with respect to the documentation of the system aspect based on the one or more evaluation perspectives and the one or more evaluation modalities to produce one or more evaluation outputs regarding the documentation of the system aspect.

What is claimed is: 
     
         1 . A method comprises:
 obtaining, by an analysis unit of an analysis system that includes one or more computing entities, a collection of data for an evaluation of documentation of a system aspect of a system;   acquiring, by the analysis unit, data analysis parameters regarding the evaluation of the documentation of the system aspect;   determining, by the analysis unit, one or more evaluation perspectives based on the data analysis parameters;   determining, by the analysis unit, one or more evaluation modalities based on the data analysis parameters; and   evaluating, by the analysis unit, the collection of data with respect to the documentation of the system aspect based on the one or more evaluation perspectives and the one or more evaluation modalities to produce one or more evaluation outputs regarding the documentation of the system aspect.   
     
     
         2 . The method of  claim 1 , wherein the system aspect comprises:
 one or more system elements;   one or more system criteria; and/or   one or more system modes.   
     
     
         3 . The method of  claim 1 , wherein an evaluation perspective of the one or more evaluation perspectives comprises:
 understanding;   implementation;   operation; or   self-analysis.   
     
     
         4 . The method of  claim 1 , wherein an evaluation modality of the one or more evaluation modalities comprises:
 a level of sufficiency of an evaluation metric of the one or more evaluation metrics associated with the system aspect;   a level of effectiveness of the evaluation metric with respect to one or more objectives of the system aspect;   a measure of use of the evaluation metric with respect to supporting the one or more objectives of the system aspect;   a measure of appropriate use of the evaluation metric with respect to supporting the one or more objectives of the system aspect; or   a measure of consistency of use of the evaluation metric with respect to supporting the one or more objectives of the system aspect.   
     
     
         5 . The method of  claim 1 , wherein an evaluation output of the one or more evaluation outputs comprises:
 one or more evaluation ratings;   one or more system aspect deficiencies; or   one or more auto-corrections of the one or more system aspect deficiencies.   
     
     
         6 . The method of  claim 1 , wherein the evaluating the collection of data comprises:
 when the one or more evaluation modalities is a sufficiency modality:   quantifying data of the collection of data regarding the documentation of the system aspect to produce quantified data; determining a reference scale based on an evaluation perspective of the one or more evaluation perspectives and one or more objectives of the system aspect for the evaluation metric; and   comparing the quantified data with the reference scale to produce an evaluation rating regarding sufficiency of the documentation of the system aspect from the evaluation perspective.   
     
     
         7 . The method of  claim 1 , wherein the evaluating the collection of data comprises:
 when the one or more evaluation modalities is an effectiveness modality:   determining a reference scale based on an evaluation perspective of the one or more evaluation perspectives and one or more objectives of the system aspect for the documentation of the system aspect; and   evaluating data of the collection of data regarding the documentation of the system aspect with respect to the reference scale to produce an evaluation rating regarding how effective the documentation of the system aspect support the one or more objectives of the system aspect from the evaluation perspective.   
     
     
         8 . The method of  claim 1 , wherein the evaluating the collection of data comprises:
 when the one or more evaluation modalities is a measure of use modality:   determining a reference scale based on an evaluation perspective of the one or more evaluation perspectives and one or more objectives of the system aspect for the documentation of the system aspect; and   evaluating data of the collection of data regarding the documentation of the system aspect with respect to the reference scale to produce an evaluation rating regarding use of the documentation of the system aspect to support the one or more objectives of the system aspect from the evaluation perspective.   
     
     
         9 . The method of  claim 1 , wherein the evaluating the collection of data comprises:
 when the one or more evaluation modalities is a measure of appropriate use modality:   determining a reference scale based on an evaluation perspective of the one or more evaluation perspectives and one or more objectives of the system aspect for the documentation of the system aspect; and   evaluating data of the collection of data regarding the documentation of the system aspect with respect to the reference scale to produce an evaluation rating regarding appropriate use of the documentation of the system aspect to support the one or more objectives of the system aspect from the evaluation perspective.   
     
     
         10 . The method of  claim 1 , wherein the evaluating the collection of data comprises:
 when the one or more evaluation modalities is a measure of consistency of use modality:   determining a reference scale based on an evaluation perspective of the one or more evaluation perspectives and one or more objectives of the system aspect for the documentation of the system aspect; and   evaluating data of the collection of data regarding the documentation of the system aspect with respect to the reference scale to produce an evaluation rating regarding consistency of use of the documentation of the system aspect to support the one or more objectives of the system aspect from the evaluation perspective.   
     
     
         11 . The method of  claim 1  further comprises:
 determining, by the analysis unit, one or more evaluation viewpoints based on the data analysis parameters. 
 
     
     
         12 . The method of  claim 11 , wherein an evaluation viewpoint of the one or more evaluation viewpoints comprises:
 a disclosed data viewpoint;   a discovered data viewpoint; or   a desired data viewpoint.   
     
     
         13 . The method of  claim 1  further comprises:
 determining, by the analysis unit, one or more evaluation categories based on the data analysis parameters. 
 
     
     
         14 . The method of  claim 13 , wherein an evaluation category of the one or more evaluation categories comprises:
 an identify category;   a protect category;   a detect category;   a respond category; or   a recover category.   
     
     
         15 . The method of  claim 1 , wherein the documentation includes system requirements. 
     
     
         16 . The method of  claim 1 , wherein the documentation includes system designs. 
     
     
         17 . The method of  claim 1 , wherein the documentation includes system operations. 
     
     
         18 . The method of  claim 1 , wherein the documentation includes system assets. 
     
     
         19 . The method of  claim 1 , wherein the documentation includes security requirements. 
     
     
         20 . A computer readable memory comprises:
 a non-transitory memory operable to store operational instructions that, when executed by an analysis unit of analysis system that includes one or more computing entities, causes the analysis unit to perform operations that include:   obtaining, by an analysis unit of an analysis system that includes one or more computing entities, a collection of data for an evaluation of documentation of a system aspect of a system;   acquiring, by the analysis unit, data analysis parameters regarding the evaluation of the documentation of the system aspect;   determining, by the analysis unit, one or more evaluation perspectives based on the data analysis parameters;   determining, by the analysis unit, one or more evaluation modalities based on the data analysis parameters; and   evaluating, by the analysis unit, the collection of data with respect to the documentation of the system aspect based on the one or more evaluation perspectives and the one or more evaluation modalities to produce one or more evaluation outputs regarding the documentation of the system aspect.