First Network Node, Second Network Node, Wireless Device, and Methods Performed Thereby for Handling One or More Reports

Abstract

A method performed by a first network node (111). The method is for handling one or more reports. The first network node (111) operates in a wireless communications network (100). The first network node (111) receives (604) a message, from at least one of a second network node (112) and one or more wireless devices (130) operating in the wireless communications network (100). The message comprises one or more reports comprising respective information of a respective Life-Cycle Management (LCM), of one or more machine learning (ML) models. The one or more ML models are available at least in part in at least one of the one or more wireless devices (130). The first network node (111) then performs (606) one or more actions using the information comprised in at least one of the one or more reports.

1 - 38 . (canceled) 
     
     
         39 . A method performed by a first network node, the method being for handling one or more reports, the first network node operating in a wireless communications network, and the method comprising:
 receiving a message from at least one of a second network node and one or more wireless devices operating in the wireless communications network, the message comprising one or more reports comprising respective information of a respective Life-Cycle Management (LCM) of one or more machine learning (ML) models, the one or more ML models being available at least in part in at least one of the one or more wireless devices; and   performing one or more actions using the information comprised in at least one of the one or more reports.   
     
     
         40 . The method of  claim 39 , wherein the one or more actions comprise at least one of:
 retraining or triggering a retraining of at least one of the one or more ML models;   updating or triggering an update of at least one of the one or more ML models;   deploying or triggering a deployment of an additional ML model;   revoking or triggering a revocation of at least one of the one or more ML models;   forwarding the one or more reports to a third network node operating in the wireless communications network; and   completing an ongoing procedure handled by the first network node.   
     
     
         41 . The method of  claim 39 , wherein the message comprises at least one of:
 one or more first indications of a respective identifier or identity of the one or more ML models;   one or more second indications of a respective vendor of the one or more ML models;   one or more third indications of a respective version of the one or more ML models;   one or more fourth indications of a type of the one or more ML models;   one or more fifth indications of a respective Operating System of the one or more wireless devices;   one or more sixth indications of a respective identifier of one or more applications the one or more ML models relate to;   one or more seventh indications of a respective identifier of one or more use cases the one or more ML models relate to;   one or more eighth indications of a respective identifier of one or more services or service types the one or more ML models relate to;   one or more ninth indications of a respective identifier of one or more network slices the one or more ML models relate to;   a cause value indicating a reason for a failure/reject; and   one or more data samples associated to one or more LCM operations for the one or more ML models available at least in part in at least one of the one or more wireless devices of:
 testing of the one or more ML models; 
 validation of the one or more ML models; 
 verification of the one or more ML models; 
 evaluation of the one or more ML models; 
 security assessment of the one or more ML models; and 
 training of the one or more ML models. 
   
     
     
         42 . The method of  claim 39 , wherein the message is a second message and wherein the method further comprises at least one of:
 sending a first message to the second network node, the first message comprising a first request to receive the one or more reports comprising the respective information of the respective LCM of the one or more ML models available at least in part in at least one of the one or more wireless devices, and wherein the second message is received in response to the sent first message, the second message comprising the one or more reports requested by the first network node; and   sending, in response to the received second message, a further message to the one of the second network node and one or more wireless devices, the further message comprising at least one of:
 a tenth indication, implicit or explicit, of success; 
 an eleventh indication, implicit or explicit, of failure or reject; and 
 a twelfth indication of no support. 
   
     
     
         43 . The method of  claim 42 , wherein the first message further comprises at least one of:
 at least one of a first request and a set of configuration parameters to be sent from the second network node to the one or more wireless devices to obtain the one or more reports;   one or more thirteenth indications of a respective one or more of model, vendor and type of the one or more wireless devices;   one or more fourteenth indications of a respective identity of the one or more wireless devices;   one or more fifteenth indications of respective criteria to select the one or more wireless devices;   a sixteenth indication of an area of scope;   a second request to obtain, from the second network node or from the at least one of the one or more wireless devices, one or more data samples associated to one or more LCM operations for the one or more ML models, of at least one of the one or more wireless devices, of:
 testing of the one or more ML models; 
 validation of the one or more ML models; 
 verification of the one or more ML models; 
 evaluation of the one or more ML models; 
 security assessment of the one or more ML models; and 
 training of the one or more ML models; 
   a seventeenth indication indicating to one of: start, stop, pause, resume, allow and prohibit sending any or all of the one or more reports;   an eighteenth indication indicating to one of: start, stop, pause, resume, allow and prohibit requesting additional one or more reports comprising respective information of a respective LCM of one or more ML models, to at least one of the one or more wireless devices;   a nineteenth indication indicating to the second network node to obtain the latest test report available for at least one of the one or more wireless devices, without requesting further test reports from the at least one of the one or more wireless devices;   one or more conditions on the reporting; and   a twentieth indication of a reason for requesting the one or more reports.   
     
     
         44 . The method of  claim 42 , further comprising at least one of:
 receiving, from the second network node or a third network node operating in the wireless communications network, another message, the another message indicating the existence of the one or more ML models available at least in part in the at least one of the one or more wireless devices, and wherein the first message is sent based on the received another message; and   determining a need to receive the respective information of the respective LCM of the one or more ML models available at least in part in the at least one of the one or more wireless devices.   
     
     
         45 . A method performed by a wireless device, the method being for handling one or more reports, the wireless device operating in a wireless communications network, and the method comprising:
 receiving a third message from a second network node operating in the wireless communications network, the third message comprising a request to receive one or more reports comprising respective information of a respective Life-Cycle Management (LCM) of one or more machine learning (ML) models, the one or more ML models being available at least in part in the wireless device; and   sending an additional message, to one of the second network node and a first network node operating in the wireless communications network, the additional message comprising the one or more reports comprising the respective information.   
     
     
         46 . The method of  claim 45 , wherein the one or more reports comprise at least one of:
 a testing report of at least one of the one or more ML models;   a verification report of at least one of the one or more ML models;   a validation report of at least one of the one or more ML models;   an evaluation report of at least one of the one or more ML models;   a security assessment report of at least one of the one or more ML models; and   a report of training, updating, or modifying at least one of the one or more ML models.   
     
     
         47 . The method of  claim 45 , wherein the respective information is to enable the first network node to perform one or more actions, the one or more actions comprising at least one of:
 retraining or triggering a retraining of at least one of the one or more ML models;   updating or triggering an update of at least one of the one or more ML models;   deploying or triggering a deployment of an additional ML model;   revoking or triggering a revocation of at least one of the one or more ML models;   forwarding the one or more reports to a third network node operating in the wireless communications network; and   completing an ongoing procedure handled by the first network node.   
     
     
         48 . The method of  claim 45 , wherein the additional message comprises at least one of:
 one or more first indications of a respective identifier or identity of the one or more ML models;   one or more second indications of a respective vendor of the one or more ML models;   one or more third indications of a respective version of the one or more ML models;   one or more fourth indications of a type of the one or more ML models, one or more fifth indications of a respective Operating System of the wireless device;   one or more sixth indications of a respective identifier of one or more applications the one or more ML models relate to;   one or more seventh indications of a respective identifier of one or more use cases the one or more ML models relate to;   one or more eighth indications of a respective identifier of one or more services or service types the one or more ML models relate to;   one or more ninth indications of a respective identifier of one or more network slices the one or more ML models relate to;   a cause value indicating a reason for a failure/reject; and   one or more data samples associated to one or more LCM operations for the one or more ML models available at least in part in the wireless device of:
 testing of the one or more ML models; 
 validation of the one or more ML models; 
 verification of the one or more ML models; 
 evaluation of the one or more ML models; 
 security assessment of the one or more ML models; and 
 training of the one or more ML models. 
   
     
     
         49 . The method of  claim 45 , wherein the additional message is one or a second message and a fifth message and wherein the method further comprises:
 sending a fourth message to the second network node, the fourth message indicating an acknowledgment, failure, or a reject of the received third message.   
     
     
         50 . A first network node for handling one or more reports, the first network node comprising:
 processing circuitry and a memory, the memory containing instructions executable by the processing circuitry whereby the first network node is configured to operate in a wireless communications network, and the first network node being further configured to:
 receive a message, from at least one of a second network node and one or more wireless devices configured to operate in the wireless communications network, the message being configured to comprise one or more reports configured to comprise respective information of a respective Life-Cycle Management (LCM) of one or more machine learning (ML) models, the one or more ML models being configured to be available at least in part in at least one of the one or more wireless devices; and 
 perform one or more actions using the information configured to be comprised in at least one of the one or more reports. 
   
     
     
         51 . The first network node of  claim 50 , wherein the one or more actions are configured to at least one of:
 retraining or triggering a retraining of at least one of the one or more ML models;   updating or triggering an update of at least one of the one or more ML models;   deploying or triggering a deployment of an additional ML model;   revoking or triggering a revocation of at least one of the one or more ML models;   forwarding the one or more reports to a third network node configured to operate in the wireless communications network; and   completing an ongoing procedure handled by the first network node.   
     
     
         52 . The first network node of  claim 50 , wherein the message is configured to comprise at least one of:
 one or more first indications of a respective identifier or identity of the one or more ML models;   one or more second indications of a respective vendor of the one or more ML models;   one or more third indications of a respective version of the one or more ML models;   one or more fourth indications of a type of the one or more ML models,   one or more fifth indications of a respective Operating System of the one or more wireless devices;   one or more sixth indications of a respective identifier of one or more applications the one or more ML models are configured to relate to;   one or more seventh indications of a respective identifier of one or more use cases the one or more ML models are configured to relate to;   one or more eighth indications of a respective identifier of one or more services or service types the one or more ML models are configured to relate to;   one or more ninth indications of a respective identifier of one or more network slices the one or more ML models are configured to relate to;   a cause value configured to indicate a reason for a failure/reject; and   one or more data samples configured to be associated to one or more LCM operations for the one or more ML models configured to be available at least in part in at least one of the one or more wireless devices of:
 testing of the one or more ML models; 
 validation of the one or more ML models; 
 verification of the one or more ML models; 
 evaluation of the one or more ML models; 
 security assessment of the one or more ML models; and 
 training of the one or more ML models. 
   
     
     
         53 . The first network node of  claim 50 , wherein the message is configured to be a second message and wherein the first network node is further configured to at least one of:
 send a first message to the second network node, the first message being configured to comprise a first request to receive the one or more reports configured to comprise the respective information of the respective LCM of the one or more ML models configured to be available at least in part in at least one of the one or more wireless devices, and wherein the second message is configured to be received in response to the sent first message, the second message being configured to comprise the one or more reports configured to be requested by the first network node; and   send, in response to the second message configured to be received, a further message to the one of the second network node and one or more wireless devices, the further message being configured to comprise at least one of:
 a tenth indication, implicit or explicit, of success; 
 an eleventh indication, implicit or explicit, of failure or reject; and 
 a twelfth indication of no support. 
   
     
     
         54 . The first network node of  claim 53 , wherein the first message is further configured to comprise at least one of:
 at least one of a first request and a set of configuration parameters to be sent from the second network node to the one or more wireless devices to obtain the one or more reports;   one or more thirteenth indications of a respective one or more of model, vendor and type of the one or more wireless devices;   one or more fourteenth indications of a respective identity of the one or more wireless devices;   one or more fifteenth indications of respective criteria to select the one or more wireless devices;   a sixteenth indication of an area of scope;   a second request to obtain, from the second network node or from the at least one of the one or more wireless devices, one or more data samples associated to one or more LCM operations for the one or more ML models, of at least one of the one or more wireless devices, of:
 testing of the one or more ML models; 
 validation of the one or more ML models; 
 verification of the one or more ML models; 
 evaluation of the one or more ML models; 
 security assessment of the one or more ML models; and 
 training of the one or more ML models; 
   a seventeenth indication configured to indicate to one of: start, stop, pause, resume, allow and prohibit sending any or all of the one or more reports;   an eighteenth indication configured to indicate to one of: start, stop, pause, resume, allow and prohibit requesting additional one or more reports configured to comprise respective information of a respective LCM of one or more ML models, to at least one of the one or more wireless devices;   a nineteenth indication configured to indicate to the second network node to obtain the latest test report available for at least one of the one or more wireless devices, without requesting further test reports from the at least one of the one or more wireless devices;   one or more conditions on the reporting; and   a twentieth indication of a reason for requesting the one or more reports.   
     
     
         55 . The first network node of  claim 50 , being further configured to at least one of:
 receive, from the second network node or a third network node configured to operate in the wireless communications network, another message, the another message being configured to indicate the existence of the one or more ML models configured to be available at least in part in the at least one of the one or more wireless devices, and wherein the first message is configured to be sent based on the another message configured to be received; and   determine a need to receive the respective information of the respective LCM of the one or more ML models configured to be available at least in part in the at least one of the one or more wireless devices.   
     
     
         56 . A wireless device for handling one or more reports, the wireless device comprising:
 processing circuitry and a memory, the memory containing instructions executable by the processing circuitry whereby the wireless device is configured to operate in a wireless communications network, and the wireless device being further configured to:
 receive a third message from a second network node configured to operate in the wireless communications network, the third message being configured to comprise a request to receive one or more reports configured to comprise respective information, of a respective Life-Cycle Management (LCM) of one or more machine learning (ML) models, the one or more ML models being configured to be available at least in part in the wireless device; and 
 send an additional message, to one of the second network node and a first network node configured to operate in the wireless communications network, the additional message being configured to comprise the one or more reports configured to comprise the respective information. 
   
     
     
         57 . The wireless device of  claim 56 , wherein the respective information is configured to enable the first network node to perform one or more actions, the one or more actions being configured to comprise at least one of:
 retraining or triggering a retraining of at least one of the one or more ML models;   updating or triggering an update of at least one of the one or more ML models;   deploying or triggering a deployment of an additional ML model;   revoking or triggering a revocation of at least one of the one or more ML models;   forwarding the one or more reports to a third network node configured to operate in the wireless communications network; and   completing an ongoing procedure handled by the first network node.   
     
     
         58 . The wireless device of  claim 56 , wherein the additional message is configured to be one or a second message and a fifth message and wherein the wireless device is further configured to:
 send a fourth message to the second network node, the fourth message being configured to indicate an acknowledgement, failure or a reject of the third message configured to be received.