Human-machine interaction for controlling and/or configuring a medical technology system

Abstract

For human-machine interaction for controlling and/or configuring a medical technology system, a user input for a central computer-implemented language model (CIS) that relates to a performance of a medical examination and/or intervention using the medical technology system is captured. Using the central CIS, a first prompt for a first CIS is generated as a function of the user input. Using the first CIS, first instructions for controlling and/or configuring a first medical technology apparatus of the medical technology system are generated as a function of the first prompt. As a function of the first instructions, the first apparatus is at least partially automatically controlled and/or configured, and/or as a function of the first instructions, user information for controlling and/or configuring the first apparatus are output.

1 . A method for human-machine interaction for controlling, configuring, or controlling and configuring a medical technology system, the method being computer-implemented and comprising:
 capturing a user input for a central computer-implemented language model (CIS), which relates to a performance of a medical examination, intervention, or examination and intervention using the medical technology system;   generating, using the central CIS, a first prompt for a first CIS assigned to a first apparatus of the medical technology system as a function of the user input;   generating, using the first CIS, first instructions for controlling, configuring, or controlling and configuring the first apparatus as a function of the first prompt; and   automatically controlling, configuring, or controlling and configuring the first apparatus as a function of the first instructions, outputting user information for controlling, configuring, or controlling and configuring the first apparatus as a function of the first instructions, or a combination thereof.   
     
     
         2 . The method of  claim 1 , wherein the first apparatus includes an imaging system. 
     
     
         3 . The method of  claim 2 , wherein the imaging system includes a C-arm X-ray imaging system, an angiography system, a computed tomography system, a magnetic resonance tomography system, a positron emission tomography system, an ultrasound imaging system, or any combination thereof. 
     
     
         4 . The method of  claim 1 , further comprising:
 generating, using the central CIS, a second prompt for a second CIS assigned to a second apparatus of the medical technology system as a function of the user input;   generating, using the second CIS, second instructions for controlling, configuring, or controlling and configuring the second apparatus as a function of the second prompt; and   at least partially automatically controlling, configurating, or controlling and configuring the second apparatus as a function of the second instructions, outputting user information for controlling, configuring, or controlling and configuring the second apparatus as a function of the second instructions, or a combination thereof.   
     
     
         5 . The method of  claim 4 , wherein the second apparatus includes a lighting apparatus, a patient table, a display device, or any combination thereof. 
     
     
         6 . The method of  claim 1 , further comprising:
 retrieving, using the central CIS, first data that contains configuration data for the first apparatus, patient data, operator data for an operative of the medical technology system, or any combination thereof from at least one database as a function of the user input; and   at least partially automatically controlling, configuring, or controlling and configuring the first apparatus as a function of the first data, outputting the user information as a function of the first data, or a combination thereof.   
     
     
         7 . The method of  claim 6 , further comprising:
 generating, using the central CIS, a third prompt for a third CIS as a function of the user input; and   retrieving, using the third CIS, the first data from the at least one database as a function of the third prompt.   
     
     
         8 . The method of  claim 1 , further comprising:
 capturing a further user input for the central CIS, the further user input including a status query relating to vital parameters for a patient, a status of the first apparatus, or the vital parameters for the patient and the status of the first apparatus;   generating, using the central CIS, a further first prompt for the first CIS as a function of the further user input;   generating, using the first CIS, further first instructions for retrieving the vital parameters for the patient, the status of the first apparatus, or the vital parameters for the patient and the status of the first apparatus as a function of the further first prompt; and   at least partially automatically retrieving the vital parameters for the patient, the status of the first apparatus, or the vital parameters for the patient and the status of the first apparatus as a function of the further first instructions.   
     
     
         9 . The method of  claim 1 , wherein the user input is a text input, or
 wherein the user input is a voice input, the voice input is converted into a text input, and the first prompt is generated as a function of the text input.   
     
     
         10 . The method of  claim 1 , wherein the central CIS is trained based on training data, and wherein:
 the training data contains specified clinical guidelines, examination protocols, intervention protocols, or any combination thereof for the medical technology system, scientific publications relating to examinations, interventions, or examinations and interventions that are performable using the medical technology system;   the training data contains historic user inputs for the central CIS, historic configuration data for the medical technology system, or a combination thereof; or   a combination thereof.   
     
     
         11 . The method of  claim 1 , wherein the first CIS is trained based on further training data, and
 wherein:
 the further training data contains at least one user manual, at least one set of operating instructions, at least one description for the first apparatus, or any combination thereof; 
 the further training data contains specified clinical guidelines, examination protocols, intervention protocols for the first apparatus, scientific publications relating to examinations, interventions that are performable using the first apparatus, or any combination thereof; 
 the further training data contains historic configuration data, control data, or historic configuration data and control data for the first apparatus; or 
 any combination thereof. 
   
     
     
         12 . The method of  claim 1 , wherein the central CIS includes a trained artificial neural network configured as a transformer network, the first CIS includes a further trained artificial neural network configured as a transformer network, or a combination thereof. 
     
     
         13 . A data processing apparatus for human-machine interaction for controlling, configuring, or controlling and configuring a medical technology system, the data processing apparatus comprising:
 a processor configured to:
 capture a user input for a central computer-implemented language model (CIS), which relates to a performance of a medical examination, intervention, or examination and intervention using the medical technology system; 
 generate, using the central CIS, a first prompt for a first CIS assigned to a first apparatus of the medical technology system as a function of the user input; 
 generate, using the first CIS, first instructions for controlling, configuring, or controlling and configuring the first apparatus as a function of the first prompt; and 
 automatically control, configure, or control and configure the first apparatus as a function of the first instructions, output user information for controlling, configuring, or controlling and configuring the first apparatus as a function of the first instructions, or a combination thereof. 
   
     
     
         14 . A medical technology system comprising:
 a data processing apparatus for human-machine interaction for controlling, configuring, or controlling and configuring a medical technology system, the data processing apparatus comprising:   a processor configured to:
 capture a user input for a central computer-implemented language model (CIS), which relates to a performance of a medical examination, intervention, or examination and intervention using the medical technology system; 
 generate, using the central CIS, a first prompt for a first CIS assigned to a first apparatus of the medical technology system as a function of the user input; 
 generate, using the first CIS, first instructions for controlling, configuring, or controlling and configuring the first apparatus as a function of the first prompt; and 
 automatically control, configure, or control and configure the first apparatus as a function of the first instructions, output user information for controlling, configuring, or controlling and configuring the first apparatus as a function of the first instructions, or a combination thereof; and 
 the first apparatus. 
   
     
     
         15 . In a non-transitory computer-readable storage medium that stores instructions executable by one or more processors for human-machine interaction for controlling, configuring, or controlling and configuring a medical technology system, the instructions comprising:
 capturing a user input for a central computer-implemented language model (CIS), which relates to a performance of a medical examination, intervention, or examination and intervention using the medical technology system;   generating, using the central CIS, a first prompt for a first CIS assigned to a first apparatus of the medical technology system as a function of the user input;   generating, using the first CIS, first instructions for controlling, configuring, or controlling and configuring the first apparatus as a function of the first prompt; and   automatically controlling, configuring, or controlling and configuring the first apparatus as a function of the first instructions, outputting user information for controlling, configuring, or controlling and configuring the first apparatus as a function of the first instructions, or a combination thereof.