System and Method for Generating Digital Information and Altering Digital Models of Components With Same

Abstract

Digital information to be associated with a component can be generated and used to alter a digital model of the component. A line of sight to at least a portion of a marking device and the component can be detected, and at least one of an orientation or a position of an endpoint of the marking device relative to the component can be determined using the line of sight. Digital information indicative of the at least one of the orientation or the position of the endpoint relative to the component can be generated responsive to the endpoint of the marking device contacting the component. The digital information can be used to alter a digital model based on defects of the component corresponding to portions contacted by the endpoint of the marking device.

1 - 20 . (canceled) 
     
     
         21 . A system, comprising:
 a computing device including a memory, a processor, and a display;   a marking device in communication with the computing device, wherein the marking device includes an endpoint; and   an imaging device in communication with the computing device,   wherein the memory includes instructions executable by the processor to:
 determine at least one of an orientation or a position of the endpoint relative to a component detected using a line of sight of the imaging device; 
 generate markup instructions representing one or more visual annotations to the component, wherein the markup instructions are indicative of the at least one of the orientation or the position of the endpoint relative to the component; 
 alter a digital model of the component according to the markup instructions to produce an altered digital model, wherein a first graphical layer of the altered digital model represents the one or more visual annotations and a second graphical layer of the altered digital model represents the digital model; and 
 output the altered digital model of the component to the display to enable manipulation of the first graphical layer together with the second graphical layer. 
   
     
     
         22 . The system of  claim 21 , wherein the markup instructions are generated based on speech input received responsive to a toggling of an interface element of the marking device. 
     
     
         23 . The system of  claim 22 , wherein the instructions to generate the markup instructions representing the one or more visual annotations to the component include instructions executable by the processor to:
 determine a correspondence between the at least one of the orientation or position of the endpoint of the marking device and a portion of the component; and   process the speech input to associate the portion of the component with a defect of a list of defects detectable for the component.   
     
     
         24 . The system of  claim 23 , wherein the instructions to determine the correspondence between the at least one of the orientation or position of the endpoint of the marking device and the portion of the component include instructions executable by the processor to:
 determine a set of coordinates representing correspondences between locations of the endpoint of the marking device in a multi-dimensional space and portions of the component in the multi-dimensional space, wherein the set of coordinates forms a point cloud;   project a surface of the point cloud to a surface of the component corresponding to the set of coordinates; and   identify the portion of the component associated with the correspondence between the at least one of the orientation or position of the endpoint of the marking device and the portion of the component as at least a portion of the surface of the point cloud.   
     
     
         25 . The system of  claim 21 , wherein the instructions to determine the at least one of the orientation or the position of the endpoint relative to the component detected using the line of sight of the imaging device include instructions executable by the processor to:
 detect, using the imaging device, a first target coupled to the marking device and a second target coupled to the component;   calculate the at least one of the orientation or the position of the endpoint relative to the component based on offsets between the first target and the second target; and   track the marking device based on the at least one of the orientation or the position of the endpoint relative to the component.   
     
     
         26 . The system of  claim 25 , wherein the instructions to calculate the at least one of the orientation or the position of the endpoint relative to the component based on the offsets between the first target and the second target include instructions executable by the processor to:
 calibrate at least one of the first target or the second target to the endpoint based on the offsets between the first target and the second target.   
     
     
         27 . The system of  claim 25 , wherein multiple targets including the first target are coupled to the marking device. 
     
     
         28 . The system of  claim 21 , wherein the instructions include instructions executable by the processor to:
 selectively toggle, based on input received from a user of the marking device, the display of the first graphical layer on or off,   wherein the first graphical layer and the second graphical layer are displayed together when the display of the first graphical layer is toggled on, and   wherein the second graphical layer alone is displayed when the display of the first graphical layer is toggled off.   
     
     
         29 . The system of  claim 21 , wherein the imaging device is a primary imaging device, wherein the system further comprises a secondary imaging device, and wherein the instructions to determine the at least one of the orientation or the position of the endpoint relative to the component detected using the line of sight of the imaging device include instructions executable by the processor to:
 identify, using the primary imaging device, the at least one of the orientation or the position of the endpoint relative to the component using the line of sight of the primary imaging device; and   identify, using the secondary imaging device, the at least one of the orientation or the position of the endpoint relative to a coordinate plane of the primary imaging device.   
     
     
         30 . The system of  claim 21 , wherein the markup instructions are generated based on a contacting of the endpoint to a portion of the component. 
     
     
         31 . A system, comprising:
 a computing device including a memory, a processor, and a display, wherein the memory includes instructions executable by the processor to:
 generate data indicative of visual annotations to make to a component based on at least one of an orientation or a position of a marking device relative to the component; 
 alter a digital model of the component using the data to produce an altered digital model, wherein a first graphical layer of the altered digital model represents the visual annotations and a second graphical layer of the altered digital model represents the digital model; and 
 output the altered digital model of the component to the display to enable manipulation of the first graphical layer together with the second graphical layer. 
   
     
     
         32 . The system of  claim 31 , wherein the instructions includes instructions executable by the processor to:
 determine the at least one of the orientation or the position of an endpoint of the marking device relative to the component detected using a line of sight of an imaging device.   
     
     
         33 . The system of  claim 31 , wherein the digital model is stored in a first digital file, wherein the instructions include instructions executable by the processor to:
 store the data indicative of visual annotations within a second digital file separate from the first digital file.   
     
     
         34 . The system of  claim 31 , wherein the instructions include instructions executable by the processor to:
 generate a comment associated with an annotation of the one or more annotations, wherein the comment is displayed separately from the altered digital model.   
     
     
         35 . The system of  claim 34 , wherein the comment indicates a resolving device to use to resolve a defect located at a portion of the altered digital model corresponding to the annotation. 
     
     
         36 . A method, comprising:
 determining at least one of an orientation or a position of a marking device relative to a component detected using a line of sight of an imaging device;   generating markup instructions representing one or more visual annotations to the component, wherein the markup instructions are indicative of the at least one of the orientation or the position of the marking device relative to the component;   altering a digital model of the component according to the markup instructions to produce an altered digital model, wherein a first graphical layer of the altered digital model represents the one or more visual annotations and a second graphical layer of the altered digital model represents the digital model; and   outputting the altered digital model of the component for display at a computing device to enable manipulation of the first graphical layer together with the second graphical layer.   
     
     
         37 . The method of  claim 36 , wherein the markup instructions are generated based on speech input received from a user of the marking device. 
     
     
         38 . The method of  claim 36 , wherein the markup instructions are generated based on a contacting of an endpoint of the marking device to a portion of the component. 
     
     
         39 . The method of  claim 36 , wherein determining the at least one of the orientation or the position of the marking device relative to the component detected using the line of sight of the imaging device comprises:
 detecting, using the imaging device, a first target coupled to the marking device and a second target coupled to the component;   calculating the at least one of the orientation or the position of the marking device relative to the component based on offsets between the first target and the second target; and   tracking the marking device based on the at least one of the orientation or the position of the marking device relative to the component.   
     
     
         40 . The method of  claim 36 , wherein generating the markup instructions representing the one or more visual annotations to the component comprises:
 determining a correspondence between the at least one of the orientation or position of the marking device and a portion of the component; and   associating the portion of the component with a defect of a list of defects detectable for the component.