System and method of radiograph correction and visualization

Abstract

Systems and methods of radiograph correction and visualization are disclosed. Certain embodiments provide a method for generating a 3D model of at least part of one anatomical object based on one or more radiographs. The method further includes positioning the 3D model based on information indicative of a normalized projection comprising information indicative of a desired position and orientation of the at least part of one anatomical object with respect to the projection plane. The method further includes generating a 2D projection of the 3D model onto the projection plane. The method further includes generating one or more modified radiographs of the at least part of one anatomical object based on the 2D projection.

1 . A computer-implemented method of generating a computer-based radiographic representation of at least part of one anatomical object, the method comprising:
 obtaining, at a computing device, one or more radiographs of at least part of one anatomical object, each of the one or more radiographs comprising a 2D visual representation of the at least part of one anatomical object in a corresponding projection plane;   obtaining, by the computing device, information indicative of a desired position and orientation of the at least part of one anatomical object with respect to a first projection plane; corresponding to a first radiograph of the one or more radiographs;   generating, by the computing device, a 3D model of the at least part of one anatomical object based on the one or more radiographs;   repositioning, by the computing device, the 3D model based on the information indicative of the desired position and orientation of the at least one anatomical object with respect to the first projection plane;   generating, by the computing device, a 2D projection of the 3D model onto the first projection plane, the generating comprising tracing rays, from a position associated with a source of x-rays used to generate the first radiograph, along points on the 3D model where the 3D model is tangential to the traced rays, wherein the 2D projection comprises a contour line representation; and   modifying by the computing device, at least one of the one or more radiographs of the at least part of one anatomical object based on the 2D projection- to generate at least one modified radiograph, the modifying comprising:
 morphing the at least one of the one or more radiographs to align one or more contours of the at least part of one anatomical object in the at least one of the one or more radiographs to the contour line representation. 
   
     
     
         2 . The method of  claim 1 , wherein the first radiograph further comprises position information of the position associated with the source of x-rays used to generate the first radiograph. 
     
     
         3 . The method of  claim 1 , wherein generating the 3D model comprises adjusting a shape of the 3D model to align with a shape of the at least part of one anatomical object in the one or more radiographs. 
     
     
         4 . The method of  claim 1 , wherein the 3D model includes statistical information about the at least part of one anatomical object, the statistical information comprising one or more of a statistical shape model, an articulated statistical shape model, an active shape model, an appearance model, and an intensity model. 
     
     
         5 . The method of  claim 1 , further comprising: displaying the at least one modified radiograph on a display of the computing device. 
     
     
         6 . The method of  claim 5 , further comprising: displaying a visual indication to indicate that the at least one modified radiograph has been modified. 
     
     
         7 . The method of  claim 5 , further comprising:
 defining one or more anatomical landmarks associated with the at least part of one anatomical object in the 3D model;   performing one or more measurements of the at least part of one anatomical object in one or more of the 3D model or the at least one modified radiograph based on the one or more anatomical landmarks; and   displaying the one or more measurements on the display.   
     
     
         8 . The method of  claim 7 , wherein the one anatomical object is a hip of a patient, and wherein the one or more measurements comprise one or more of a femoral diameter, a femoral neck length, a femoral offset, an acetabulum diameter, an acetabulum depth, an acetabulum inclination, an acetabulum anteversion, a pelvic tilt, a tilt of the coronal reference plane of the pelvis, a pelvic anterior tilt, a pelvic lateral tilt, a pelvic rotation, a neck-shaft angle, a femoral torsion, a femur length, a leg length, an adduction or abduction, an internal or external rotation, or a flexion or extension. 
     
     
         9 . The method of  claim 7 , wherein the one anatomical object is a knee of a patient, and wherein the one or more measurements comprise one or more of a femoral mediolateral size, a femoral anteroposterior size, a femoral medial anteroposterior size, a femoral lateral anteroposterior size, a tibial mediolateral size, a tibial anteroposterior size, a tibial medial anteroposterior size, a tibial lateral anteroposterior size, a  varus  or valgus angle, a femoral shaft angle, an adduction or abduction, an internal or external rotation, or a flexion or extension. 
     
     
         10 . The method of  claim 5 , further comprising:
 defining one or more anatomical landmarks associated with the at least part of one anatomical object in the 3D model, wherein displaying the one or more of the modified radiographs comprises displaying information indicative of the one or more anatomical landmarks.   
     
     
         11 . The method of  claim 5 , further comprising:
 displaying a 2D template of an implant on the display.   
     
     
         12 . The method of  claim 1 , further comprising:
 applying an inverse of the morphing to a 2D template of an implant; and   displaying the morphed 2D template of the implant along with the at least one of the one or more radiographs on a display of the computing device.   
     
     
         13 . The method of  claim 1 , wherein repositioning the 3D model with respect to the first projection plane comprises applying a transformation to the 3D model to align the 3D model with the desired position and orientation, and further comprising:
 applying an inverse of the transformation to a 2D template of an implant to generate a 3D template of the implant;   generating, by the computing device, a second 2D projection of the 3D template of the implant onto the first projection plane in the first radiograph; and   displaying the second 2D projection on the first radiograph on a display of the computing device.   
     
     
         14 . The method of  claim 1 , further comprising:
 obtaining a 3D template of an implant;   generating, by the computing device, a second 2D projection of the 3D template of the implant onto the first projection plane in the first radiograph; and   displaying the second 2D projection on the first radiograph on a display of the computing device.   
     
     
         15 . The method of  claim 1 , further comprising displaying the repositioned 3D model on a display of the computing device. 
     
     
         16 . The method of  claim 15 , wherein the displaying comprises displaying 2D slices of the repositioned 3D model. 
     
     
         17 . The method of  claim 1 , further comprising:
 defining one or more anatomical landmarks associated with the at least part of one anatomical object in the 3D model;   performing one or more measurements of the at least part of one anatomical object in the 3D model based on the one or more anatomical landmarks;   identifying the one or more anatomical landmarks in one or more additional radiographs; and   performing one or more additional measurements of the at least part of one anatomical object in the one or more additional radiographs based on the one or more anatomical landmarks.   
     
     
         18 . A non-transitory computer-readable medium having computer-executable instructions stored thereon, which, when executed by a computing device, cause the computing device to perform a method of generating a computer-based radiographic representation of at least part of one anatomical object, the method comprising:
 obtaining one or more radiographs of at least part of one anatomical object, each of the one or more radiographs comprising a 2D visual representation of the at least part of one anatomical object in a corresponding projection plane;   obtaining information indicative of a desired position and orientation of the at least part of one anatomical object with respect to a first projection plane corresponding to a first radiograph of the one or more radiographs;   generating a 3D model of the at least part of one anatomical object based on the one or more radiographs;   repositioning the 3D model based on the information indicative of the desired position and orientation of the at least one anatomical object with respect to the first projection plane;   generating a 2D projection of the 3D model onto the first projection plane, the generating comprising tracing rays, from a position associated with a source of x-rays used to generate the first radiograph, along points on the 3D model where the 3D model is tangential to the traced rays, wherein the 2D projection comprises a contour line representation; and   modifying at least one of the one or more radiographs of the at least part of one anatomical object based on the 2D projection to generate at least one modified radiograph, the modifying comprising:
 morphing the at least one of the one or more radiographs to align one or more contours of the at least part of one anatomical object in the at least one of the one or more radiographs to the contour line representation. 
   
     
     
         19 . A computing device comprising: a memory; and a processor configured to perform a method of generating a computer-based radiographic representation of at least part of one anatomical object, the method comprising:
 obtaining one or more radiographs of at least part of one anatomical object, each of the one or more radiographs comprising a 2D visual representation of the at least part of one anatomical object in a corresponding projection plane;   obtaining information indicative of a desired position and orientation of the at least part of one anatomical object with respect to a first projection plane corresponding to a first radiograph of the one or more radiographs;   generating a 3D model of the at least part of one anatomical object based on the one or more radiographs;   repositioning the 3D model based on the information indicative of the desired position and orientation of the at least one anatomical object with respect to the first projection plane;   generating a 2D projection of the 3D model onto the first projection plane, the generating comprising tracing rays, from a position associated with a source of x-rays used to generate the first radiograph, along points on the 3D model where the 3D model is tangential to the traced rays, wherein the 2D projection comprises a contour line representation; and   modifying at least one of the one or more radiographs of the at least part of one anatomical object based on the 2D projection to generate at least one modified radiograph, the modifying comprising:
 morphing the at least one of the one or more radiographs to align one or more contours of the at least part of one anatomical object in the at least one of the one or more radiographs to the contour line representation.