Multi-modality image acquistion

Abstract

One or more techniques and/or systems are described for automatically generating a transformation matrix for correlating images from an ultrasound modality with images from another modality (or with ultrasound images acquired at a different point in time). Ultrasound volumetric data and volumetric data yielded from another image modality are examined to identify and/or extract features. The transformation matrix is automatically generated, or populated, based at least in part upon common features that are identified in both the ultrasound volumetric data and the volumetric data yielded from the other image modality. The transformation matrix can then be used to correlate images from the different modalities (e.g., to display a CT image of an object next to an ultrasound image of the object, where the images are substantially similar to one another even though they were acquired using different modalities).

What is claimed is: 
     
         1 . A multi-modality image correlation method, comprising:
 generating using a real-time image modality during a medical procedure, a first volumetric image of a patient comprising a representation of an instrument at a first location relative to the patient;   spatially correlating the first volumetric image with a second volumetric image generated from an examination of the patient using a first image modality other than the real-time image modality using a transformation matrix based on features of the patient present in the first and second volumetric images, wherein the second volumetric image does not comprise a representation of the instrument, and   imposing, during the medical procedure, a representation of the instrument on the second volumetric image responsive to the correlating such that the instrument appears to be present at the first location.   
     
     
         2 . The method of  claim 1 , comprising generating the transformation matrix, comprising:
 identifying a feature in the first volumetric image;   identifying the feature in the second volumetric image; and   comparing a spatial position of the feature in the first volumetric image with a spatial position of the feature in the second volumetric image to generate the transformation matrix.   
     
     
         3 . The method of  claim 1 , the generating, comprising:
 generating the first volumetric image from two or more two-dimensional ultrasound data sets acquired during the imaging.   
     
     
         4 . The method of  claim 1 , the first image modality comprising at least on of a computed tomography image modality or a magnetic resonance image modality. 
     
     
         5 . The method of  claim 1 , the a real-time image modality comprising an ultrasound image modality. 
     
     
         6 . The method of  claim 1 , comprising generating the transformation matrix based at least in part upon a feature in the first volumetric image and a feature in the second volumetric image. 
     
     
         7 . The method of  claim 6 , the feature in the first volumetric image and the feature in the second volumetric image representing a same anatomical feature of the patient. 
     
     
         8 . The method of  claim 7 , the same anatomical feature comprising at least one of a blood vessel, a blood vessel pattern, or a topology of blood vessels trees. 
     
     
         9 . A system for multi-modality image correlation, comprising:
 a real-time image modality that generates, during a medical procedure, a first volumetric image of a patient comprising a representation of an instrument at a first location relative to the patient;   an image correlation component that spatially correlates the first volumetric image with a second volumetric image generated from an examination of the patient using a first image modality other than the real-time image modality using a transformation matrix based on features of the patient present in the first and second volumetric images, wherein the second volumetric image does not comprise a representation of the instrument, and imposes, during the medical procedure, a representation of the instrument on the second volumetric image responsive to the correlating such that the instrument appears to be present at the first location.   
     
     
         10 . The system of  claim 9 , comprising a feature extraction component configured to:
 identify a feature in the first volumetric image; and   identify the feature in the second volumetric image.   
     
     
         11 . The system of  claim 9 , comprising:
 a volumetric data generator that compiles two or more two-dimensional ultrasound images generated by an ultrasound probe based at least in part upon tracking information to generate the first volumetric image.   
     
     
         12 . The system of  claim 11 , comprising:
 a tracking component that implements at least one of an active tracking technique or a passive tracking technique to track movement of the ultrasound probe relative to a patient during the medical procedure in which an instrument is inserted into the patient at a first location and generate tracking information.   
     
     
         13 . The system of  claim 10 , comprising:
 a feature correlation component that generates the transformation matrix based at least in part upon identifying the feature in the first volumetric image and identifying the feature in the second volumetric ultrasound image.   
     
     
         14 . The system of  claim 9 , the first image modality comprising at least one of a computed tomography image modality or a magnetic resonance image modality. 
     
     
         15 . The system of  claim 10 , the feature comprising a representation of at least one of a blood vessel, a blood vessel pattern, or a topology of blood vessels trees. 
     
     
         16 . The system of  claim 9 , comprising:
 a feature correlation component that generates the transformation matrix in the absence of user input.   
     
     
         17 . The system of  claim 9 , comprising:
 a refinement component that refines a correlation of the first volumetric image and the second volumetric image using at least one of a rigid fusion technique or a non-rigid fusion technique.   
     
     
         18 . An apparatus, comprising:
 a memory that stores computer executable instructions; and   a processor that executes the computer executable instructions, wherein executing the computer executable instructions causes the processor to:   spatially correlates, using a transformation matrix, a first volumetric image with a second volumetric image,   wherein the transformation matrix is based on features of the patient present in the first and second volumetric images; wherein the first volumetric image is generated by a real-time image modality during a medical procedure of a patient and includes a representation of an instrument at a first location relative to the patient; wherein the second volumetric image is generated from an examination of the patient using a first image modality other than the real-time image modality; and wherein the second volumetric image does not comprise a representation of the instrument, and   imposes, during the medical procedure, a representation of the instrument on the second volumetric image responsive to the correlating such that the instrument appears to be present at the first location   
     
     
         19 . The apparatus of  claim 19 , wherein executing the computer executable instructions further causes the processor to: generate the transformation matrix by identifying a feature in the first volumetric image, identifying the feature in the second volumetric image, and comparing a spatial position of the feature in the first volumetric image with a spatial position of the feature in the second volumetric ultrasound image. 
     
     
         20 . The apparatus of  claim 19 , wherein the first volumetric image includes volumetric image includes an ultrasound image and the second volumetric image includes at least one of a computed tomography image or a magnetic resonance image.