Method and apparatus for volumetric image navigation

Abstract

A surgical navigation system has a computer with a memory and display connected to a surgical instrument or pointer and position tracking system, so that the location and orientation of the pointer are tracked in real time and conveyed to the computer. The computer memory is loaded with data from an MRI, CT, or other volumetric scan of a patient, and this data is utilized to dynamically display 3-dimensional perspective images in real time of the patient's anatomy from the viewpoint of the pointer. The images are segmented and displayed in color to highlight selected anatomical features and to allow the viewer to see beyond obscuring surfaces and structures. The displayed image tracks the movement of the instrument during surgical procedures. The instrument may include an imaging device such as an endoscope or ultrasound transducer, and the system displays also the image for this device from the same viewpoint, and enables the two images to be fused so that a combined image is displayed. The system is adapted for easy and convenient operating room use during surgical procedures.

What is claimed is:  
     
         1 . A method for generating an image of a three-dimensional object, said method comprising the steps of: 
 acquiring volumetric first scan data for the object;    utilizing said first scan data to reconstruct first virtual image data representing structural information in said first scan data;    selecting a viewpoint for displaying an image of said object based on said first virtual image data;    manipulating said first virtual image data to generate a first three-dimensional perspective image of said object from said viewpoint; and    displaying said first three-dimensional perspective image.    
     
     
         2 . The method recited in    claim 1   , wherein the step of utilizing said first scan data to reconstruct first virtual image data representing structural information in said first scan data includes the step of segmenting said first virtual image data to distinguish selected features of said object.  
     
     
         3 . The method recited in    claim 1   , wherein the step of utilizing said first scan data to reconstruct first virtual image data representing structural information in said first scan data includes the step of registration of said first virtual image data in relation to said object to determine the location of features of said object represented in said first virtual image data.  
     
     
         4 . The method recited in    claim 1   , further comprising, following the step of displaying said first three-dimensional perspective image, repeating any desired number of times the steps of: 
 selecting another viewpoint for displaying an image of said object based on said first virtual image data;    manipulating said first virtual image data to generate a first three-dimensional perspective image of said object from said other viewpoint; and    displaying said first three-dimensional perspective image.    
     
     
         5 . The method recited in    claim 1   , further comprising the steps of: 
 acquiring volumetric second scan data for the object;    utilizing said second scan data to reconstruct second virtual image data representing structural information in said second scan data;    determining the viewpoint for displaying an image of said object based on said second virtual image data to coincide with said viewpoint selected for displaying an image of said object based on said virtual image data;    manipulating said second virtual image data to generate a second three-dimensional perspective image of said object from said viewpoint; and    displaying said second three-dimensional perspective image.    
     
     
         6 . The method recited in    claim 5   , further comprising the step of fusing said second three-dimensional perspective image and said first three-dimensional perspective image to display a combined image.  
     
     
         7 . The method recited in    claim 1   , further comprising the steps of: 
 acquiring second scan data for the object;    utilizing said second scan data to reconstruct second virtual image data representing structural information in said second scan data;    determining the viewpoint for displaying an image of said object based on said second virtual image data to coincide with said viewpoint selected for displaying an image of said object based on said virtual image data;    manipulating said second virtual image data to generate a second image of said object from said viewpoint; and    displaying said second image.    
     
     
         8 . The method recited in    claim 7   , further comprising the step of fusing said second image and said first three-dimensional perspective image to display a combined image.  
     
     
         9 . Apparatus for generating an image of a three-dimensional object, comprising: 
 a computer having a memory;    display means communicative with said computer;    input means communicative with said computer;    pointer means communicative with said computer, said pointer means being movable by the user; and    position tracking means communicative with said computer and said pointing means, such that said position tracking means detects the position and orientation of said pointer means continually and communicates said position and orientation to said computer;    wherein said computer memory contains volumetric first scan data for the object, and further contains a program which causes said computer to perform the steps of:    utilizing said first scan data to reconstruct first virtual image data representing structural information in said first scan data;    determining a viewpoint for displaying an image of said object based on said first virtual image data to be the position and orientation of said pointer means detected by said position tracking means;    manipulating said first virtual image data to generate a first three-dimensional perspective image of said object from said viewpoint; and    displaying said first three-dimensional perspective image.    
     
     
         10 . Apparatus as recited in    claim 9   , wherein the step of utilizing said first scan data to reconstruct first virtual image data representing structural information in said first scan data includes the step of segmenting said first virtual image data to distinguish selected features of said object.  
     
     
         11 . Apparatus as recited in    claim 9   , wherein the step of utilizing said first scan data to reconstruct first virtual image data representing structural information in said first scan data includes the step of registration of said first virtual image data in relation to said object to determine the location of features of said object represented in said first virtual image data.  
     
     
         12 . Apparatus as recited in    claim 9   , wherein said program causes said computer, following the step of displaying said first three-dimensional perspective image, to perform and repeat any desired number of times the further steps of: 
 selecting another viewpoint for displaying an image of said object based on said first virtual image data;    manipulating said first virtual image data to generate a first three-dimensional perspective image of said object from said other viewpoint; and    displaying said first three-dimensional perspective image.    
     
     
         13 . Apparatus as recited in    claim 9   , wherein said program causes said program performs the further steps of: 
 acquiring volumetric second scan data for the object;    utilizing said second scan data to reconstruct second virtual image data representing structural information in said second scan data;    determining the viewpoint for displaying an image of said object based on said second virtual image data to coincide with said viewpoint selected for displaying an image of said object based on said virtual image data;    manipulating said second virtual image data to generate a second three-dimensional perspective image of said object from said viewpoint; and    displaying said second three-dimensional perspective image.    
     
     
         14 . Apparatus as recited in    claim 13   , wherein said program performs the further step of fusing said second three-dimensional perspective image and said first three-dimensional perspective image to display a combined image.  
     
     
         15 . Apparatus as recited in    claim 9   , wherein said program performs the further steps of: 
 acquiring second scan data for the object;    utilizing said second scan data to reconstruct second virtual image data representing structural information in said second scan data;    determining the viewpoint for displaying an image of said object based on said second virtual image data to coincide with said viewpoint selected for displaying an image of said object based on said virtual image data;    manipulating said second virtual image-data to generate a second image of said object from said viewpoint; and    displaying said second image.    
     
     
         16 . Apparatus as recited in    claim 15   , wherein said program performs the further step of fusing said second image and said first three-dimensional perspective image to display a combined image.