Image processing apparatus, control method for the same, image processing system, and program

Abstract

An image processing apparatus includes an obtaining unit obtaining data of an image of an object and data of a plurality of annotations attached to the image, an input unit receiving a designation of a display magnification for enlarging or reducing the image, and a generation unit generating display data with which the annotations are displayed in such a way as to be superimposed on the image enlarged at the designated display magnification, wherein the data of the plurality of annotations includes position information indicating a position in the image at which each annotation is attached and information about the display magnification of the image at the time of attachment of each annotation, and the generation unit generates display data with which display modes of annotations are made different between annotations of which the display magnifications of the image at the time of attachment thereof are different.

1 . An image processing apparatus comprising:
 an obtaining unit configured to obtain data of an image of an object and data of a plurality of annotations attached to the image;   an input unit configured to receive a designation of a display magnification for enlarging or reducing the image; and   a generation unit configured to generate display data with which the annotations are displayed in such a way as to be superimposed on the image enlarged at the designated display magnification,   wherein the data of the plurality of annotations includes position information indicating a position in the image at which each annotation is attached and information about the display magnification of the image at the time of attachment of each annotation, and   the generation unit generates display data with which a display mode of a first annotation which is attached to the image enlarged at a first display magnification and a display mode of a second annotation which is attached to the image enlarged at a second display magnification are different.   
     
     
         2 . An image processing apparatus according to  claim 1 , wherein the generation unit generates display data with which display modes of annotations are made different between an annotation of which the display magnification of the image at the time of attachment thereof and the designated display magnification are different and an annotation of which the display magnification of the image at the time of attachment thereof and the designated display magnification are the same. 
     
     
         3 . An image processing apparatus according to  claim 1 , wherein the input unit receives a command for selecting one of the annotations displayed in such a way as to be superimposed on the image, and when the input unit receives the command for selection, the generation unit generates display data with which the annotation selected by the command is displayed in such a way as to be superimposed on the image enlarged at the display magnification at the time of attachment of the selected annotation. 
     
     
         4 . An image processing apparatus according to  claim 1 , wherein the data of the image obtained by the obtaining unit includes data of a plurality of image layers of the same object having gradually different resolutions, and the generation unit generates display data using the data of an image layer having a resolution suitable for the designated display magnification. 
     
     
         5 . An image processing apparatus according to  claim 4 , further comprising storage unit configured to calculate a position in each image layer at which an annotation is to be displayed in a superimposed manner, based on the display magnification of the image at the time of attachment of the annotation, the position on the image at which the annotation is attached, and the display magnification corresponding to the resolution of each image layer, and configured to store link information in which the calculated position is associated with information of the annotation, wherein the generation unit calculates a position of the annotation associated with the designated display magnification based on the link information and generates display data with which the annotation is displayed in such a way as to be superimposed on the image enlarged at the designated display magnification. 
     
     
         6 . An image processing apparatus comprising:
 an obtaining unit configured to obtain data of an image of an object including data of a plurality of depth images obtained by imaging the object at different focus positions with respect to the direction of an optical axis, and data of a plurality of annotations attached to the image;   an input unit configured to receive a designation of a focus position; and   a generation unit configured to generate display data with which the annotations are displayed in such a way as to be superimposed on a depth image of the designated focus position,   wherein the data of the plurality of annotations includes position information indicating a position in the image at which each annotation is attached and information about the focus position of the image at the time of attachment of each annotation, and   if an annotation is attached to a depth image of a focus position different from the designated focus position, and the degree of similarity of an image in a neighborhood of a position, which is corresponding to the position of this annotation, in the depth image of the designated focus position and an image in a neighborhood of the position of this annotation in the depth image of a focus position different from the designated focus position is equal to or higher than a threshold value, the generation unit generates display data with which this annotation is displayed in such a way as to be superimposed on the depth image of the designated focus position.   
     
     
         7 . An image processing apparatus according to  claim 6 , wherein the generation unit generates display data with which display modes of annotations are made different between an annotation of which the focus position of the image at the time of attachment thereof and the designated focus position are different and an annotation of which the focus position of the image at the time of attachment thereof and the designated focus position are the same. 
     
     
         8 . An image processing apparatus according to  claim 7 , further comprising storage unit configured to calculate a position in each depth image at which an annotation is to be displayed in a superimposed manner, based on the focus position of the image at the time of attachment of the annotation and the position of the annotation in the image at the time of attachment of the annotation, and configured to store link information in which the calculated position is associated with information of the annotation, wherein the generation unit calculates a position of the annotation associated with the designated focus position based on the link information and generates display data with which the annotation is displayed in such a way as to be superimposed on the depth image of the designated focus position at the calculated position. 
     
     
         9 . An image processing apparatus according to  claim 6 , wherein if an annotation is attached to a depth image of a focus position different from the designated focus position, the generation unit generates display data with which this annotation is displayed in such a way as to be superimposed on the depth image of the designated focus position. 
     
     
         10 . An image processing apparatus according to  claim 9 , wherein the input unit further receives a designation of a display magnification for enlarging or reducing the depth image, and the generation unit generates display data with which the annotation attached to a depth image of a focus position different from the designated focus position is displayed in such a way as to be superimposed on the depth image of the designated focus position, if the display magnification is equal to or higher than a threshold value. 
     
     
         11 . An image processing apparatus according to  claim 9 , wherein the generation unit generates display data with which an annotation attached to the depth image of the designated focus position and the annotation attached to a depth image of a focus position different from the designated focus position are displayed in different display modes. 
     
     
         12 . (canceled) 
     
     
         13 . An image processing apparatus according to  claim 6 , wherein the generation unit determines the degree of similarity of the image in the neighborhood of the position, which is corresponding to the position of the annotation, in the depth image of the designated focus position and the image in the neighborhood of the position of the annotation in the depth image of a focus position different from the designated focus position by calculating the correlation of these images while shifting these images relative to each other in a predetermined range and determines a position in the depth image of the designated focus position at which the annotation attached to the depth image of a focus position different from the designated focus position is to be displayed, based on a shift amount that makes the correlation highest. 
     
     
         14 . An image processing system comprising:
 an image processing apparatus according to  claim 1 ; and   a display apparatus that displays an image based on image data output from the image processing apparatus.   
     
     
         15 . A method of controlling an image processing apparatus comprising:
 an obtaining step of obtaining data of an image of an object and data of a plurality of annotations attached to the image;   an input step of receiving a designation of a display magnification for enlarging or reducing the image; and   a generation step of generating display data with which the annotations are displayed in such a way as to be superimposed on the image enlarged at the designated display magnification,   wherein the data of the plurality of annotations includes position information indicating a position in the image at which each annotation is attached and information about the display magnification of the image at the time of attachment of each annotation, and   in the generation step, generating of display data with which a display mode of a first annotation which is attached to the image enlarged at a first display magnification and a display mode of a second annotation which is attached to the image enlarged at a second display magnification are different is performed.   
     
     
         16 . A method of controlling an image processing apparatus comprising:
 an obtaining step of obtaining data of an image of an object including data of a plurality of depth images obtained by imaging the object at different focus positions with respect to the direction of an optical axis, and data of a plurality of annotations attached to the image;   an input step of receiving a designation of a focus position;   a generation step of generating display data with which the annotations are displayed in such a way as to be superimposed on a depth image of the designated focus position,   wherein the data of the plurality of annotations includes position information indicating a position in the image at which each annotation is attached and information about the focus position of the image at the time of attachment of each annotation, and   if an annotation is attached to a depth image of a focus position different from the designated focus position, and the degree of similarity of an image in a neighborhood of a position, which is corresponding to the position of this annotation, in the depth image of the designated focus position and an image in a neighborhood of the position of this annotation in the depth image of a focus position different from the designated focus position is equal to or higher than a threshold value, in the generation step, generating of display data with which this annotation is displayed in such a way as to be superimposed on the depth image of the designated focus position is performed.   
     
     
         17 . A non-transitory computer readable storage medium storing a computer program that causes a computer to execute the steps in the method of controlling an image processing apparatus according to  claim 15 .