US12324563B2ActiveUtilityA1

Image processing apparatus, processor apparatus, endoscope system, image processing method, and program enabling notification of a biopsy certainty factor

Assignee: FUJIFILM CORPPriority: Sep 11, 2020Filed: Mar 6, 2023Granted: Jun 10, 2025
Est. expirySep 11, 2040(~14.1 yrs left)· nominal 20-yr term from priority
Inventors:Maiko Endo
H04N 7/183G06T 2207/30168G06T 2207/30096G06T 2207/10068G06T 11/00G06T 7/0012A61B 1/0005H04N 23/555A61B 1/000094G06V 20/50G06V 2201/03G06V 10/25G06T 2207/20084G06T 2207/10088G06T 2207/10081G06T 2207/10132G06T 2207/10016G06T 2207/10024G06V 2201/034A61B 1/0638A61B 1/00055H04N 7/185
57
PatentIndex Score
0
Cited by
31
References
15
Claims

Abstract

Provided are an image processing system, a processor apparatus, an endoscope system, an image processing method, and a program that enable notification of a biopsy certainty factor with which the obstruction of a user's field of view is suppressed. A medical image ( 38 ) is acquired, a region ( 500 ) of interest is detected from the medical image, a biopsy certainty factor representing certainty of a biopsy region that is a biopsy target is calculated for the region of interest, a notification image ( 502 ) is generated, the notification image being an image in which a degree of notification differs depending on the calculated biopsy certainty factor and being an image that is to be displayed so as to be superimposed on the medical image, and a display signal representing the notification image is transmitted to a display apparatus.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. An image processing system comprising
 one or more processors configured to: 
 acquire a medical image; 
 detect a region of interest from the medical image; 
 calculate a biopsy certainty factor for the region of interest, the biopsy certainty factor representing certainty of a biopsy region that is a biopsy target; 
 generate a notification image in which a degree of notification differs depending on the calculated biopsy certainty factor, the notification image being to be displayed so as to be superimposed on the medical image; 
 transmit a display signal representing the notification image to a display apparatus; 
 detect whether a biopsy instrument is included in the medical image; and 
 stop transmission of the display signal representing the notification image if a detection result indicating that the biopsy instrument is included in the medical image is obtained. 
 
     
     
       2. The image processing system according to  claim 1 , wherein the one or more processors are configured to
 set a threshold value for the biopsy certainty factor, and 
 cause a biopsy certainty factor exceeding the threshold value to be displayed as the notification image. 
 
     
     
       3. The image processing system according to  claim 1 , wherein the one or more processors are configured to generate the notification image in which an image quality of the notification image differs depending on the calculated biopsy certainty factor. 
     
     
       4. The image processing system according to  claim 3 , wherein the one or more processors are configured to generate the notification image in which the image quality of a region in which the biopsy certainty factor is relatively small is reduced compared to a region in which the biopsy certainty factor is relatively large. 
     
     
       5. The image processing system according to  claim 3 , wherein the one or more processors are configured to generate the notification image in which a saturation of the notification image differs depending on the calculated biopsy certainty factor. 
     
     
       6. The image processing system according to  claim 5 , wherein the one or more processors are configured to generate the notification image in which the saturation of a region in which the biopsy certainty factor is relatively small is reduced compared to a region in which the biopsy certainty factor is relatively large. 
     
     
       7. The image processing system according to  claim 3 , wherein the one or more processors are configured to generate the notification image in which a luminance of the notification image differs depending on the calculated biopsy certainty factor. 
     
     
       8. The image processing system according to  claim 7 , wherein the one or more processors are configured to generate the notification image in which the luminance of a region in which the biopsy certainty factor is relatively small is reduced compared to a region in which the biopsy certainty factor is relatively large. 
     
     
       9. The image processing system according to  claim 1 , wherein the one or more processors are configured to
 measure an elapsed period from a display start timing of the notification image, and 
 stop transmission of the display signal representing the notification image if the elapsed period from the display start timing of the notification image exceeds a prescribed period. 
 
     
     
       10. The image processing system according to  claim 1 , wherein the one or more processors are configured to
 detect whether a biopsy has been performed, and 
 stop transmission of the display signal representing the notification image if a detection result indicating that the biopsy has been performed is obtained. 
 
     
     
       11. The image processing system according to  claim 1 , wherein the one or more processors are configured to
 calculate a lesion certainty factor for the region of interest, the lesion certainty factor representing certainty of a lesion, and 
 calculate the biopsy certainty factor for the region of interest in which the lesion certainty factor exceeds a prescribed threshold value. 
 
     
     
       12. A processor apparatus for controlling an endoscope, comprising
 one or more processors configured to: 
 acquire an endoscopic image from the endoscope; 
 detect a region of interest from the endoscopic image; 
 calculate a biopsy certainty factor for the region of interest, the biopsy certainty factor representing certainty of a biopsy region that is a biopsy target; 
 generate a notification image in which a degree of notification differs depending on the calculated biopsy certainty factor, the notification image being to be displayed so as to be superimposed on the endoscopic image; 
 transmit a display signal representing the notification image to a display apparatus; 
 detect whether a biopsy instrument is included in the endoscopic image; and 
 stop transmission of the display signal representing the notification image if a detection result indicating that the biopsy instrument is included in the endoscopic image is obtained. 
 
     
     
       13. An endoscope system comprising:
 an endoscope; 
 a processor apparatus for controlling the endoscope; and 
 one or more processors configured to:
 acquire an endoscopic image from the endoscope; 
 detect a region of interest from the endoscopic image; 
 calculate a biopsy certainty factor for the region of interest, the biopsy certainty factor representing certainty of a biopsy region that is a biopsy target; 
 generate a notification image in which a degree of notification differs depending on the calculated biopsy certainty factor, the notification image being to be displayed so as to be superimposed on the endoscopic image; 
 transmit a display signal representing the notification image to a display apparatus; 
 detect whether a biopsy instrument is included in the endoscopic image; and 
 stop transmission of the display signal representing the notification image if a detection result indicating that the biopsy instrument is included in the endoscopic image is obtained. 
 
 
     
     
       14. An image processing method comprising:
 acquiring a medical image; 
 detecting a region of interest from the medical image; 
 calculating a biopsy certainty factor for the region of interest, the biopsy certainty factor representing certainty of a biopsy region that is a biopsy target; 
 generating a notification image in which a degree of notification differs depending on the calculated biopsy certainty factor, the notification image being to be displayed so as to be superimposed on the medical image; 
 transmitting a display signal representing the notification image to a display apparatus; 
 detecting whether a biopsy instrument is included in the medical image; and 
 stopping transmission of the display signal representing the notification image if a detection result indicating that the biopsy instrument is included in the medical image is obtained. 
 
     
     
       15. A non-transitory, computer-readable tangible recording medium which records thereon a program for causing, when read by a computer, the computer to implement:
 a function of acquiring a medical image; 
 a function of detecting a region of interest from the medical image; 
 a function of calculating a biopsy certainty factor for the region of interest, the biopsy certainty factor representing certainty of a biopsy region that is a biopsy target; 
 a function of generating a notification image in which a degree of notification differs depending on the calculated biopsy certainty factor, the notification image being to be displayed so as to be superimposed on the medical image; 
 a function of transmitting a display signal representing the notification image to a display apparatus; 
 a function of detecting whether a biopsy instrument is included in the medical image; and 
 a function of stopping transmission of the display signal representing the notification image if a detection result indicating that the biopsy instrument is included in the medical image is obtained.

Join the waitlist — get patent alerts

Track US12324563B2 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.