US2023181001A1PendingUtilityA1

Endoscopic image processing device, endoscopic image processing method, endoscopic image processing program, and endoscope system

Assignee: FUJIFILM CORPPriority: Mar 13, 2019Filed: Feb 3, 2023Published: Jun 15, 2023
Est. expiryMar 13, 2039(~12.6 yrs left)· nominal 20-yr term from priority
Inventors:Toshihiro Usuda
A61B 1/045A61B 1/0005A61B 1/122A61B 1/000094A61B 1/00042A61B 1/015G06T 2207/30096A61B 1/0638G06T 7/0012G06T 2207/10068A61B 1/018
66
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

There are provided an endoscopic image processing device, an endoscopic image processing method, and an endoscope system that appropriately notify region-of-interest information about a region of interest included in an endoscopic image according to an endoscope operator's action.An endoscope operator's action on a portion to be observed of an endoscopic image is recognized from endoscopic images, and first emphasis display where region-of-interest information is displayed in the endoscopic image at a first emphasis level and second emphasis display where the region-of-interest information is displayed at a second emphasis level relatively lower than the first emphasis level are switched according to a recognition result.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . An endoscopic image processing device comprising a processor configured to:
 cause a display to display region-of-interest information about a region of interest included in a plurality of endoscopic images of a portion to be observed sequentially picked up by an endoscope operator and to be sequentially displayed on the display;   recognize an action of the endoscope operator on the portion to be observed from at least one of the plurality of endoscopic images;   perform first emphasis display where the region-of-interest information is displayed at a position in the endoscopic image at a first emphasis level, according to a result of the recognition of the action of the endoscope operator;   recognize whether or not a specific action is performed, wherein the specific action is at least one action of a use of a treatment tool, washing, length measurement, or pigment observation; and   perform the first emphasis display in a case where the specific action is not recognized, and cause the display not to display the region-of-interest information in a case where the specific action is recognized.   
     
     
         2 . The endoscopic image processing device according to  claim 1 , wherein the processor is further configured to:
 cause a frame-shaped figure indicating a position of the region of interest to be displayed on the endoscopic image based on the region-of-interest information; and   cause the frame-shaped figure not to be displayed on the endoscopic image in a case where the pigment observation is recognized.   
     
     
         3 . The endoscopic image processing device according to  claim 1 , wherein the processor is further configured to:
 acquire the plurality of endoscopic images;   detect the region of interest from the acquired endoscopic images; and   acquire the region-of-interest information about the detected region of interest.   
     
     
         4 . The endoscopic image processing device according to  claim 3 , wherein the processor is further configured to cause the display to sequentially display the plurality of acquired endoscopic images. 
     
     
         5 . The endoscopic image processing device according to  claim 1 , wherein the processor is further configured to cause a figure to be displayed on the endoscopic image based on the region-of-interest information. 
     
     
         6 . The endoscopic image processing device according to  claim 1 , further comprising an emphasis method storage configured to store an emphasis method for the region-of-interest information,
 wherein the processor is further configured to cause the region-of-interest information to be displayed by the emphasis method stored in the emphasis method storage.   
     
     
         7 . An endoscope system comprising:
 the endoscopic image processing device according to  claim 1 ;   the display;   an endoscope configured to be inserted into an object to be examined; and   a camera configured to sequentially pick up the plurality of endoscopic images of the portion to be observed included in the object to be examined.   
     
     
         8 . An endoscopic image processing device comprising a processor configured to:
 cause a display to display region-of-interest information about a region of interest included in a plurality of endoscopic images of a portion to be observed sequentially picked up by an endoscope operator and to be sequentially displayed on the display;   recognize an action of the endoscope operator on the portion to be observed from at least one of the plurality of endoscopic images;   switch between first emphasis display where the region-of-interest information is displayed at a position in the endoscopic image at a first emphasis level and second emphasis display where the region-of-interest information is displayed at a second emphasis level relatively lower than the first emphasis level, according to a result of the recognition of the action of the endoscope operator;   recognize whether or not a specific action is performed, wherein the specific action is at least one action of a use of a treatment tool, washing, length measurement, or pigment observation; and   perform the first emphasis display in a case where the specific action is not recognized, and cause the display not to display the region-of-interest information in a case where the specific action is recognized.   
     
     
         9 . The endoscopic image processing device according to  claim 8 , wherein the processor is further configured to:
 cause a frame-shaped figure indicating a position of the region of interest to be superimposed and displayed on the endoscopic image as the region-of-interest information; and   cause the frame-shaped figure not to be superimposed and displayed on the endoscopic image in a case where the pigment observation is recognized.   
     
     
         10 . The endoscopic image processing device according to  claim 8 , wherein the processor is further configured to:
 acquire the plurality of endoscopic images;   detect the region of interest from the acquired endoscopic images; and   acquire the region-of-interest information about the detected region of interest.   
     
     
         11 . The endoscopic image processing device according to  claim 10 , wherein the processor is further configured to cause the display to sequentially display the plurality of acquired endoscopic images. 
     
     
         12 . The endoscopic image processing device according to  claim 8 , wherein the processor is further configured to cause a figure to be displayed on the endoscopic image based on the region-of-interest information. 
     
     
         13 . The endoscopic image processing device according to  claim 12 , wherein at least one of a color, a shape, or transparency of the figure at the first emphasis level is different from that at the second emphasis level. 
     
     
         14 . The endoscopic image processing device according to  claim 8 , wherein the region-of-interest information is displayed at a position different from the endoscopic image in the first emphasis display. 
     
     
         15 . The endoscopic image processing device according to  claim 8 , wherein the region-of-interest information is displayed at a position in the endoscopic image in the second emphasis display. 
     
     
         16 . The endoscopic image processing device according to  claim 8 , wherein the region-of-interest information is displayed at a position different from the endoscopic image in the second emphasis display. 
     
     
         17 . The endoscopic image processing device according to  claim 8 , further comprising an emphasis method storage configured to store an emphasis method for the region-of-interest information,
 wherein the processor is further configured to cause the region-of-interest information to be displayed by the emphasis method stored in the emphasis method storage.   
     
     
         18 . An endoscope system comprising:
 the endoscopic image processing device according to  claim 8 ;   the display;   an endoscope configured to be inserted into an object to be examined; and   a camera configured to sequentially pick up the plurality of endoscopic images of the portion to be observed included in the object to be examined.   
     
     
         19 . An endoscopic image processing method comprising:
 causing a display to display region-of-interest information about a region of interest included in a plurality of endoscopic images of a portion to be observed sequentially picked up by an endoscope operator and to be sequentially displayed on the display;   recognizing an action of the endoscope operator on the portion to be observed from at least one of the plurality of endoscopic images;   performing first emphasis display where the region-of-interest information is displayed at a position in the endoscopic image at a first emphasis level, according to a result of the recognition of the action of the endoscope operator;   recognizing whether or not a specific action is performed, wherein the specific action is at least one action of a use of a treatment tool, washing, length measurement, or pigment observation; and   performing the first emphasis display in a case where the specific action is not recognized, and cause the display not to display the region-of-interest information in a case where the specific action is recognized.   
     
     
         20 . An endoscopic image processing method comprising:
 causing a display to display region-of-interest information about a region of interest included in a plurality of endoscopic images of a portion to be observed sequentially picked up by an endoscope operator and to be sequentially displayed on the display;   recognizing an action of the endoscope operator on the portion to be observed from at least one of the plurality of endoscopic images;   switching between first emphasis display where the region-of-interest information is displayed at a position in the endoscopic image at a first emphasis level and second emphasis display where the region-of-interest information is displayed at a second emphasis level relatively lower than the first emphasis level, according to a result of the recognition of the action of the endoscope operator;   recognizing whether or not a specific action is performed, wherein the specific action is at least one action of a use of a treatment tool, washing, length measurement, or pigment observation; and   performing the first emphasis display in a case where the specific action is not recognized, and causing the display not to display the region-of-interest information in a case where the specific action is recognized.

Join the waitlist — get patent alerts

Track US2023181001A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.