Method and system for facilitating tray management

Abstract

The present disclosure relates to a method and system for facilitating tray management by determining at least one missing tool from the plurality of tools placed in tray. The tray management system (TMS) is connected to a weighing system to measure combined weight of tools before and after usage of tools. The combined weight of the tools is measured after at least one tool is removed for usage from the tray or placed back in the tray and a weight discrepancy is determined dynamically. Using the weight discrepancy, image sensor captures plurality of video segments. The TMS identifies occurrences of removing at least one tool from the tray and the corresponding occurrence of placing the tool in the tray in video segments and determines missing tool in the tray. The TMS alerts the user about the missing of tools in real time and enables effective tray management.

1 - 21 . (canceled) 
     
     
         22 . A method comprising:
 receiving, by a processor of a tray management system, at least a first data and a second data associated with a plurality of tools placed in a tray, wherein the first data is obtained before usage of the plurality of tools and the second data is obtained after usage of the plurality of tools;   determining, by the processor, a weight discrepancy of the plurality of tools upon receiving the second data, wherein the weight discrepancy is computed as a difference of the first data and the second data;   obtaining, by the processor, a plurality of video segments captured by at least one image sensor, wherein each of the plurality of video segments is captured when the weight discrepancy is determined to be above a threshold;   identifying, by the processor, at least one missing tool using the plurality of video segments; and   displaying an alert about the at least one missing tool, the alert comprising an image of the at least one missing tool.   
     
     
         23 . The method of  claim 22 , wherein the capturing of each video segment is continued until the weight discrepancy is determined to be below the threshold. 
     
     
         24 . The method of  claim 22 , wherein the alert comprises a time corresponding to an occurrence of removing the at least one missing tool from the tray. 
     
     
         25 . The method of  claim 22 , further comprising:
 receiving an input from a user of the plurality of tools in response to the alert; and   generating a recommendation to track the at least one missing tool based on the user input.   
     
     
         26 . The method of  claim 25 , further comprising updating a user profile of the user with time stamp details of the usage of each of the plurality of tools, the image of the at least one missing tool, the user input received in response to the alert, and the recommendation generated based on the user input. 
     
     
         27 . The method of  claim 22 , wherein the first data is a combined weight of the plurality of tools measured before usage of the plurality of tools and upon verifying a user of the plurality of tools, and the second data is a combined weight of the plurality of tools measured after at least one tool is removed for usage from the tray or placed back in the tray. 
     
     
         28 . The method of  claim 27 , wherein verifying the user of the plurality of tools comprises steps of:
 receiving an image of the user captured by the at least one image sensor;   determining access to the plurality of tools by the user based on the user image and a user profile corresponding to the user; and   verifying the user as an authorized user to access the plurality of tools based on a successful determination of access to the plurality of tools.   
     
     
         29 . The method of  claim 22 , wherein the capturing of each video segment is continued until a length of the current video segment exceeds a maximum threshold time period. 
     
     
         30 . The method of  claim 22 , wherein identifying the at least one missing tool comprises steps of:
 detecting at least one tool available in each video segment of the plurality of tools;   identifying one or more occurrences of removing the at least one tool from the tray in each video segment;   determining a successive occurrence of placing the at least one tool in the tray for each previous occurrence of removing the at least one tool in one of current and subsequent plurality of video segments; and   identifying the at least one missing tool in absence of the determination of successive occurrence of placing the tool in the tray in one of the current and subsequent plurality of video segments.   
     
     
         31 . The method of  claim 22 , wherein the plurality of tools are surgical tools for medical surgery, and the at least one image sensor captures the plurality of video segments during a surgical procedure. 
     
     
         32 . The method of  claim 22 , wherein the at least one missing tool is identified by detecting the plurality of tools available in each video segment using feature extraction of the plurality of tools. 
     
     
         33 . The method of  claim 22 , wherein the feature extraction comprises using pixel comparison to determine the outline of a tool. 
     
     
         34 . A tray management system comprising:
 a processor;   a memory communicatively coupled with the processor, wherein the memory stores processor-executable instructions, which on execution cause the processor to:   receive at least a first data and a second data associated with a plurality of tools placed in a tray, wherein the first data is obtained before usage of the plurality of tools and the second data is obtained after usage of the plurality of tools;   determine a weight discrepancy of the plurality of tools upon receiving the second data, wherein the weight discrepancy is computed as a difference of the first data and the second data;   obtain a plurality of video segments captured by at least one image sensor, wherein each of the plurality of video segments is captured when the weight discrepancy is determined to be above a threshold;   identify at least one missing tool using the plurality of video segments; and   display an alert about the at least one missing tool, the alert comprising an image of the at least one missing tool.   
     
     
         35 . The system of  claim 34 , wherein the processor receives the first data and the second data from a weighing system communicatively coupled with the processor, the first data is a combined weight of the plurality of tools measured before usage of the plurality of tools and upon verifying a user of the plurality of tools, and the second data is a combined weight of the plurality of tools measured after at least one tool is removed for usage from the tray or placed back in the tray. 
     
     
         36 . The system of  claim 34 , wherein the processor is configured to identify the at least one missing tool by performing steps of:
 detecting at least one tool available in each video segment of the plurality of tools;   identifying one or more occurrences of removing the at least one tool from the tray in each video segment;   determining a successive occurrence of placing the at least one tool in the tray for each previous occurrence of removing the at least one tool in one of current and subsequent plurality of video segments; and   identifying the at least one missing tool in absence of the determination of successive occurrence of placing the tool in the tray in one of the current and subsequent plurality of video segments.   
     
     
         37 . The system of  claim 34 , wherein the processor is further configured to update a user profile of a user with time stamp details of the usage of each of the plurality of tools, the image of the at least one missing tool, a user input received in response to the alert, and a recommendation based on the user input. 
     
     
         38 . A non-transitory computer readable medium including instructions stored thereon that when processed by at least one processor cause a tray management system to perform acts of:
 receiving at least a first data and a second data associated with a plurality of tools placed in a tray, wherein the first data is obtained before usage of the plurality of tools and the second data is obtained after usage of the plurality of tools;   determining a weight discrepancy of the plurality of tools upon receiving the second data, wherein the weight discrepancy is computed as a difference of the first data and the second data;   obtaining a plurality of video segments captured by at least one image sensor, wherein each of the plurality of video segments is captured when the weight discrepancy is determined to be above a threshold;   identifying at least one missing tool using the plurality of video segments; and   displaying an alert about the at least one missing tool, the alert comprising an image of the at least one missing tool.   
     
     
         39 . The medium of  claim 38 , wherein the at least one processor receives the first data and the second data from a weighing system communicatively coupled with the at least one processor, the first data is a combined weight of the plurality of tools measured before usage of the plurality of tools and upon verifying a user of the plurality of tools, and the second data is a combined weight of the plurality of tools measured after at least one tool is removed for usage from the tray or placed back in the tray. 
     
     
         40 . The medium of  claim 38 , wherein the instructions stored thereon further causes the at least one processor to identify the at least one missing tool by performing steps of:
 detecting at least one tool available in each video segment of the plurality of tools;   identifying one or more occurrences of removing the at least one tool from the tray in each video segment;   determining a successive occurrence of placing the at least one tool in the tray for each previous occurrence of removing the at least one tool in one of current and subsequent plurality of video segments; and   identifying the at least one missing tool in absence of the determination of successive occurrence of placing the tool in the tray in one of the current and subsequent plurality of video segments.   
     
     
         41 . The medium of  claim 38 , wherein the instructions stored thereon further causes the at least one processor to update a user profile of a user with time stamp details of the usage of each of the plurality of tools, an image of the at least one missing tool, a user input received in response to the alert, and a recommendation generated based on the user input.