Device and method for forming at least one ground truth database for an object recognition system

Abstract

Described herein are a device and a method for forming at least one ground truth database for an object recognition system and for keeping the at least one ground truth database current. The device comprises includes at least the following components: a data storage unit configured to store color space positions and/or reflectance spectra and/or luminescence spectra of different objects; and a processor programmed for communication with the data storage unit and with the object recognition system.

1 . A device for forming at least one ground truth database for an object recognition system and for keeping the at least one ground truth database current, the device comprising at least the following components:
 a) a data storage unit configured to store color space positions and/or reflectance spectra and/or luminescence spectra of different objects; and   b) a processor programmed for communication with the data storage unit and with the object recognition system, the processor programmed for:
 receiving, via a communication interface, measured color space positions and/or reflectance spectra and/or luminescence spectra of different objects, 
 assigning each color space position and/or reflectance spectrum and/or luminescence spectrum to one of the different objects as a tag, 
 storing the color space positions and/or reflectance spectra and/or luminescence spectra together with the respective different objects the color space positions and/or reflectance spectra and/or luminescence spectra are assigned to, respectively, in the data storage unit, thus forming the at least one ground truth database, 
 monitoring, by using at least one sensor and/or artificial intelligence tools, a scene including at least some of the different objects for the occurrence of a triggering and/or recognition event, 
 updating and/or supplementing dynamically in at least one of the at least one database the color space positions and/or the reflectance spectra and/or luminescence spectra stored in the respective at least one database in the case the triggering and/or recognition event occurs, and 
 providing immediate access to the up-to-date color space positions and/or reflectance spectra and/or luminescence spectra. 
   
     
     
         2 . The device according to  claim 1 , further comprising the processor programmed for providing as the at least one ground truth database a master database and a local database, the local database being in conjunction with the master database and the color space positions and/or the reflectance spectra and/or luminescence spectra stored in the local database are updated and/or supplemented over time by receiving from the object recognition system re-measured respective color space positions and/or reflectance spectra and/or luminescence spectra for at least some of the different objects in the scene and, thus, small and continuous changes of the respective objects are at least tracked in the local database. 
     
     
         3 . The device according to  claim 2 , wherein the local database is stored locally in the scene or on a cloud server, the local database being only accessible for the object recognition system which is locally used in the scene. 
     
     
         4 . The device according to  claim 1 , further comprising the processor programmed for tracking small and continuous changes of the different objects by monitoring changes in fluorescence emission magnitude and/or fluorescence emission spectral shapes of the respective objects. 
     
     
         5 . The device according to  claim 2 , further comprising the processor programmed for supplementing the local database by a color space position and/or a reflectance spectrum and/or luminescence spectrum of an object by using the master database when the object is new in the scene and the new object's color space position and/or reflective and luminescence spectrum measured by the locally used object recognition system can be matched to a color space position and/or a reflectance spectrum and/or luminescence spectrum of an object stored in the master database. 
     
     
         6 . The device according to  claim 2 , further comprising the processor programmed for synchronizing the master database and the local database regarding the different objects in the scene. 
     
     
         7 . The device according to  claim 2 , wherein the master database comprises for each of the different objects color space position and/or reflectance spectrum and/or luminescence spectrum of the original object and color space position and/or reflectance spectrum and/or luminescence spectrum of at least one degraded/aged object descending from the original object. 
     
     
         8 . A computer-implemented method for forming at least one ground truth database for an object recognition system and for keeping the at least one ground truth database current, the method comprising at least the following steps:
 providing, via a communication interface, color space positions and/or reflectance spectra and/or luminescence spectra of different objects,   assigning, by a processor, each color space position and/or reflectance spectrum and/or luminescence spectrum to one of the different objects as a tag,   storing the color space positions and/or reflectance spectra and/or luminescence spectra together with the respective different objects the color space positions and/or reflectance spectra and/or luminescence spectra are assigned to, respectively, in a data storage, thus forming the at least one ground truth database,   monitoring, by using at least one sensor and/or artificial intelligence tools, a scene including at least some of the different objects for the occurrence of a triggering and/or recognition event,   updating and/or supplementing dynamically in at least one of the at least one database the color space positions and/or the reflectance spectra and/or luminescence spectra stored in the at least one database in the case the triggering and/or recognition event occurs, and   providing immediate access to the up-to-date color positions and/or reflectance spectra and/or luminescence spectra.   
     
     
         9 . The method according to  claim 8 , further comprising providing a master database and a local database, the local database being in conjunction with the master database and the color space positions and/or the reflectance spectra and/or luminescence spectra stored in the local database are updated and/or supplemented over time by re-measuring by the object recognition system the respective color space positions and/or reflectance spectra and/or luminescence spectra for the different objects and, thus, small and continuous changes of the respective objects are at least tracked in the local database. 
     
     
         10 . The method according to  claim 9 , wherein the local database is stored locally in the scene or on a cloud server, the local database being only accessible for the object recognition system which is locally used in the scene. 
     
     
         11 . The method according to  claim 8 , wherein small and continuous changes of the different objects are tracked by monitoring changes in fluorescence emission magnitude and/or fluorescence emission spectral shapes of the respective objects. 
     
     
         12 . The method according to  claim 9 , wherein the local database is supplemented by a color space position and/or a reflectance spectrum and/or luminescence spectrum of an object by using the master database when the object is new in the scene and the new object's color space position and/or reflectance spectrum and/or luminescence spectrum measured by the locally used object recognition system can be matched to a color space position and/or a reflectance spectrum and/or luminescence spectrum of an object stored in the master database. 
     
     
         13 . The method according to  claim 9 , wherein the master database and the local database are synchronized regarding the different objects in the scene when at least one of a number of predefined events occurs. 
     
     
         14 . The method according to  claim 13 , wherein the master database comprises for each of the different objects a color space position and/or a reflectance spectrum and/or luminescence spectrum of the original object and a color space position and/or a reflectance spectrum and/or luminescence spectrum of at least one degraded/aged object descending from the original object. 
     
     
         15 . A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause a machine to:
 receive, via a communication interface, color space positions and/or reflectance spectra and/or luminescence spectra of different objects,   assign each color space position and/or reflectance spectrum and/or luminescence spectrum to one of the different objects as a tag,   store the color space positions and/or reflectance spectra and/or luminescence spectra together with the respective different objects the color space positions and/or reflectance spectra and/or luminescence spectra are assigned to, respectively, in a data storage, thus forming at least one ground truth database,   monitor, using at least one sensor and/or artificial intelligence tools, a scene which includes at least some of the different objects for the occurrence of a triggering and/or recognition event,   update and/or supplement dynamically in at least one of the at least one database the color space positions and/or the reflectance spectra and/or luminescence spectra stored in the at least one database in the case the triggering and/or recognition event occurs, and   provide immediate access to the up-to-date color positions and/or reflectance spectra and/or luminescence spectra.