High speed actuator-based item registration system

Abstract

A system comprising circuitry configured to perform a vision-based registration task, the circuitry being coupled with an event-based vision sensor and being configured to be adaptive to inference quality derived from output of the event-based vision sensor and/or to be adaptive to consistency of a task output of the vision-based registration task.

1 . A system comprising circuitry configured to perform a vision-based registration task, the circuitry being coupled with an event-based vision sensor and being configured to be adaptive to inference quality derived from output of the event-based vision sensor and/or to be adaptive to consistency of a task output of the vision-based registration task. 
     
     
         2 . The system of  claim 1 , wherein the circuitry is configured to find the state in which the system performs the vision-based registration task optimally. 
     
     
         3 . The system of  claim 1 , wherein the circuitry is configured to determine a quality metric from the output of the event-based vision sensor, the quality metric being used in a feedback loop to control an actuator and thus affect the quality of what is being sensed by the event-based vision sensor. 
     
     
         4 . The system of  claim 1 , wherein the system itself or an object can be moved in its relative position to the system by an actuator which gets control input based on the inference quality derived from output of the event-based vision sensor and/or the consistency of the task output. 
     
     
         5 . The system of  claim 1 , wherein the actuator-based optical registration system comprises an EVS-based sensing subsystem which comprises the event-based vision sensor. 
     
     
         6 . The system of  claim 1 , wherein the system is moved by an actuator, or an object is moved in its relative position to the system by an actuator, the actuator getting control input based on the inference quality derived from output of the event-based vision sensor and/or the consistency of the task output. 
     
     
         7 . The system of  claim 1 , comprising an EVS-based sensing subsystem which comprises the event-based vision sensor, and wherein the EVS-based sensor subsystem uses events measured by EVS sensor to reconstruct item tags and/or navigational cues. 
     
     
         8 . The system of  claim 1 , comprising an EVS-based sensing subsystem which comprises the event-based vision sensor, and wherein the EVS-based sensor subsystem is configured to output an inference quality metric. 
     
     
         9 . The system of  claim 1 , comprising a conveyor belt which is coupled to an EVS-based sensing subsystem, the movement of the conveyor belt being adaptive to inference quality derived from output of the event-based vision sensor and/or to consistency of a task output. 
     
     
         10 . The system of  claim 1 , wherein an EVS-based sensing subsystem is implemented onboard a scanning drone or robot, the movement of the scanning drone or robot being adaptive to inference quality derived from output of the event-based vision sensor and/or to consistency of a task output. 
     
     
         11 . The system of  claim 1 , wherein the item tags are selected from barcodes, QR codes and April tags and wherein the vision-based registration task comprises a process of tag detection. 
     
     
         12 . The system of  claim 1 , wherein the circuitry is configured to transform an event representation of events obtained from the event-based vision sensor. 
     
     
         13 . The system of  claim 1 , wherein the circuitry is configured to perform image reconstruction based on an event stream obtained by the event-based vision sensor. 
     
     
         14 . The system of  claim 1 , wherein the circuitry is configured to perform a specified task on reconstructed images to obtain a task output. 
     
     
         15 . The system of  claim 1 , wherein the circuitry is configured to perform inference of image quality is performed based on reconstructed images to obtain an image quality metric. 
     
     
         16 . The system of  claim 1 , wherein the circuitry is configured to perform a consistency check on the task output to obtain a consistence metric. 
     
     
         17 . The system of  claim 1 , wherein the circuitry is configured to perform a control loop based on an image quality metric and/or a consistence metric. 
     
     
         18 . The system of  claim 1 , wherein the circuitry is configured to deduce the possibility of the current frame containing an image tag, and/or the circuitry is configured to localize a tag. 
     
     
         19 . An EVS-based sensing subsystem comprising circuitry configured to perform a vision-based registration task, the subsystem comprising an event-based vision sensor and circuitry configured to output an inference quality metric to a processor of a vision-based registration task system. 
     
     
         20 . A computer-implemented method for performing a vision-based registration task, the method comprising acquiring output of an event-based vision sensor and adapting a vision-based registration task system to inference quality derived from the output of the event-based vision sensor and/or to a task output of the vision-based registration task performed by the vision-based registration task system. 
     
     
         21 . A program comprising instructions, the instructions being configured to, when operated by a processor, perform the method of  claim 20 .