Camera Enhanced Off-Platter Detection System

Abstract

An example object recognition and weighing apparatus for use with a POS terminal includes a weigh platter; a scale configured to measure a weight of the item when placed on the weigh platter; an off-platter detection assembly configured to detect an off-platter condition; an object recognition assembly configured to capture image data associated with the item, and based on the image data that includes non-barcode data, identify the item; a communication interface configured to communicate with the POS terminal; a processor in communication with the scale, the off-platter detection assembly, and the communication interface; and a non-transitory machine-readable storage medium storing instructions that, when executed by the processor, cause the object recognition and weighing apparatus to, responsive to detecting the off-platter condition, prevent a transmission of the identified item to the POS terminal until the off-platter condition is no longer detected.

1 . An object recognition and weighing apparatus for use with a point of sale (POS) terminal that is operable to execute a transaction associated with a purchase of an item, the object recognition and weighing apparatus comprising:
 a weigh platter having a first surface extending in a first transverse plane;   a scale configured to measure a weight of the item when placed on the surface;   an off-platter detection assembly configured to detect an off-platter condition;   an object recognition assembly configured to capture image data associated with the item when placed on the surface and, based on the image data that includes non-barcode data, identify the item as an identified item set, the identified item set including one or more items selected from a preexisting item database where the one or more items are selected based satisfying a predetermined similarity threshold relative to the item;   a communication interface configured to communicate with the POS terminal;   a processor in communication with the scale, the off-platter detection assembly, and the communication interface; and   a non-transitory machine-readable storage medium storing instructions that, when executed by the processor, cause the object recognition and weighing apparatus to, responsive to detecting the off-platter condition, prevent a transmission of the identified item set to the POS terminal until the off-platter condition is no longer detected,   wherein the off-platter detection assembly is configured to detect the off-platter condition based on at least one of (i) a portion of the item resting on a second surface off the weigh platter resulting or (ii) at least some portion of the item extending beyond a perimeter of the weigh platter.   
     
     
         2 . The object recognition and weighing apparatus of  claim 1 , wherein the POS terminal is configured to calculate a price for each item based on the identified item set and based on the most recent weight measured by the scale at the time of transmission of the identified item set. 
     
     
         3 . The object recognition and weighing apparatus of  claim 1 , further comprising a camera configured to capture an image or video of a user, responsive to the off-platter detection assembly detecting an off-platter condition. 
     
     
         4 . The object recognition and weighing apparatus of  claim 1 , wherein the instructions, when executed by the processor, further cause the object recognition and weighing apparatus to provide a message to a user indicating that the user must resolve the off-platter condition in order to proceed, via one or more of a user interface, a voice instruction over a speaker, an error beep, or an LED flash, responsive to the off-platter detection assembly detecting an off-platter condition. 
     
     
         5 . The object recognition and weighing apparatus of  claim 4 , wherein the instructions, when executed by the processor, further cause the object recognition and weighing apparatus to analyze the image data associated with the item to determine a location or direction associated with the off-platter condition; and wherein the message to the user includes an indication of the determined location or direction. 
     
     
         6 . The object recognition and weighing apparatus of  claim 5 , wherein the instructions, when executed by the processor, further cause the object recognition and weighing apparatus to analyze the image data associated with the item after providing the message to the user, to determine whether the user has attempted to resolve the off-platter condition. 
     
     
         7 . The object recognition and weighing apparatus of  claim 6 , wherein analyzing the image data to determine whether the user has attempted to resolve the off-platter condition includes determining one or more of: whether the item is moved or whether a hand of the user moved in the vicinity of the determined location or direction. 
     
     
         8 . An object recognition and weighing apparatus for use with a point of sale (POS) terminal that is operable to execute a transaction associated with a purchase of an item, the object recognition and weighing apparatus comprising:
 a weigh platter having a first surface extending in a first transverse plane;   a scale configured to measure a weight of the item when placed on the surface;   an object classification identification system configured to detect the item as a high-priority item;   an off-platter detection assembly configured to detect an off-platter condition;   an object recognition assembly configured to capture image data associated with the item when placed on the surface and, based on the image data that includes non-barcode data, identify the item as an identified item set, the identified item set including one or more items selected from a preexisting item database where the one or more items are selected based satisfying a predetermined similarity threshold relative to the item;   a communication interface configured to communicate with the POS terminal;   a processor in communication with the scale, the off-platter detection assembly, and the communication interface; and   a non-transitory machine-readable storage medium storing instructions that, when executed by the processor, cause the object recognition and weighing apparatus to:
 responsive to (i) detecting the item being the high-priority item and (ii) detecting the off-platter condition, prevent a transmission of the identified item set to the POS terminal until the off-platter condition is no longer detected, 
   wherein the off-platter detection assembly is configured to detect the off-platter condition based on at least one of (i) a portion of the item resting on a second surface off the weigh platter resulting or (ii) at least some portion of the item extending beyond a perimeter of the weigh platter.   
     
     
         9 . The object recognition and weighing apparatus of  claim 8 , wherein the POS terminal is configured to calculate a price for each item based on the identified item set and based on the most recent weight measured by the scale at the time of transmission of the identified item set. 
     
     
         10 . The object recognition and weighing apparatus of  claim 8 , wherein the item being the high-priority item is based on one or more of: a total price associated with the item, a price per unit weight associated with the item, a high theft potential associated with the item, or whether the item is a controlled item. 
     
     
         11 . The object recognition and weighing apparatus of  claim 10 , wherein a high theft potential associated with the item is based on one or more of: frequent observations of ticket switching associated with the item, or frequent observations of scan avoidance associated with the item. 
     
     
         12 . The object recognition and weighing apparatus of  claim 8 , wherein the item being the high-priority item is based on the higher priority level of the priority levels associated with each of the items of the identified item set. 
     
     
         13 . The object recognition and weighing apparatus of  claim 8 , further comprising a camera configured to capture an image or video of a user, responsive to the off-platter detection assembly detecting an off-platter condition. 
     
     
         14 . The object recognition and weighing apparatus of  claim 8 , wherein the instructions, when executed by the processor, further cause the object recognition and weighing apparatus to provide a message to a user indicating that the user must resolve the off-platter condition in order to proceed, via one or more of a user interface, a voice instruction over a speaker, an error beep, or an LED flash, responsive to the off-platter detection assembly detecting an off-platter condition. 
     
     
         15 . The object recognition and weighing apparatus of  claim 14 , wherein the instructions, when executed by the processor, further cause the object recognition and weighing apparatus to analyze the image data associated with the item to determine a location or direction associated with the off-platter condition; and wherein the message to the user includes an indication of the determined location or direction. 
     
     
         16 . The object recognition and weighing apparatus of  claim 15 , wherein the instructions, when executed by the processor, further cause the object recognition and weighing apparatus to analyze the image data associated with the item after providing the message to the user, to determine whether the user has attempted to resolve the off-platter condition. 
     
     
         17 . The object recognition and weighing apparatus of  claim 16 , wherein analyzing the image data to determine whether the user has attempted to resolve the off-platter condition includes determining one or more of: whether the item is moved or whether a hand of the user moved in the vicinity of the determined location or direction.