Fraud detection apparatus and fraud detection system

Abstract

A storing unit stores area information indicating positions of a plurality of image areas set in a captured image of a front region of a self-checkout terminal including a scanner. A processing unit recognizes a product from the captured image. The processing unit detects a fraudulent action related to a scanning operation for causing the scanner to scan product information attached to the product, based on a movement path of the recognized product in the plurality of image areas, and a residence time of the product in a first image area that is closest to the scanner among the plurality of image areas.

What is claimed is: 
     
         1 . A non-transitory computer-readable recording medium storing therein a computer program that causes a computer to execute a process comprising:
 recognizing a product from a captured image of a front region of a self-checkout terminal including a scanner; and   detecting a fraudulent action related to a scanning operation for causing the scanner to scan product information attached to the product, based on a movement path of the product in a plurality of image areas set in the captured image, and a residence time of the product in a first image area that is closest to the scanner among the plurality of image areas.   
     
     
         2 . The non-transitory computer-readable recording medium according to  claim 1 , wherein:
 the plurality of image areas includes a second image area and a third image area that are disposed facing each other across the first image area, and   the detecting of the fraudulent action includes determining that the fraudulent action has occurred when the product moves from the second image area to the third image area via the first image area, and the residence time of the product in the first image area is shorter than a predetermined threshold.   
     
     
         3 . The non-transitory computer-readable recording medium according to  claim 2 , wherein:
 the captured image is an image of the front region of the self-checkout terminal taken from above.   
     
     
         4 . The non-transitory computer-readable recording medium according to  claim 1 , wherein:
 the detecting of the fraudulent action includes performing the detecting based on the movement path and the residence time each time a recognition from the captured image is made that a same person has held each of a plurality of individual products included in the product, and   the process further includes:   notifying that the fraudulent action has been detected when a number of times the fraudulent action is detected reaches a predetermined value.   
     
     
         5 . The non-transitory computer-readable recording medium according to  claim 1 , wherein the process further includes:
 determining, each time a recognition from the captured image is made that a same person has held each of a plurality of individual products included in the product, for the recognized product, whether a first condition based on the movement path and the residence time is satisfied, and whether a second condition based on the movement path is satisfied;   incrementing a first count value when the first condition is satisfied, and incrementing a second count value when the second condition is satisfied; and   notifying that the fraudulent action has been detected when a calculation result obtained by performing weighted addition of the first count value and the second count value using a predetermined weighting coefficient reaches a predetermined value.   
     
     
         6 . The non-transitory computer-readable recording medium according to  claim 5 , wherein:
 the first condition indicates that all of the plurality of image areas is passed through in a predetermined order and that the residence time in the first image area is shorter than a predetermined threshold, and   the second condition indicates that, without passing through the first image area, another predetermined image area among the plurality of image areas is passed through.   
     
     
         7 . The non-transitory computer-readable recording medium according to  claim 1 , wherein:
 the detecting of the fraudulent action includes detecting the fraudulent action based on the movement path, the residence time, and a characteristic of a shape of a movement trajectory of the product in the first image area.   
     
     
         8 . The non-transitory computer-readable recording medium according to  claim 7 , wherein:
 the detecting of the fraudulent action includes determining the characteristic of the shape of the movement trajectory based on an entry position of the product into the first image area, a closest position of the product to the scanner in the first image area, and an exit position of the product from the first image area.   
     
     
         9 . The non-transitory computer-readable recording medium according to  claim 1 , wherein:
 the detecting of the fraudulent action includes:
 detecting a first fraudulent action related to the scanning operation based on the movement path and the residence time, and 
 detecting a second fraudulent action related to the scanning operation based on a recognition result of the product in the captured image and on information regarding the product or the scanning operation of the product, the information being acquired from the self-checkout terminal, and 
   the process further includes:
 executing a notification process of fraudulent action detection in a different manner depending on whether the first fraudulent action or the second fraudulent action has been detected. 
   
     
     
         10 . The non-transitory computer-readable recording medium according to  claim 1 , wherein the process further includes:
 receiving, from the self-checkout terminal, a notification indicating that a checkout start operation has been performed on the self-checkout terminal to terminate the scanning operation and initiate checkout; and   executing a notification process of fraudulent action detection in a different manner depending on whether the fraudulent action has been detected before or after the checkout start operation has been performed.   
     
     
         11 . A fraud detection apparatus comprising:
 a memory configured to store area information indicating positions of a plurality of image areas set in a captured image of a front region of a self-checkout terminal including a scanner; and   a processor coupled to the memory and the processor configured to:
 recognize a product from the captured image, and 
 detect a fraudulent action related to a scanning operation for causing the scanner to scan product information attached to the product, based on a movement path of the product in the plurality of image areas, and a residence time of the product in a first image area that is closest to the scanner among the plurality of image areas. 
   
     
     
         12 . A fraud detection system comprising:
 a camera configured to capture an image of a front region of a self-checkout terminal including a scanner; and   a fraud detection apparatus configured to:
 recognize a product from the captured image, and 
 detect a fraudulent action related to a scanning operation for causing the scanner to scan product information attached to the product, based on a movement path of the product in a plurality of image areas set in the captured image, and a residence time of the product in a first image area that is closest to the scanner among the plurality of image areas.