Article reading device

Abstract

An article reading device according to an embodiment includes a display device and an image capturing device that generates an image of an article. A processor extracts, from the image, first feature data for recognizing the article and second feature data for determining whether to recognize the article based on the first feature data. The processor determines whether to recognize the article. If it is determined to recognize the article, the processor recognizes the article based on the extracted first feature data, and controls the display device to display a recognition result. If it is determined to not recognize the article, extract a barcode from the image, the processor identifies the article based on the extracted barcode, and control the display device to display an identification result. The processor performs a transaction settlement with respect to the recognition result, if any, and the identification result, if any.

What is claimed is: 
     
         1 . An article reading device comprising:
 a display device;   an image capturing device configured to generate an image of an article; and   a processor configured to:
 receive the generated image of the article, 
 extract, from the image, first feature data for recognizing the article and second feature data for determining whether to recognize the article based on the first feature data, 
 determine, based on the extracted second feature data, whether to recognize the article, 
 if it is determined to recognize the article, recognize the article based on the extracted first feature data, and control the display device to display a recognition result corresponding to the recognized article, 
 if it is determined to not recognize the article, extract a barcode from the image, identify the article based on the extracted barcode, and control the display device to display an identification result corresponding to the identified article, and 
 perform a transaction settlement with respect to the recognition result, if any, and the identification result, if any. 
   
     
     
         2 . The device according to  claim 1 , wherein the processor determines whether to recognize the article by transmitting the extracted second feature data to a POS terminal, and receiving, from the POS terminal, information indicating whether the article is a candidate for object recognition. 
     
     
         3 . The device according to  claim 1 , wherein the processor recognizes the article by transmitting the extracted first feature data to a POS terminal, and receiving, from the POS terminal, at least one candidate article. 
     
     
         4 . The device according to  claim 3 , wherein the recognition result includes an image of each of a plurality of candidate articles. 
     
     
         5 . The device according to  claim 4 , wherein
 the processor is configured to receive a selection of one of the plurality of candidate articles, and   the transaction settlement is performed with respect to the selection.   
     
     
         6 . The device according to  claim 1 , wherein
 the processor is further configured to determine whether an article is positioned within an image capturing area of the image capturing device, and   the processor receives the generated image when the article is determined to be positioned within the image capturing area.   
     
     
         7 . The device according to  claim 1 , wherein the processor performs the transaction settlement by transmitting the recognition result, if any, and the identification result, if any, to a POS terminal. 
     
     
         8 . An article reading device comprising:
 a display device;   an image capturing device configured to generate an image of an article; and   a processor configured to:
 receive the generated image of the article, 
 determine whether the image includes a barcode, 
 if it is determined that the image includes the barcode, identify the article based on the barcode, and control the display device to display an identification result corresponding to the identified article, and 
 if it is determined that the image does not include the barcode, extract feature data of the article, recognize the article based on the extracted feature data, and control the display device to display a recognition result corresponding to the recognized article, and 
 perform a transaction settlement with respect to the recognition result, if any, and the identification result, if any. 
   
     
     
         9 . The device according to  claim 8 , wherein the processor recognizes the article by transmitting the extracted first feature data to a POS terminal, and receiving, from the POS terminal, at least one candidate article. 
     
     
         10 . The device according to  claim 9 , wherein the recognition result includes an image of each of a plurality of candidate articles. 
     
     
         11 . The device according to  claim 10 , wherein
 the processor is configured to receive a selection of one of the plurality of candidate articles, and   the transaction settlement is performed with respect to the selection.   
     
     
         12 . The device according to  claim 8 , wherein
 the processor is further configured to determine whether an article is positioned within an image capturing area of the image capturing device, and   the processor receives the generated image when the article is determined to be positioned within the image capturing area.   
     
     
         13 . The device according to  claim 8 , wherein the processor performs the transaction settlement by transmitting the recognition result, if any, and the identification result, if any, to a POS terminal. 
     
     
         14 . A non-transitory computer readable medium containing a program that causes article reading device including a display device, an image capturing device, and a processor to perform an article reading method comprising the steps of:
 generating, with the image capturing device, an image of an article;   extracting, from the image, first feature data for recognizing the article and second feature data for determining whether to recognize the article based on the first feature data;   determining, based on the extracted second feature data, whether to recognize the article;   if it is determined to recognize the article, recognizing the article based on the extracted first feature data, and controlling the display device to display a recognition result corresponding to the recognized article;   if it is determined to not recognize the article, extract a barcode from the image, identifying the article based on the extracted barcode, and controlling the display device to display an identification result corresponding to the identified article; and   performing a transaction settlement with respect to the recognition result, if any, and the identification result, if any.   
     
     
         15 . The non-transitory computer readable medium according to  claim 14 , wherein whether to recognize the article is determined by transmitting the extracted second feature data to a POS terminal, and receiving, from the POS terminal, information indicating whether the article is a candidate for object recognition. 
     
     
         16 . The non-transitory computer readable medium according to  claim 14 , wherein the article is recognized by transmitting the extracted first feature data to a POS terminal, and receiving, from the POS terminal, at least one candidate article. 
     
     
         17 . The non-transitory computer readable medium according to  claim 16 , wherein the recognition result includes an image of each of a plurality of candidate articles. 
     
     
         18 . The non-transitory computer readable medium according to  claim 17 , the method further comprising:
 receiving a selection of one of the plurality of candidate articles, wherein the transaction settlement is performed with respect to the selection.   
     
     
         19 . The non-transitory computer readable medium according to  claim 14 , the method further comprising:
 determining whether an article is positioned within an image capturing area of the image capturing device, and   the image is generated when the article is determined to be positioned within the image capturing area.   
     
     
         20 . The non-transitory computer readable medium according to  claim 14 , wherein the transaction settlement is performed by transmitting the recognition result, if any, and the identification result, if any, to a POS terminal.