Processing apparatus, and processing method

Abstract

This invention provides a processing apparatus ( 10 ) including a container identification score computation unit ( 11 ) that computes an identification score of a container for a product, based on an image to be processed containing the product, a product identification score computation unit ( 12 ) that computes an identification score of the product, based on the image to be processed, and a first identification unit ( 13 ) that decides identification information of the product, based on the computed identification score of the container and the computed identification score of the product.

1 . A processing apparatus comprising:
 at least one memory configured to store one or more instructions; and   at least one processor configured to execute the one or more instructions to:     5  acquire an image of a product in a container;   compute an identification score of a container for a product, based on at least one of color and pattern of the container detected from the image;   compute an identification score of the product, based on the image; and   decide identification information of the product, based on the computed identification  10  score of the container and the computed identification score of the product.   
     
     
         2 . The processing apparatus according to  claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to decide identification information of the product, from a group of products similar  15  in appearance to each other, and wherein the products are contained in containers different from each other. 
     
     
         3 . The processing apparatus according to  claim 1 , wherein the identification score of the container for the product is value representing a  2   0  degree of similarity between the container and each of a plurality of containers registered in advance, and wherein the identification score of the product is value representing the degree of similarity between the product and each of a plurality of products registered in advance.  2   5   4 . The processing apparatus according to  claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to:
 decide, as the identification information of the product, an identification of a product which is included in candidates for the identification information of a first product having the  3   0  identification score of the product equal to or higher than a first reference value, and is associated with candidates for identification information of a first container having the identification score of the container equal to or higher than a second reference value. 
 
     
     
         5 . The processing apparatus according to  claim 1 ,  35  wherein the at least one processor is further configured to execute the one or more instructions to:
 decide candidates for the identification information of the product, based on the identification score of the container, and compute the identification score of each of the decided candidates for the identification  5  information of the product. 
 
     
     
         6 . The processing apparatus according to  claim 1 , wherein the at least one processor is further configured to execute the one or more instructions to:
   10  compute a degree of similarity between a container image being associated with the identification information of the product and a container image that does not associate with the identification information of the product, based on the container image being associated with the identification information and the container image that does not associate with the identification information; and     15  suggest a container for a product that does not associate with the identification information of the product, based on the degree of similarity.   
     
     
         7 . The processing apparatus according to  claim 1 , wherein the product is food or drink, and  2   0  wherein the container is a dish or a tray. 
     
     
         8 . A processing method executed by a computer, the processing method comprising:
 acquiring an image of a product in a container;   computing an identification score of a container for a product, based on at least one of  2   5  color and pattern of the container detected from the image;   computing an identification score of the product, based on the image; and   deciding identification information of the product, based on the computed identification score of the container and the computed identification score of the product.  3   0   9 . The processing method according to  claim 8 , wherein the computer decides identification information of the product, from a group of products similar in appearance to each other, and wherein the products are contained in containers different from each other.  3   5   10 . The processing method according to  claim 8 , wherein the identification score of the container for the product is value representing a degree of similarity between the container and each of a plurality of containers registered in advance, and wherein the identification score of the product is value representing the degree of  5  similarity between the product and each of a plurality of products registered in advance.   
     
     
         11 . The processing method according to  claim 8 , wherein the computer decides, as the identification information of the product, an identification of a product which is included in candidates for the identification information of a  10  first product having the identification score of the product equal to or higher than a first reference value, and is associated with candidates for identification information of a first container having the identification score of the container equal to or higher than a second reference value.  15   12 . The processing method according to  claim 8 , wherein computer:
 decides candidates for the identification information of the product, based on the identification score of the container, and computes the identification score of each of the decided candidates for the identification  2   0  information of the product. 
 
     
     
         13 . The processing method according to  claim 8 , wherein the computer:
 computes a degree of similarity between a container image being associated with the  2   5  identification information of the product and a container image that does not associate with the identification information of the product, based on the container image being associated with the identification information and the container image that does not associate with the identification information; and   suggests a container for a product that does not associate with the identification  3   0  information of the product, based on the degree of similarity.   
     
     
         14 . The processing method according to  claim 8 , wherein the product is food or drink, and wherein the container is a dish or a tray.  35   
     
     
         15 . A non-transitory storage medium storing a program for causing a computer to:
 acquire an image of a product in a container;   compute an identification score of a container for a product, based on at least one of color and pattern of the container detected from the image;     5  compute an identification score of the product, based on the image; and   decide identification information of the product, based on the computed identification score of the container and the computed identification score of the product.   
     
     
         16 . The non-transitory storage medium according to  claim 15 ,  10  wherein the program causes the computer to decide identification information of the product, from a group of products similar in appearance to each other, and wherein the products are contained in containers different from each other. 
     
     
         17 . The non-transitory storage medium according to  claim 15 ,  15  wherein the identification score of the container for the product is value representing a degree of similarity between the container and each of a plurality of containers registered in advance, and wherein the identification score of the product is value representing the degree of similarity between the product and each of a plurality of products registered in advance.  20   
     
     
         18 . The non-transitory storage medium according to  claim 15 , wherein the program causes the computer to decide, as the identification information of the product, an identification of a product which is included in candidates for the identification information of a first product having the identification score of the product equal to  2   5  or higher than a first reference value, and is associated with candidates for identification information of a first container having the identification score of the container equal to or higher than a second reference value. 
     
     
         19 . The non-transitory storage medium according to  claim 15 ,  3   0  wherein the program causes the computer to:
 decide candidates for the identification information of the product, based on the identification score of the container, and compute the identification score of each of the decided candidates for the identification information of the product.  35   
 
     
     
         20 . The non-transitory storage medium according to  claim 15 , wherein the program causes the computer to:
 compute a degree of similarity between a container image being associated with the identification information of the product and a container image that does not associate with the  5  identification information of the product, based on the container image being associated with the identification information and the container image that does not associate with the identification information; and   suggest a container for a product that does not associate with the identification information of the product, based on the degree of similarity.  10