Storefront device, storefront management method, and program

Abstract

First position information indicating positions of approaching people nearing merchandise is acquired. Second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people, is detected. A movement action performed on the merchandise is detected. An ID of a person corresponding to the subject person who performed the detected movement action is specified based on a positional relationship between the first position information and the second position information.

1 . A storefront device comprising:
 at least one memory configured to store instructions; and   at least one processor configured to execute instructions to:
 acquire first position information indicating positions of approaching people who are nearing merchandise; 
 detect second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people; 
 detect third position information indicating a position of the merchandise when the merchandise is picked up; 
 specify, based on the first position information, the second position information and the third position information, identification information of the subject person corresponding to facial feature information; 
 specify, based on the third position information, the merchandise as being picked up by the subject person; and 
 generate management information by associating the identification information and the specified merchandise. 
   
     
     
         2 . The storefront device according to  claim 1 , wherein:
 the second position information relates to an axis indicating the arm of the subject person who has stretched the arm out towards the merchandise.   
     
     
         3 . The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 delete, from the management information, the merchandise returned by the subject person.   
     
     
         4 . The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 output, to the subject person, display information regarding sales information of the merchandise, based on the management information corresponding to the subject person.   
     
     
         5 . The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 acquire the first position information within a three-dimensional space of feature information of the subject person captured by a first camera.   
     
     
         6 . The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 detect whether a movement action indicates that the subject person picked up or returned the merchandise based on movement information of the merchandise captured by a second camera.   
     
     
         7 . The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute the instructions to:
 detect whether a movement action is an acquisition action or a return action of the merchandise based on movement information of the merchandise.   
     
     
         8 . The storefront device according to  claim 1 , wherein the at least one processor is further configured to execute instructions to:
 specify, based on detection time of the second position information and detection time of the third position information, the identification information.   
     
     
         9 . A storefront management method comprising:
 acquiring first position information indicating positions of approaching people nearing merchandise;   detecting second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people;   detecting third position information indicating a position of the merchandise when the merchandise is picked up;   specifying, based on the first position information, the second position information and the third position information, identification information of the subject person corresponding to facial feature information;   specifying, based on the third position information, the merchandise as being picked up by the subject person; and   generating management information by associating the identification information and the specified merchandise.   
     
     
         10 . A non-transitory computer-readable recording medium storing a program for causing a computer of a storefront device to execute processes, the processes comprising:
 acquiring first position information indicating positions of approaching people nearing merchandise;   detecting second position information indicating a position of a subject person who has stretched an arm out towards the merchandise among the approaching people;   detecting third position information indicating a position of the merchandise when the merchandise is picked up;   specifying, based on the first position information, the second position information and the third position information, identification information of the subject person corresponding to facial feature information;   specifying, based on the third position information, the merchandise as being picked up by the subject person; and   generating management information by associating the identification information and the specified merchandise.