Information processing apparatus, control method, and program

Abstract

An information processing apparatus (2000) analyzes a captured image (12) generated by a camera (10) to determine a motion of a person. The camera (10) is a camera that images a display place where an item is displayed. The information processing apparatus (2000) detects a reference position (24) from the captured image (12). The reference position (24) indicates a position of a hand of the person. The information processing apparatus (2000) decides an analysis target region (30) to be analyzed in the captured image (12) using the reference position (24). The information processing apparatus (2000) analyzes the analysis target region (30) to determine the motion of the person.

1 . An information processing apparatus comprising:
 at least one memory configured to store instructions; and   at least one processor configured to execute the instructions to:   detect a reference position indicating a position of a hand of a person included in a captured image from the captured image in which a display place of an item is imaged;   decide an analysis target region in the captured image using the detected reference position and decides the analysis target region; and   determine a motion of the person by analyzing the decided analysis target region.   
     
     
         2 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to decide a region having a predetermined shape with the detected reference position as a reference, as the analysis target region.   
     
     
         3 . The information processing apparatus according to  claim 2 ,
 wherein the at least one processor is further configured to:   detect a pose of the hand of the person; and   decide a region having a predetermined shape with the detected reference position as a reference and having an orientation defined by the detected pose, as the analysis target region.   
     
     
         4 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person holding an item by analyzing the decided analysis target region.   
     
     
         5 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person taking out an item from the display place by analyzing the analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         6 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to determine an item which is a target of the motion of the person based on display information indicating a position of each item in the display place and a position of the reference position in a height direction included in the analysis target region.   
     
     
         7 . The information processing apparatus according to  claim 6 ,
 wherein the captured image is a depth image generated by a depth camera that images the display place from above, and   wherein the at least one processor is further configured to determine the position of the reference position in the height direction based on a pixel value at the reference position in the depth image.   
     
     
         8 . A control method executed by a computer, the method comprising:
 detecting a reference position indicating a position of a hand of a person included in a captured image from the captured image in which a display place of an item is imaged;   deciding an analysis target region in the captured image using the detected reference position and deciding the analysis target region; and   analyzing the decided analysis target region to determine a motion of the person.   
     
     
         9 .- 14 . (canceled) 
     
     
         15 . A non-transitory computer-readable storage medium storing a program causing a computer to execute:
 detecting a reference position indicating a position of a hand of a person included in a captured image from the captured image in which a display place of an item is imaged;   deciding an analysis target region in the captured image using the detected reference position and deciding the analysis target region; and   analyzing the decided analysis target region to determine a motion of the person.   
     
     
         16 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person not holding an item by analyzing the decided analysis target region.   
     
     
         17 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person not holding an item both before and after contact with the display place by analyzing the analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         18 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person placing an item on the display place by analyzing the analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         19 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person holding an item before and after contact with the display place by analyzing the analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         20 . The information processing apparatus according to  claim 2 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person holding an item by analyzing the decided analysis target region.   
     
     
         21 . The information processing apparatus according to  claim 3 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person holding an item by analyzing the decided analysis target region.   
     
     
         22 . The information processing apparatus according to  claim 2 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person not holding an item by analyzing the decided analysis target region.   
     
     
         23 . The information processing apparatus according to  claim 3 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person not holding an item by analyzing the decided analysis target region.   
     
     
         24 . The information processing apparatus according to  claim 2 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person taking out an item from the display place by analyzing the analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         25 . The information processing apparatus according to  claim 3 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person taking out an item from the display place by analyzing the analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         26 . The information processing apparatus according to  claim 4 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person taking out an item from the display place by analyzing the analysis target region decided for each of a plurality of captured images generated at different timepoints.