Information processing apparatus, control method, and program

Abstract

An information processing apparatus (2000) analyzes a captured image (12) generated by a camera (10) to determine a motion of a person. The camera (10) is a camera that images a display place where an item is displayed. The information processing apparatus (2000) detects a reference position (24) from the captured image (12). The reference position (24) indicates a position of a hand of the person. The information processing apparatus (2000) decides an analysis target region (30) to be analyzed in the captured image (12) using the reference position (24). The information processing apparatus (2000) analyzes the analysis target region (30) to determine the motion of the person.

1 . An information processing apparatus comprising:
 at least one memory configured to store instructions; and   at least one processor configured to execute the instructions to:   detect a pose of the hand of the person from the captured image;   set an analysis region of a predetermined shape on the captured image, the analysis region having a direction determined based on a direction of the hand defined by the pose of the hand; and   determine a motion of the person by analyzing the analysis target region,   wherein the analysis region has two first parallel sides that are parallel to the direction of the hand defined by the pose of the hand and two second parallel sides that are perpendicular to the direction of the hand.   
     
     
         2 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person holding the item by analyzing the analysis target region.   
     
     
         3 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person taking out the item from the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         4 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person not holding the item by analyzing the analysis target region.   
     
     
         5 . The information processing apparatus according to  claim 4 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person not holding the item both before and after contact with the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         6 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person placing the item on the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         7 . The information processing apparatus according to  claim 2 ,
 wherein the at least one processor is further configured to execute the instructions to determine a motion of the person taking out the item from the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         8 . A control method executed by a computer, the method comprising:
 detecting a pose of the hand of the person from the captured image;   setting an analysis region of a predetermined shape on the captured image, the analysis region having a direction determined based on a direction of the hand defined by the pose of the hand; and   determining a motion of the person by analyzing the analysis target region,   wherein the analysis region has two first parallel sides that are parallel to the direction of the hand defined by the pose of the hand and two second parallel sides that are perpendicular to the direction of the hand.   
     
     
         9 . The control method according to  claim 8 ,
 wherein the method comprises determining a motion of the person holding the item by analyzing the analysis target region.   
     
     
         10 . The control method according to  claim 8 ,
 wherein the method comprises determining a motion of the person taking out the item from the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         11 . The control method according to  claim 8 ,
 wherein the method comprises determining a motion of the person not holding the item by analyzing the analysis target region.   
     
     
         12 . The control method according to  claim 11 ,
 wherein the method comprises determining a motion of the person not holding the item both before and after contact with the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         13 . The control method according to  claim 8 ,
 wherein the method comprises determining a motion of the person placing the item on the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         14 . The control method according to  claim 9 ,
 wherein the method comprises determining a motion of the person taking out the item from the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         15 . A non-transitory computer readable medium storing a program for causing a computer to perform operations, the operations comprising:
 detecting a pose of the hand of the person from the captured image;   setting an analysis region of a predetermined shape on the captured image, the analysis region having a direction determined based on a direction of the hand defined by the pose of the hand; and   determining a motion of the person by analyzing the analysis target region,   wherein the analysis region has two first parallel sides that are parallel to the direction of the hand defined by the pose of the hand and two second parallel sides that are perpendicular to the direction of the hand.   
     
     
         16 . The non-transitory computer readable medium according to  claim 15 ,
 wherein the operations comprise determining a motion of the person holding the item by analyzing the analysis target region.   
     
     
         17 . The non-transitory computer readable medium according to  claim 15 ,
 wherein the operations comprise determining a motion of the person taking out the item from the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         18 . The non-transitory computer readable medium according to  claim 15 ,
 wherein the operations comprise determining a motion of the person not holding the item by analyzing the analysis target region.   
     
     
         19 . The non-transitory computer readable medium according to  claim 18 ,
 wherein the operations comprise determining a motion of the person not holding the item both before and after contact with the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.   
     
     
         20 . The non-transitory computer readable medium according to  claim 15 ,
 wherein the operations comprise determining a motion of the person placing the item on the display place by analyzing the analysis target region set for each of a plurality of captured images generated at different timepoints.