US2023410321A1PendingUtilityA1

Information processing apparatus, control method, and program

Assignee: NEC CORPPriority: Jun 21, 2017Filed: Jul 28, 2023Published: Dec 21, 2023
Est. expiryJun 21, 2037(~10.9 yrs left)· nominal 20-yr term from priority
Inventors:Soma Shiraishi
G06T 7/20G06V 10/255G06T 7/248G06V 20/52G06T 2207/10028G06T 7/74G06V 40/107G06T 2207/30196G06V 40/28G06Q 30/02G08B 13/196G06T 7/73G06T 2207/30232G06T 2207/10016G06T 2207/10021G06T 2207/20081
79
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

An information processing apparatus (2000) analyzes a captured image (12) generated by a camera (10) to determine a motion of a person. The camera (10) is a camera that images a display place where an item is displayed. The information processing apparatus (2000) detects a reference position (24) from the captured image (12). The reference position (24) indicates a position of a hand of the person. The information processing apparatus (2000) decides an analysis target region (30) to be analyzed in the captured image (12) using the reference position (24). The information processing apparatus (2000) analyzes the analysis target region (30) to determine the motion of the person.

Claims

exact text as granted — not AI-modified
1 . An information processing apparatus comprising:
 at least one memory configured to store instructions; and   at least one processor configured to execute the instructions to:   detect a reference position indicating a position of a hand of a person included in a captured image from the captured image in which a display place of an item is imaged;   decide an analysis target region in the captured image using the detected reference position and decides the analysis target region; and   determine a motion of the person by analyzing the decided analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         2 . The information processing apparatus according to  claim 1 ,
 wherein the plurality of captured images includes a first captured image including a scene in which the reference position moves toward a product shelf, and a second captured image including a scene in which the reference position moves in a direction away from the product shelf from among the captured images generated later than generated timepoint of the first captured image.   
     
     
         3 . The information processing apparatus according to  claim 2 ,
 wherein the first captured image is imaged in a case where a distance between the reference position and the product shelf decreases over time.   
     
     
         4 . The information processing apparatus according to  claim 2 ,
 wherein the second captured image is imaged in a case where a distance between the reference position and the product shelf increases over time.   
     
     
         5 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to determine at least one of a motion of the person taking out an item from the display place, a motion of the person not holding an item both before and after contact with the display place, a motion of the person placing an item on the display place, and a motion of the person holding an item both before and after contact with the display place.   
     
     
         6 . The information processing apparatus according to  claim 5 ,
 wherein the at least one processor is further configured to execute the instructions to determine an item which is a target of the motion of the person based on display information indicating a position of each item in the display place and a position of the reference position in a height direction included in the analysis target region.   
     
     
         7 . The information processing apparatus according to  claim 1 ,
 wherein the at least one processor is further configured to execute the instructions to decide a size of the analysis target region that is decided by a reference area defined in advance for the hand region, or a reference distance value defined in advance.   
     
     
         8 . A control method executed by a computer, the method comprising:
 detecting a reference position indicating a position of a hand of a person included in a captured image from the captured image in which a display place of an item is imaged;   deciding an analysis target region in the captured image using the detected reference position and deciding the analysis target region; and   determining a motion of the person by analyzing the decided analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         9 . The control method according to  claim 8 ,
 wherein the plurality of captured images includes a first captured image including a scene in which the reference position moves toward a product shelf, and a second captured image including a scene in which the reference position moves in a direction away from the product shelf from among the captured images generated later than generated timepoint of the first captured image.   
     
     
         10 . The control method according to  claim 9 ,
 wherein the first captured image is imaged in a case where a distance between the reference position and the product shelf decreases over time.   
     
     
         11 . The control method according to  claim 2 ,
 wherein the second captured image is imaged in a case where a distance between the reference position and the product shelf increases over time.   
     
     
         12 . The control method according to  claim 8 ,
 wherein the method comprises determining at least one of a motion of the person taking out an item from the display place, a motion of the person not holding an item both before and after contact with the display place, a motion of the person placing an item on the display place, and a motion of the person holding an item both before and after contact with the display place.   
     
     
         13 . The control method according to  claim 12 ,
 wherein the method comprises determining an item which is a target of the motion of the person based on display information indicating a position of each item in the display place and a position of the reference position in a height direction included in the analysis target region.   
     
     
         14 . The control method according to  claim 8 ,
 wherein the method comprises deciding a size of the analysis target region that is decided by a reference area defined in advance for the hand region, or a reference distance value defined in advance.   
     
     
         15 . A non-transitory computer-readable medium storing a program for causing a computer to perform operations, the operations comprising:
 detecting a reference position indicating a position of a hand of a person included in a captured image from the captured image in which a display place of an item is imaged;   deciding an analysis target region in the captured image using the detected reference position and deciding the analysis target region; and   determining a motion of the person by analyzing the decided analysis target region decided for each of a plurality of captured images generated at different timepoints.   
     
     
         16 . The non-transitory computer-readable medium according to  claim 15 ,
 wherein the plurality of captured images includes a first captured image including a scene in which the reference position moves toward a product shelf, and a second captured image including a scene in which the reference position moves in a direction away from the product shelf from among the captured images generated later than generated timepoint of the first captured image.   
     
     
         17 . The non-transitory computer-readable medium according to  claim 16 ,
 wherein the first captured image is imaged in a case where a distance between the reference position and the product shelf decreases over time.   
     
     
         18 . The non-transitory computer-readable medium according to  claim 16 ,
 wherein the second captured image is imaged in a case where a distance between the reference position and the product shelf increases over time.   
     
     
         19 . The non-transitory computer-readable medium according to  claim 15 ,
 wherein the operations comprise determining at least one of a motion of the person taking out an item from the display place, a motion of the person not holding an item both before and after contact with the display place, a motion of the person placing an item on the display place, and a motion of the person holding an item both before and after contact with the display place.   
     
     
         20 . The non-transitory computer-readable medium according to  claim 19 ,
 wherein the operations comprise determining an item which is a target of the motion of the person based on display information indicating a position of each item in the display place and a position of the reference position in a height direction included in the analysis target region.

Join the waitlist — get patent alerts

Track US2023410321A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.