Estimation device, estimation method, and storage medium

Abstract

An estimation device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: generate a plurality of extraction regions by adding a perturbation to an extraction region of a partial image determined based on positions of feature points extracted from a face image; estimate a plurality of directions of at least one of a face and a line of sight and a reliability of each of the plurality of directions based on a plurality of partial images in the plurality of extraction regions of the face image; and calculate an integrated direction obtained by integrating the plurality of directions based on the estimated reliability.

What is claimed is: 
     
         1 . An estimation device comprising:
 at least one memory storing a set of instructions; and   at least one processor configured to execute the set of instructions to:   generate a plurality of extraction regions by adding a perturbation to an extraction region of a partial image determined based on positions of feature points extracted from a face image;   estimate a plurality of directions of at least one of a face and a line of sight and a reliability of each of the plurality of directions based on a plurality of partial images in the plurality of extraction regions of the face image; and   calculate an integrated direction obtained by integrating the plurality of directions based on the estimated reliability.   
     
     
         2 . The estimation device according to  claim 1 , wherein
 the at least one processor is configured to execute the set of instructions to   determine, based on the positions of the feature points, the perturbation added to the extraction region determined based on the positions of the feature points.   
     
     
         3 . The estimation device according to  claim 1 , wherein
 the at least one processor is configured to execute the set of instructions to   extract a face region that is a region of the face from the face image;   extract the feature points from the face region;   estimate a size of the face based on the positions of the extracted feature points, points; and   determine the perturbation based on the estimated size.   
     
     
         4 . The estimation device according to  claim 1 , wherein
 the perturbation is at least one of a change in a size of the extraction region, a change in a position of the extraction region, a change in an angle of the extraction region, and image processing on a partial image extracted from the extraction region.   
     
     
         5 . The estimation device according to  claim 1 , wherein
 the at least one processor is configured to execute the set of instructions to:   acquire an input image and extracting the face image from the input image;   extract the feature points from the face image; and   output the integrated direction.   
     
     
         6 . The estimation device according to  claim 5 , wherein
 the at least one processor is configured to execute the set of instructions to:   estimate a plurality of directions of the face and a plurality of directions of the line of sight;   calculate an integrated face direction obtained by integrating the plurality of directions of the face and an integrated line of sight direction obtained by integrating the plurality of directions of the line of sight;   superimpose a first mark indicating the integrated face direction and a second mark indicating the integrated line of sight direction on the input image; and   output the input image on which the first mark and the second mark are superimposed.   
     
     
         7 . An estimation method comprising:
 generating a plurality of extraction regions by adding a perturbation to an extraction region of a partial image determined based on positions of feature points extracted from a face image;   estimating a plurality of directions of at least one of a face and a line of sight and a reliability of each of the plurality of directions based on a plurality of partial images in the plurality of extraction regions of the face image; and   calculating an integrated direction obtained by integrating the plurality of directions based on the estimated reliability.   
     
     
         8 . The estimation method according to  claim 7 , further comprising
 determining, based on the positions of the feature points, the perturbation added to the extraction region determined based on the positions of the feature points.   
     
     
         9 . The estimation method according to  claim 7 , further comprising:
 extracting a face region that is a region of the face from the face image;   extracting the feature points from the face region;   estimating a size of the face based on the positions of the extracted feature points; and   determining the perturbation based on the estimated size.   
     
     
         10 . The estimation method according to  claim 7 , wherein
 the perturbation is at least one of a change in a size of the extraction region, a change in a position of the extraction region, a change in an angle of the extraction region, and image processing on a partial image extracted from the extraction region.   
     
     
         11 . The estimation method according to  claim 7 , further comprising:
 acquiring an input image and extracting the face image from the input image;   extracting the feature points from the face image; and   outputting the integrated direction.   
     
     
         12 . The estimation method according to  claim 11 , further comprising:
 estimating a plurality of directions of the face and a plurality of directions of the line of sight;   calculating an integrated face direction obtained by integrating the plurality of directions of the face and an integrated line of sight direction obtained by integrating the plurality of directions of the line of sight;   superimposing a first mark indicating the integrated face direction and a second mark indicating the integrated line of sight direction on the input image; and   outputting the input image on which the first mark and the second mark are superimposed.   
     
     
         13 . A non-transitory computer readable storage medium that stores a program causing a computer to execute:
 perturbation processing of generating a plurality of extraction regions by adding a perturbation to an extraction region of a partial image determined based on positions of feature points extracted from a face image;   estimation processing of estimating a plurality of directions of at least one of a face and a line of sight and a reliability of each of the plurality of directions based on a plurality of partial images in the plurality of extraction regions of the face image; and   integration processing of calculating an integrated direction obtained by integrating the plurality of directions based on the estimated reliability.   
     
     
         14 . The storage medium according to  claim 13 , wherein
 the perturbation processing determines, based on the positions of the feature points, the perturbation added to the extraction region determined based on the positions of the feature points.   
     
     
         15 . The storage medium according to  claim 13 , wherein
 the perturbation processing extracts a face region that is a region of the face from the face image, extracts the feature points from the face region, estimates a size of the face based on the positions of the extracted feature points, and determines the perturbation based on the estimated size.   
     
     
         16 . The storage medium according to  claim 13 , wherein
 the perturbation is at least one of a change in a size of the extraction region, a change in a position of the extraction region, a change in an angle of the extraction region, and image processing on a partial image extracted from the extraction region.   
     
     
         17 . The storage medium according to  claim 13 , the program further causing a computer to execute:
 acquisition processing of acquiring an input image and extracting the face image from the input image;   extraction processing of extracting the feature points from the face image; and   output processing of outputting the integrated direction.   
     
     
         18 . The storage medium according to  claim 17 , wherein
 the estimation processing estimates a plurality of directions of the face and a plurality of directions of the line of sight,   the integration processing calculates an integrated face direction obtained by integrating the plurality of directions of the face and an integrated line of sight direction obtained by integrating the plurality of directions of the line of sight, and   the output processing superimposes a first mark indicating the integrated face direction and a second mark indicating the integrated line of sight direction on the input image and outputs the input image on which the first mark and the second mark are superimposed.