Computer-implemented methods and computer systems for detection of human's emotions

Abstract

In some embodiments, the present invention provides for an exemplary system that may include at least the following components: a camera component, where the camera component is configured to acquire a visual input, where the visual input includes a face of a person; a processor configured to: obtain the visual input; apply a face detection algorithm to detect a presence of the face within the visual input; extract a vector of at least one feature of the face; match the vector to a stored profile of the person to identify the person; fit, based on person-specific meta-parameters, a three-dimensional morphable face model (3DMFM) to obtain a person-specific 3DMFM of the one person; apply a facial expression detection algorithm to the person-specific 3DMFM to determine a person-specific facial expression; and cause to perform at least one activity associated with the person based at least in part on the person-specific facial expression of the person.

What is claimed is: 
     
         1 . A computer-implemented method, comprising:
 obtaining, by at least one processor, a visual input having a face of at least one person;   wherein the visual input comprises at least one video frame, at least one image, or both;   applying, by the at least one processor, at least one face detection algorithm to detect a presence of the face of the at least one person within the visual input;   extracting, by the at least one processor, a vector of at least one feature of the face of the at least one person from the presence of the face within the visual input;   matching, by the at least one processor, the vector of the at least one feature of the face of the at least one person to at least one stored profile of the at least one person to identify the at least one person;   wherein the at least one stored profile of the at least one person is stored in at least one profile database having a plurality of profiles of a plurality of persons;   wherein each respective profile of each respective person in the at least one profile database comprises each respective plurality of vectors corresponding to each respective plurality of features;   fitting, by the at least one processor, based at least in part on a plurality of person-specific meta-parameters, at least one three-dimensional morphable face model (3DMFM) to obtain a person-specific 3DMFM of the at least one person;   wherein the plurality of person-specific meta-parameters corresponds to a particular plurality of vectors corresponding to a particular plurality of features of the at least one person; and   applying, by the at least one processor, at least one facial expression detection algorithm to the person-specific 3DMFM of the at least one person to determine at least one person-specific facial expression of the at least one person.   
     
     
         2 . The method of  claim 1 , further comprising:
 associating, by the at least one processor, the at least one person-specific facial expression of the at least one person with at least one element of an electronic content.   
     
     
         3 . The method of  claim 2 , wherein the electronic content is a recommended content that is provided to the at least one person. 
     
     
         4 . The method of  claim 3 , wherein the recommended content is at least one of:
 i) at least one visual effect,   ii) at least one visual mask, or   iii) at least one visual filter.   
     
     
         5 . The method of  claim 1 , wherein the visual input has a lower resolution and has been obtained from at least one of:
 i) at least one CCTV camera,   ii) at least one computer camera having a associated with a desktop computer,   iii) at least one computer camera associated with at least one mobile computer, or   iv) at least one computer camera associated with at least one smartphone.   
     
     
         6 . A system, comprising:
 a camera component, wherein the camera component is configured to acquire a visual input, wherein the visual input comprises a face of at least one person;   at least one processor;   a non-transitory computer memory, storing a computer program that, when executed by the at least one processor, causes the at least one processor to:
 obtain the visual input having the face of the at least one person; 
 wherein the visual input comprises at least one video frame, at least one image, or both; 
 apply at least one face detection algorithm to detect a presence of the face of the at least one person within the visual input; 
 extract a vector of at least one feature of the face of the at least one person from the presence of the face within the visual input; 
 match the vector of the at least one feature of the face of the at least one person to at least one stored profile of the at least one person to identify the at least one person; 
 wherein the at least one stored profile of the at least one person is stored in at least one profile database having a plurality of profiles of a plurality of persons; 
 wherein each respective profile of each respective person in the at least one profile database comprises each respective plurality of vectors corresponding to each respective plurality of features; 
 fit, based at least in part on a plurality of person-specific meta-parameters, at least one three-dimensional morphable face model (3DMFM) to obtain a person-specific 3DMFM of the at least one person; 
 wherein the plurality of person-specific meta-parameters corresponds to a particular plurality of vectors corresponding to a particular plurality of features of the at least one person; and 
 apply at least one facial expression detection algorithm to the person-specific 3DMFM of the at least one person to determine at least one person-specific facial expression of the at least one person. 
   
     
     
         7 . The system of  claim 6 , wherein, when executed by the at least one processor, the computer program further causes the at least one processor to:
 associate the at least one person-specific facial expression of the at least one person with at least one element of an electronic content.   
     
     
         8 . The system of  claim 7 , wherein the electronic content is a recommended content that is provided to the at least one person. 
     
     
         9 . The system of  claim 8 , wherein the recommended content is at least one of:
 i) at least one visual effect,   ii) at least one visual mask, or   iii) at least one visual filter.   
     
     
         10 . The system of  claim 6 , wherein the visual input has a lower resolution and has been obtained from at least one of:
 i) at least one CCTV camera,   ii) at least one computer camera having a associated with a desktop computer,   iii) at least one computer camera associated with at least one mobile computer, or   iv) at least one computer camera associated with at least one smartphone.