Method for Sharing Emotions Through the Creation of Three-Dimensional Avatars and Their Interaction

Abstract

A system includes at least one camera capable of acquiring at least one first image comprising a representation of at least a portion of a face and at least one processor. The processor is configured to: detect a plurality of landmarks in the at least one first image, the plurality of landmarks corresponding to respective features of the face; detect an emotion expressed in the face; generate a three-dimensional model of the face based, at least in part, on the plurality of detected landmarks; and, in response to a request to incorporate at least one object, generate at least one second image comprising a representation of at least a portion of the at least one object atop of the representation of at least a portion of the face generated from the three-dimensional model, wherein the emotion detected in the face is expressed in the at least one object.

What is claimed: 
     
         1 . A system comprising:
 at least one camera capable of acquiring at least one first image comprising a representation of at least a portion of a face; and   at least one processor configured to:
 detect a plurality of landmarks in the at least one first image, the plurality of landmarks corresponding to respective features of the face; 
 detect an emotion expressed in the face; 
 generate a three-dimensional model of the face based, at least in part, on the plurality of detected landmarks; 
 in response to a request to incorporate at least one object absent from the at least one first image, generate at least one second image comprising a representation of at least a portion of the at least one object atop of the representation of at least a portion of the face generated from the three-dimensional model, wherein the emotion detected in the face is expressed in the at least one object. 
   
     
     
         2 . The system of  claim 1 , wherein the representation of at least the portion of the at least one object is greater than the representation of the face generated from the three-dimensional model in the at least one second image. 
     
     
         3 . The system of  claim 1 , wherein the emotion expressed in the at least one object is expressed in a coloring of the at least one object. 
     
     
         4 . The system of  claim 1 , wherein the emotion expressed in the at least one object is expressed in a shape of the at least one object. 
     
     
         5 . The system of  claim 1 , wherein the emotion expressed in the at least one object is expressed in a positioning of the at least one object relative to the face. 
     
     
         6 . The system of  claim 1 , the processor is configured to detect changes in the emotion of the face corresponding to changes in the plurality of landmarks. 
     
     
         7 . The system of  claim 6 , wherein the emotion expressed in the at least one object is updated to reflect the detected changes in the emotion of the face. 
     
     
         8 . The system of  claim 1 , wherein the at least one camera comprises one of a camera integrated in a mobile device and a webcam. 
     
     
         9 . The system of  claim 1 , wherein the at least one object comprises one of an article, a product, a branded item, a hat, a wig, glasses, clothing, a costume and/or a gadget. 
     
     
         10 . The system of  claim 1 , wherein the at least one object comprises at least one effect applied to the face, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the at least one effect applied thereto. 
     
     
         11 . The system of  claim 10 , wherein the at least one effect comprises one of a texture and a coloring applied to the face. 
     
     
         12 . The system of  claim 11 , wherein the at least one effect comprises coloring to lips of the face, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the coloring to the lips applied thereto. 
     
     
         13 . The system of  claim 11 , wherein the at least one effect comprises one of coloring and texture to skin of the face. 
     
     
         14 . The system of  claim 11 , wherein the at least one effect comprises make-up. 
     
     
         15 . The system of  claim 11 , wherein the at least one processor is configured to transform the three-dimensional model and/or the at least one object in response to a request for modification. 
     
     
         16 . The system of  claim 15 , wherein the at least one processor is configured to generate the at least one second image based at least in part on the transformed three-dimensional model and/or transformed at least one object. 
     
     
         17 . The system of  claim 16 , wherein the at least one processor is configured to apply a plurality of transformations to the three-dimensional model and/or the at least one object in response to the request for modification. 
     
     
         18 . The system of  claim 17 , wherein the at least one processor is configured to generate a sequences of images, based at least in part on the plurality of transformations, to produce an animation of the face incorporating the at least one object. 
     
     
         19 . The system of  claim 1 , wherein the request to incorporate the at least one object comprises a selection, by a user, of the at least one object to be incorporated in the at least one second image. 
     
     
         20 . The system of  claim 1 , wherein the three-dimensional model comprises a deformable model and image information from the at least one first image. 
     
     
         21 . The system of  claim 1 , wherein the three-dimensional model comprises a mesh textured with image information from the at least one first image. 
     
     
         22 . The system of  claim 1 , wherein the at least one processor is configured to transmit the at least one second image to a remote location. 
     
     
         23 . The system of  claim 1 , wherein the at least one processor is configured to transmit the at least one second image via one of a messaging application and a social networking platform.