Precise application of cosmetic looks from over a network environment

Abstract

A method for guiding a user to manually apply cosmetics by overlaying graphical indicators on a real-time image of the user, the method including receiving a real-time image of the area of skin. Generating a registration layer containing a mapping between features of the real-time image and a graphical model of the area of skin. Presenting, for display to a user, a control layer overlaid on the real-time image according to the registration layer, the control layer including at least one indicator of a location on the area of skin where a reflectance modifying agent (RMA) should be applied. Determining, based on the real-time image, that the RMA has been applied to the location on the area of skin. In response to determining that the RMA has been applied to the location on the area of skin, modifying the at least one indicator included in the control layer.

What is claimed is: 
     
         1 . A computer implemented method for applying reflectance modifying agents (RMA) to an area of physical human skin, the method comprising:
 accessing, by one or more processors, a plurality of makeup effects for applying RMA to the area of physical human skin;   providing, for display to a user on a touchscreen display on an applicator device, the plurality of makeup effects;   receiving, by the one or more processors from the user via the touchscreen display, a selection of a makeup effect from the plurality of makeup effects to be applied to the area of physical human skin;   obtaining, by the one or more processors, data defining the selected makeup effect, the data identifying one or more of: an RMA to apply to the area of physical human skin, an amount of RMA to apply to the area of physical human skin, and a location on which to apply RMA; and   sending, by the one or more processors, the data defining the selected makeup effect to the applicator device, wherein the applicator device is configured to map the data to the area of physical human skin and automatically apply RMA to the area of physical human skin according to the data defining the selected makeup effect.   
     
     
         2 . The method of  claim 1 , wherein the plurality of makeup effects include one or more of predefined looks, each of the predefined looks comprising data identifying one or more RMAs and one or more locations to apply the RMAs in order to apply the predefined look to the area of physical human skin. 
     
     
         3 . The method of  claim 1 , further comprising receiving an image of the area of physical human skin, and
 wherein presenting the plurality of makeup effects comprises presenting, for display to a user, a graphical user interface (GUI) including the image of the area of physical human skin and the plurality of makeup effects.   
     
     
         4 . The method of  claim 3 , further comprising modifying the image of the area of physical human skin based on the selected makeup effect to show the user a preview of the selected makeup effect applied to the area of physical human skin. 
     
     
         5 . The method of  claim 1 , further comprising receiving an image of the area of physical human skin, and
 wherein presenting the plurality of makeup effects comprises presenting, for display to another user, a graphical user interface (GUI) including the image of the area of physical human skin and the plurality of makeup effects, and   wherein receiving a selection of a makeup effect from the plurality of makeup effects to be applied to the area of physical human skin comprises receiving the selection from the other user.   
     
     
         6 . The method of  claim 1 , further comprising:
 receiving, from the applicator device, information about the area of physical human skin; and   selecting, based on the information about the area of physical human skin, a set of makeup effects from the plurality of makeup effects for presentation to the user,   wherein presenting the plurality of makeup effects comprises presenting the set of makeup effects.   
     
     
         7 . The method of  claim 6 , wherein the information about the area of physical human skin includes information obtained by the applicator device from a scan of the area of physical human skin. 
     
     
         8 . A device for applying reflectance modifying agents (RMA) to an area of skin, the device comprising:
 one or more deposition nozzles;   one or more sensors;   a touchscreen display;   a container that contains the RMA and that is in fluid communication with at least one of the one or more deposition nozzles;   one or more processors that are in communication with the one or more sensors, the one or more deposition nozzles, and the display; and   a data store coupled to the one or more processors having instructions stored thereon which, when executed by the one or more processors, causes the one or more processors to perform operations comprising:
 accessing a plurality of makeup effects for applying reflectance modifying agents (RMA) to the area of skin;
 presenting, for display to a user, the plurality of makeup effects; 
 receiving, from an input device, a selection of a makeup effect from the plurality of makeup effects to be applied to the area of skin; 
 obtaining data defining the selected makeup effect, the data identifying, one or more RMAs to apply to the area of skin, an amount of RMA to apply to the area of skin, and a location on which to apply RMA; 
 
 mapping the data to the area of skin using a feature map of the area of skin obtained from a scan of the area of skin by the one or more sensors; and 
 causing the one or more deposition nozzles to deposit RMA on the area of skin according the mapped data defining the selected makeup effect. 
   
     
     
         9 . The device of  claim 8 , wherein the plurality of makeup effects include one or more of predefined looks, each of the predefined looks comprising data identifying one or more RMAs and one or more locations to apply the RMAs in order to apply the predefined look to the area of skin. 
     
     
         10 . The device of  claim 8 , wherein the operations further comprise receiving an image of the area of skin, and
 wherein presenting the plurality of makeup effects comprises presenting, for display to a user, a graphical user interface (GUI) including the image of the area of skin and the plurality of makeup effects.   
     
     
         11 . The device of  claim 10 , wherein the operations further comprise modifying the image of the area of skin based on the selected makeup effect to show the user a preview of the selected makeup effect applied to the area of skin. 
     
     
         12 . The device of  claim 8 , wherein the operations further comprise receiving an image of the area of skin, and
 wherein presenting the plurality of makeup effects comprises presenting, for display to another user, a graphical user interface (GUI) including the image of the area of skin and the plurality of makeup effects, and   wherein receiving a selection of a makeup effect from the plurality of makeup effects to be applied to the area of skin comprises receiving the selection from the other user.   
     
     
         13 . The device of  claim 8 , wherein the operations further comprise:
 obtaining information about the area of skin; and   selecting, based on the information about the area of skin, a set of makeup effects from the plurality of makeup effects for presentation to the user,   wherein presenting the plurality of makeup effects comprises presenting the set of makeup effects.   
     
     
         14 . A system for applying reflectance modifying agents (RMA) to an area of physical human skin, the system comprising:
 one or more computers; and   one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
 accessing a plurality of makeup effects for applying RMA to the area of physical human skin; 
 providing, for display to a user on a touchscreen display on an applicator device, the plurality of makeup effects; 
 receiving, from the user via the touchscreen display, a selection of a makeup effect from the plurality of makeup effects to be applied to the area of physical human skin; 
 obtaining data defining the selected makeup effect, the data identifying one or more of: an RMA to apply to the area of physical human skin, an amount of RMA to apply to the area of physical human skin, and a location on which to apply RMA; and 
 sending the data defining the selected makeup effect to the applicator device, wherein the applicator device is configured to map the data to the area of physical human skin and automatically apply RMA to the area of physical human skin according to the data defining the selected makeup effect. 
   
     
     
         15 . The system of  claim 14 , wherein the plurality of makeup effects include one or more of predefined looks, each of the predefined looks comprising data identifying one or more RMAs and one or more locations to apply the RMAs in order to apply the predefined look to the area of physical human skin. 
     
     
         16 . The system of  claim 14 , wherein the operations further comprise receiving an image of the area of physical human skin, and
 wherein presenting the plurality of makeup effects comprises presenting, for display to a user, a graphical user interface (GUI) including the image of the area of physical human skin and the plurality of makeup effects.   
     
     
         17 . The system of  claim 16 , wherein the operations further comprise modifying the image of the area of physical human skin based on the selected makeup effect to show the user a preview of the selected makeup effect applied to the area of physical human skin. 
     
     
         18 . The system of  claim 14 , wherein the operations further comprise receiving an image of the area of physical human skin, and
 wherein presenting the plurality of makeup effects comprises presenting, for display to another user, a graphical user interface (GUI) including the image of the area of physical human skin and the plurality of makeup effects, and   wherein receiving a selection of a makeup effect from the plurality of makeup effects to be applied to the area of physical human skin comprises receiving the selection from the other user.   
     
     
         19 . The system of  claim 14 , wherein the operations further comprise:
 receiving, from the applicator device, information about the area of physical human skin; and   selecting, based on the information about the area of physical human skin, a set of makeup effects from the plurality of makeup effects for presentation to the user,   wherein presenting the plurality of makeup effects comprises presenting the set of makeup effects.   
     
     
         20 . The system of  claim 19 , wherein the information about the area of physical human skin includes information obtained by the applicator device from a scan of the area of physical human skin.