Method and system to provide a computer-modified visualization of the desired face of a person

Abstract

A data set of visuals of faces and extracted face property data are generated and linked to face characteristics data provided by a representative set of humans that rate the visuals of these faces with respect to their face characteristics. Further face property data of these visuals of faces is extracted and together with the generated data set used to train an artificial intelligence. The artificial intelligence is used to analyse a visual of the person's face and generate a data set of modifications based on a selected desired characteristic(s) and modifications achievable by at least one cosmetic and/or medical treatment. The visual of the face of the person is modified based on the data set of modifications and the computer-modified visual of the desired face of the person with the modification of the face achievable by the least one proposed cosmetic and/or medical treatment is generated and displayed.

1 . A method to provide a computer-modified visual of a desired face of a person, wherein the method comprises the following steps:
 generating a data set of visuals of faces and extracted face property data thereof linked to face characteristics data provided by a representative set of humans that rate the visuals of these faces about their face characteristics and store the data set in a database;   extracting further face property data of these visuals of faces and use these extracted face property data together with the generated data set for training of an artificial intelligence to enable the artificial intelligence to provide an automated rating of the characteristics of the visuals of faces;   generating a data set of visual modifications of a face achievable by cosmetic and/or medical treatments and store the data set in a database;   taking a standardized visual of the face of the person;   inputting at least one desired characteristic of the face of the person to be changed;   using the artificial intelligence to analyse the visual of the person's face and to generate a data set of modifications based on the selected desired characteristic(s) and modifications achievable by at least one cosmetic and/or medical treatment;   modifying the visual of the face of the person based on the data set of modifications and generate the computer-modified visual of the desired face of the person with the modification of the face achievable by the least one proposed cosmetic and/or medical treatment; and   displaying the computer-modified visual of the desired face of the person.   
     
     
         2 . Method according to  claim 1 , wherein the method comprises the following further steps:
 using a toggle mode to alternatively show the taken standardized visual of the face of the person and the computer-modified visual of the desired face of the person, or   using a marking mode to mark the areas of the face of the person modified by the data set of modifications as an overlay to the displayed computer-modified visual of the desired face of the person.   
     
     
         3 . The method according to  claim 1 , wherein the method comprises the following further steps:
 displaying all cosmetic and/or medical treatments stored in the data set;   selecting only one or more of the cosmetic and/or medical treatments displayed; and   using only selected cosmetic and/or medical treatments for the generation of the data set of modifications.   
     
     
         4 . The method according to  claim 1 , wherein the method comprises the following further steps:
 displaying all characteristics stored in the database; and   selecting two or more of the characteristics displayed as desired characteristic to be used by the artificial intelligence to generate the data set of modifications.   
     
     
         5 . The method according to  claim 1 , wherein the method comprises the following further step:
 displaying those cosmetic and/or medical treatments which, were selected by the artificial intelligence to be used to generate the data set of modifications.   
     
     
         6 . The method according to  claim 1 , wherein the method comprises the following further steps:
 using the artificial intelligence to analyse the visual of the person's face to provide an automated rating of the characteristics of the visual of the person's face; and   displaying the characteristics of the visual of the person's face.   
     
     
         7 . The method according to  claim 1 , wherein the method comprises the following further steps:
 using the artificial intelligence to automatically identify an area with wrinkles in the visual of the person's face and to automatically soft focus this identified area in case the data set of modifications includes such information to modify the visual of the face of the person to generate the computer-modified visual of the desired face of the person.   
     
     
         8 . A system to display a computer-modified visual of a desired face of a person with a mobile device, which mobile device comprises a display and a camera and input means to input a characteristic, which mobile device is connected to a remote server which generates a data set of modifications, wherein
 the remote server comprises a deep learning based application to process the steps of the method according to  claim 1  to generate a database with data sets of visuals of faces and extracted face property data thereof linked to face characteristics and to generate a database with a data set of visual modifications of a face achievable by cosmetic and/or medical treatments and the deep learning based application is built to generate the data set of modifications for at least one region of the face of the person to achieve the desired change in the characteristic of the face based on the generated databases; and   the remote server or the mobile device comprises visual data modification means to modify the visual data of the face of the person with the data set of modifications achievable by the at least one cosmetic and/or medical treatment, which modified visual data of the face are displayed with the mobile device.   
     
     
         9 . A computer program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the following steps to provide a computer-modified visualization of a desired face of a person:
 generating a data set of visuals of faces and extracted face property data thereof linked to face characteristics data provided by a representative set of humans that rate the visuals of these faces about their face characteristics and store the data set in a database;   extracting further face property data of these visuals of faces and use these extracted face property data together with the generated data set for training of an artificial intelligence to enable the artificial intelligence to provide an automated rating of the characteristics of the visuals of faces;   generating a data set of visual modifications of a face achievable by cosmetic and/or medical treatments and store the data set in a database;   receiving a standardized visual of the face of the person from a mobile device;   receiving at least one desired characteristic of the face of the person to be changed input by the person with mobile device;   using the artificial intelligence to analyse the visual of the person's face and to generate a data set of modifications based on the selected desired characteristic(s) and modifications achievable by at least one cosmetic and/or medical treatment;   modifying the visual of the face of the person based on the data set of modifications and generate the computer-modified visual of the face of the person with the modification of the face achievable by the at least one proposed cosmetic and/or medical treatment; and   transmitting the computer-modified visual of the desired face of the person to mobile device to display the computer-modified visual.