Computing Platform for Improved Aesthetic Outcomes and Patient Safety in Medical and Surgical Cosmetic Procedures

Abstract

An electronic computing system creates a treatment plan and provides safe and accurate treatment recommendations by obtaining an input image of a face; comparing, using a pattern recognition process, one or more aspects of the input image to corresponding aspects of a plurality of reference images; obtaining, based on a result of the comparing, supplemental information associated with one or more additional characteristics of the face; and creating a treatment plan based on the input image and the additional characteristic.

What is claimed is: 
     
         1 . An electronic computer system, comprising:
 one or more processors; and   memory storing one or more programs for execution by the one or more processors, the one or more programs comprising instructions for:
 obtaining an input image of a face of a user; 
 comparing, using a pattern recognition process, image data of the input image to corresponding image data of a plurality of reference images, wherein each of the plurality of reference images includes a face of an individual other than the user; and 
 determining, based on the input image and the comparing of the image data of the input image to the corresponding image data of the plurality of reference images:
 (i) an amount or unit of an injecting agent; and 
 (ii) a plurality of injection locations for the injecting agent or an injection sequence for the injecting agent; and 
 
 displaying the amount or unit of the injecting agent, the plurality of injection locations, and/or the injection sequence on a user interface of the electronic computer system. 
   
     
     
         2 . The electronic computer system of  claim 1 , wherein the image data of the input image represents physical features of the face that are detectable in the input image. 
     
     
         3 . The electronic computer system of  claim 1 , wherein:
 the one or more programs further comprise instructions for obtaining, based on a result of the comparing, supplemental information associated with one or more additional characteristics of the face; and   the determining is further based on the supplemental information.   
     
     
         4 . The electronic computer system of  claim 3 , wherein the one or more additional characteristics include gender and/or age of a patient to which the face belongs. 
     
     
         5 . The electronic computer system of  claim 3 , wherein the one or more additional characteristics include a physical condition associated with an aspect of the face, wherein the physical condition is undetectable in the input image. 
     
     
         6 . The electronic computer system of  claim 3 , wherein obtaining the supplemental information associated with one or more additional characteristics of the face comprises:
 matching, based on the comparing, the input image with one or more reference images;   determining, based on the matching, a first type of information classified as necessary for determining the injecting agent, the plurality of injecting locations, and/or the injection sequence; and   providing a prompt on the user interface for obtaining the supplemental information based on the first type of information.   
     
     
         7 . The electronic computer system of  claim 1 , wherein:
 the pattern recognition process uses a model refined by unsupervised or adversarial training, wherein inputs of the model include the plurality of reference images, and input labels of the model include treatment plans comprising injecting agents, injection locations, and/or injection sequences corresponding to respective reference images of the plurality of reference images;   comparing the one or more aspects of the input image to corresponding aspects of the plurality of reference images includes matching the input image to a first reference image of the plurality of reference images using the model; and   the injection agent, the plurality of injection locations, and/or the injection sequence determined based on the comparing correspond to the first reference image.   
     
     
         8 . The electronic computer system of  claim 1 , wherein:
 the pattern recognition process uses a model refined by unsupervised or adversarial training, wherein inputs of the model include the plurality of reference images, and input labels of the model include one or more evaluation questions corresponding to respective reference images of the plurality of reference images; and   obtaining the supplemental information includes (i) matching the input image to a first reference image of the plurality of reference images using the model, and (ii) providing a prompt on the user interface for obtaining the supplemental information based on one or more evaluation questions corresponding to the first reference image, wherein the prompt includes the one or more evaluation questions.   
     
     
         9 . A method, comprising:
 at an electronic computer system including one or more processors and memory storing one or more programs for execution by the one or more processors:
 obtaining an input image of a face of a user; 
 comparing, using a pattern recognition process, image data of the input image to corresponding image data of a plurality of reference images, wherein each of the plurality of reference images includes a face of an individual other than the user; and 
 determining, based on the input image and the comparing of the image data of the input image to the corresponding image data of the plurality of reference images:
 (i) an amount or unit of an injecting agent; and 
 (ii) a plurality of injection locations for the injecting agent or an injection sequence for the injecting agent; and 
 
 displaying the amount or unit of the injecting agent, the plurality of injection locations, and/or the injection sequence on a user interface of the electronic computer system. 
   
     
     
         10 . The method of  claim 9 , wherein the image data of the input image represents physical features of the face that are detectable in the input image. 
     
     
         11 . The method of  claim 9 , further comprising:
 obtaining, based on a result of the comparing, supplemental information associated with one or more additional characteristics of the face;   wherein the determining is further based on the supplemental information.   
     
     
         12 . The method of  claim 11 , wherein the one or more additional characteristics include gender and/or age of a patient to which the face belongs. 
     
     
         13 . The method of  claim 11 , wherein the one or more additional characteristics include a physical condition associated with an aspect of the face, wherein the physical condition is undetectable in the input image. 
     
     
         14 . The method of  claim 11 , wherein obtaining supplemental information associated with one or more additional characteristics of the face comprises:
 matching, based on the comparing, the input image with one or more reference images;   determining, based on the matching, a first type of information classified as necessary for determining the injecting agent, the plurality of injecting locations, and/or the injection sequence; and   providing a prompt on the user interface for obtaining the supplemental information based on the first type of information.   
     
     
         15 . A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer system, the one or more programs including instructions for:
 obtaining an input image of a face of a user;   comparing, using a pattern recognition process, image data of the input image to corresponding image data of a plurality of reference images, wherein each of the plurality of reference images includes a face of an individual other than the user; and   determining, based on the input image and the comparing of the image data of the input image to the corresponding image data of the plurality of reference images:
 (i) an amount or unit of an injecting agent; and 
 (ii) a plurality of injection locations for the injecting agent or an injection sequence for the injecting agent; and 
   displaying the amount or unit of the injecting agent, the plurality of injection locations, and/or the injection sequence on a user interface of the electronic computer system.   
     
     
         16 . The non-transitory computer readable storage medium of  claim 15 , wherein the image data of the input image represent physical features of the face that are detectable in the input image. 
     
     
         17 . The non-transitory computer readable storage medium of  claim 15 , wherein:
 the one or more programs further include instructions for obtaining, based on a result of the comparing, supplemental information associated with one or more additional characteristics of the face; and   the determining is further based on the supplemental information.   
     
     
         18 . The non-transitory computer readable storage medium of  claim 17 , wherein the one or more additional characteristics include gender and/or age of a patient to which the face belongs. 
     
     
         19 . The non-transitory computer readable storage medium of  claim 17 , wherein the one or more additional characteristics include a physical condition associated with an aspect of the face, wherein the physical condition is undetectable in the input image. 
     
     
         20 . The non-transitory computer readable storage medium of  claim 17 , wherein obtaining supplemental information associated with one or more additional characteristics of the face comprises:
 matching, based on the comparing, the input image with one or more reference images;   determining, based on the matching, a first type of information classified as necessary for determining the injecting agent, the plurality of injecting locations, and/or the injection sequence; and   providing a prompt on the user interface for obtaining the supplemental information based on the first type of information.