Method, server and computer program for performing face transformation simulation

Abstract

Provided is a face transformation simulation method. The method is performed by one or more processors of a computing device, and includes obtaining three-dimensional (3D) volume data and 3D facial data, generating matching data by matching the 3D volume data and the 3D facial data, generating a user interface including the matching data and providing the user interface to a user terminal, and performing transformation on the matching data on the basis of a response to the user interface, which is received from the user terminal.

What is claimed is: 
     
         1 . A method of performing a face transformation simulation, which is performed by one or more processors of a computing device, the method comprising:
 obtaining three-dimensional (3D) volume data and 3D facial data;   generating matching data by matching the 3D volume data and the 3D facial data;   generating a user interface including the matching data and providing the user interface to a user terminal; and   performing transformation on the matching data on the basis of a response to the user interface, the response being received from the user terminal.   
     
     
         2 . The method of  claim 1 , wherein the 3D volume data is volume data related to the head and neck of a person who undergoes surgery and comprises one or more landmarks, and
 the 3D facial data is image data related to the face of the person who undergoes the surgery and comprises polygon data and texture data.   
     
     
         3 . The method of  claim 1 , wherein the generating of the matching data comprises:
 identifying landmarks for matching in the 3D volume data and the 3D facial data; and   generating the matching data on the basis of the identified landmarks for matching.   
     
     
         4 . The method of  claim 1 , wherein the user interface comprises:
 a simulation selection screen for receiving a selection input related to an orthodontic simulation or a plastic and orthognathic surgery simulation from a user;   a matching data display screen displaying the matching data; and   a hard tissue change information input screen for receiving a hard tissue adjustment input in relation to a change in hard tissue from the user.   
     
     
         5 . The method of  claim 4 , wherein the performing of the transformation on the matching data comprises:
 changing the hard tissue on the basis of the hard tissue adjustment input; and   changing soft tissue corresponding to the hard tissue using a weighted array when the hard tissue is changed,   wherein the weighted array calculates a movement coefficient of the soft tissue according to the change in the hard tissue.   
     
     
         6 . The method of  claim 5 , wherein the changing of the hard tissue is performed through a plurality of surgical operations,
 wherein the plurality of surgical operations comprise:   a first surgical operation of performing an x-axis movement;   a second surgical operation of performing a z-axis rotation with respect to an arbitrary reference point after applying the first surgery operation with respect to one or more landmarks;   a third surgical operation of performing a y-axis rotation with respect to the arbitrary reference point after applying the second surgery operation with respect to the one or more landmarks;   a fourth surgical operation of performing the z-axis movement;   a fifth surgical operation of performing the x-axis rotation with respect to the arbitrary reference point after applying the fourth surgery operation with respect to the one or more landmarks; and   a sixth surgical operation of performing a y-axis movement.   
     
     
         7 . The method of  claim 5 , wherein the weighted array comprises a mesh including a plurality of vertices and a plurality of edges connecting the plurality of vertices,
 wherein the plurality of vertices are matched to setting values according to a positional relationship with one or more landmarks.   
     
     
         8 . The method of  claim 7 , wherein, when a force is applied to the plurality of vertices according to movement of the hard tissue, the weighted array moves the plurality of vertices on the basis of the applied force and the setting values matched to the plurality of vertices, and
 the plurality of vertices are assigned different weights according to depths of connection between adjacent vertices.   
     
     
         9 . An apparatus for performing the method of  claim 1 , comprising:
 a memory storing one or more instructions; and   a processor configured to execute the one or more instructions stored in the memory,   wherein the processor executes the one or more instructions to perform the method of  claim 1 .   
     
     
         10 . A computer-readable recording medium on which a program for executing a method of performing a face transformation simulation in conjunction with a computing device is recorded, wherein the method comprises:
 obtaining three-dimensional (3D) volume data and 3D facial data;   generating matching data by matching the 3D volume data and the 3D facial data;   generating a user interface including the matching data and providing the user interface to a user terminal; and   performing transformation on the matching data on the basis of a response to the user interface, the response being received from the user terminal.