Fast 3d model fitting and anthropometrics using synthetic data

Abstract

Disclosed are methods and systems for displaying items of clothing on a model having a similar body shape to that of an ecommerce user. In one aspects, a system includes one or more hardware processors configured to perform operations comprising receiving, by one or more hardware processors, an image, the image representing a user height, user weight, and user gender, causing display, by the one or more hardware processors, of a second image via a computer interface, the second image representing a model, the model selected based on a comparison of a model height, weight, and gender with the user height, weight, and gender respectively, receiving, by the one or more hardware processors, a selection of an item of clothing; and causing display, by the one or more hardware processors, of a representation of the selected model wearing the selected item of clothing.

What is claimed is: 
     
         1 . A method comprising:
 receiving, by one or more hardware processors, an indication of a height and a weight of a subject;   receiving, by the one or more hardware processors, an image of the subject, the image depicting at least the height of the subject;   determining, by the one or more hardware processors, one or more physical features of the subject based at least in part on the weight of the subject and a comparison of the height of the subject depicted in the image with the one or more physical features of the subject depicted in the image;   generating, by the one or more hardware processors, a multi-dimensional feature vector representing at least the one or more physical features of the subject;   selecting a three-dimensional model from a plurality of three-dimensional models based at least in part on the height, the weight, and a comparison of the multi-dimensional feature vector with a plurality of multi-dimensional feature vectors associated with the plurality of three-dimensional models;   receiving, by the one or more hardware processors, a selection of an item of clothing; and   displaying a representation of the selected three-dimensional model wearing the item of clothing.   
     
     
         2 . The method of  claim 1 , further comprising:
 obtaining rigging data associated with the selected three-dimensional model; and   animating the representation of the selected three-dimensional model wearing the item of clothing in a plurality of poses based at least in part on the rigging data.   
     
     
         3 . The method of  claim 1 , further comprising:
 receiving an additional image of the subject, wherein the additional image is received prior to the image;   determining a relative degree that the subject is depicted as standing straight in the additional image; and   transmitting a prompt for the subject to pose for the image based at least in part on the relative degree satisfying a threshold, wherein the image of the subject is received in response to the prompt.   
     
     
         4 . The method of  claim 1 , further comprising:
 selecting a size of the item of clothing from a plurality of sizes of the item of clothing in response to receiving the selection of the item of clothing and based at least in part on one or more body measurements associated with the selected three-dimensional model, the selected size corresponding to the one or more body measurements of the selected three-dimensional model, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing is based at least in part on the size of the item of clothing.   
     
     
         5 . The method of  claim 1 , further comprising:
 determining one or more measurements associated with a size of the item of clothing based at least in part on receiving the selection of the item of clothing, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing comprises rendering a model of the item of clothing on top of the selected three-dimensional model.   
     
     
         6 . The method of  claim 1 , wherein the item of clothing is displayed on the representation of the selected three-dimensional model with one or more wrinkles. 
     
     
         7 . The method of  claim 1 , wherein the one or more physical features comprise a shoulder width, a hip width, a length of sleeve, a length of leg, or any combination thereof. 
     
     
         8 . A system comprising:
 one or more processors; and   a non-transitory computer-readable medium storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
 receiving an indication of a height and a weight of a subject; 
 receiving an image of the subject, the image depicting at least the height of the subject; 
 determining one or more physical features of the subject based at least in part on the weight of the subject and a comparison of the height of the subject depicted in the image with the one or more physical features of the subject depicted in the image; 
 generating a multi-dimensional feature vector representing at least the one or more physical features of the subject; 
 selecting a three-dimensional model from a plurality of three-dimensional models based at least in part on the height, the weight, and a comparison of the multi-dimensional feature vector with a plurality of multi-dimensional feature vectors associated with the plurality of three-dimensional models; 
 receiving a selection of an item of clothing; and 
 displaying a representation of the selected three-dimensional model wearing the item of clothing. 
   
     
     
         9 . The system of  claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 obtaining rigging data associated with the selected three-dimensional model; and   animating the representation of the selected three-dimensional model wearing the item of clothing in a plurality of poses based at least in part on the rigging data.   
     
     
         10 . The system of  claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 receiving an additional image of the subject, wherein the additional image is received prior to the image;   determining a relative degree that the subject is depicted as standing straight in the additional image; and   transmitting a prompt for the subject to pose for the image based at least in part on the relative degree satisfying a threshold, wherein the image of the subject is received in response to the prompt.   
     
     
         11 . The system of  claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 selecting a size of the item of clothing from a plurality of sizes of the item of clothing in response to receiving the selection of the item of clothing and based at least in part on one or more body measurements associated with the selected three-dimensional model, the selected size corresponding to the one or more body measurements of the selected three-dimensional model, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing is based at least in part on the size of the item of clothing.   
     
     
         12 . The system of  claim 8 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 determining one or more measurements associated with a size of the item of clothing based at least in part on receiving the selection of the item of clothing, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing comprises rendering a model of the item of clothing on top of the selected three-dimensional model.   
     
     
         13 . The system of  claim 8 , wherein the item of clothing is displayed on the representation of the selected three-dimensional model with one or more wrinkles. 
     
     
         14 . The system of  claim 8 , wherein the one or more physical features comprise a shoulder width, a hip width, a length of sleeve, a length of leg, or any combination thereof. 
     
     
         15 . A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause a system to perform operations comprising:
 receiving an indication of a height and a weight of a subject;   receiving an image of the subject, the image depicting at least the height of the subject;   determining one or more physical features of the subject based at least in part on the weight of the subject and a comparison of the height of the subject depicted in the image with the one or more physical features of the subject depicted in the image;   generating a multi-dimensional feature vector representing at least the one or more physical features of the subject;   selecting a three-dimensional model from a plurality of three-dimensional models based at least in part on the height, the weight, and a comparison of the multi-dimensional feature vector with a plurality of multi-dimensional feature vectors associated with the plurality of three-dimensional models;   receiving a selection of an item of clothing; and   displaying a representation of the selected three-dimensional model wearing the item of clothing.   
     
     
         16 . The non-transitory computer-readable medium of  claim 15 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 obtaining rigging data associated with the selected three-dimensional model; and   animating the representation of the selected three-dimensional model wearing the item of clothing in a plurality of poses based at least in part on the rigging data.   
     
     
         17 . The non-transitory computer-readable medium of  claim 15 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 receiving an additional image of the subject, wherein the additional image is received prior to the image;   determining a relative degree that the subject is depicted as standing straight in the additional image; and   transmitting a prompt for the subject to pose for the image based at least in part on the relative degree satisfying a threshold, wherein the image of the subject is received in response to the prompt.   
     
     
         18 . The non-transitory computer-readable medium of  claim 15 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 selecting a size of the item of clothing from a plurality of sizes of the item of clothing in response to receiving the selection of the item of clothing and based at least in part on one or more body measurements associated with the selected three-dimensional model, the selected size corresponding to the one or more body measurements of the selected three-dimensional model, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing is based at least in part on the size of the item of clothing.   
     
     
         19 . The non-transitory computer-readable medium of  claim 15 , wherein the instructions, when executed by the one or more processors, cause the system to perform operations comprising:
 determining one or more measurements associated with a size of the item of clothing based at least in part on receiving the selection of the item of clothing, wherein displaying the representation of the selected three-dimensional model wearing the item of clothing comprises rendering a model of the item of clothing on top of the selected three-dimensional model.   
     
     
         20 . The non-transitory computer-readable medium of  claim 15 , wherein the item of clothing is displayed on the representation of the selected three-dimensional model with one or more wrinkles.