Systems and methods for fitting product

Abstract

Systems and methods are disclosed for fitting by selecting one or more 3D models from a product database; capturing images of a user view of a location and a reference frame using a mobile device with a wide view image sensor and an infrared sensor, both dedicated to 3D sensing, wherein the wide view image sensor is additional to a video camera on the mobile device; generating an updated model of the location by selecting a closest 3D product model to the user view and matching points on the closest 3D product model to one or more predetermined points on the user view; and selecting a best-fit product based on the 3D model.

What is claimed is: 
     
         1 . A method, comprising:
 capturing images of an object relative to a reference frame using a mobile camera with a wide-angle lens and an infrared sensor;   generating in advance of image capturing, one or more 3D models for the object;   generating an updated model of the object by selecting a closest 3D model to the object and matching points on the closest 3D model to one or more predetermined points on the object; and   selecting a best-fit product based on the 3D model.   
     
     
         2 . The method of  claim 1 , wherein the object comprises a room, a space, or an environment, and the product comprises furniture, game, or architecture. 
     
     
         3 . The method of  claim 1 , comprising warping the model to one or more predetermined points on the 3D model. 
     
     
         4 . The method of  claim 1 , wherein the object comprises hair, foot, hand, finger, toe, wrist, neck, or ear, wherein the product comprises jewelry. 
     
     
         5 . The method of  claim 4 , wherein the jewelry comprises cosmetic jewelry, a facial jewelry, hand jewelry, foot jewelry, ear jewelry, dental jewelry, navel jewelry or a hair jewelry. 
     
     
         6 . The method of  claim 1 , wherein the object comprises a body portion, a head, a chest region, a leg, and the object variations comprises body protection gear. 
     
     
         7 . The method of  claim 1 , wherein the object comprises a face and the product comprises facial makeup products. 
     
     
         8 . The method of  claim 1 , wherein the object comprises a head and the product comprises hairstyles or wigs. 
     
     
         9 . The method of  claim 1 , wherein the object comprises skin and the product comprises make-up product or skin care product. 
     
     
         10 . The method of  claim 1 , wherein the object is a face, comprising:
 selecting a makeup pattern or color from a plurality of makeup product variations; and   blending the makeup pattern or color onto the 3D model; and   displaying the makeup color on the face.   
     
     
         11 . The method of  claim 1 , comprising modeling one or more applications of light foundation creme, eye disguise, highlighter, concealer or blush and recommending a makeup. 
     
     
         12 . The method of  claim 1 , wherein the object comprises an anatomical portion, comprising capturing images of the user anatomical portion and selecting one or more pre-generated 3D models for the anatomical portion. 
     
     
         13 . The method of  claim 1 , wherein the object comprises a body portion, comprising:
 identifying a jewelry with one or more dimensions matching one or more dimensions of a body portion; and   rendering an augmented or virtual reality display of the jewelry on the body portion.   
     
     
         14 . The method of  claim 1 , wherein the object comprises one or more fingers, comprising determining ring sizing by:
 performing motion tracking of the jewelry with non-visible and visible image data;   performing area learning of the jewelry with non-visible and visible image data;   performing depth sensing of the jewelry with non-visible and visible image data.   
     
     
         15 . The method of  claim 4 , comprising rendering an image of the jewelry on a hand, a hair, a face, an ear or a nose. 
     
     
         16 . The method of  claim 15 , comprising searching for rings over a period of time and saving the determined user body portions from each dimension determination over the period of time, further comprising monitoring user health by analyzing changes in a user body portion captured by the mobile camera over time. 
     
     
         17 . The method of  claim 4 , wherein the jewelry comprises cosmetic jewelry, facial jewelry, hand jewelry, foot jewelry, ear jewelry, dental jewelry, navel jewelry, a hair jewelry, wearable, ring, or necklace. 
     
     
         18 . The method of  claim 1 , wherein the object comprises a body portion, and the product comprises clothing, swimwear, sweater, jacket, sweater, jean, pant, or dress. 
     
     
         19 . A method for selecting a product, comprising:
 selecting one or more 3D models from a product database;   capturing images of a user view of a location and a reference frame using a mobile device with a wide view image sensor and an infrared sensor, both dedicated to 3D sensing, wherein the wide view image sensor is additional to a video camera on the mobile device;   generating an updated model of the location by selecting a closest 3D product model to the user view and matching points on the closest 3D product model to one or more predetermined points on the user view; and   selecting a best-fit product based on the 3D model.   
     
     
         20 . A method for fitting, comprising:
 selecting one or more 3D models from a product database;   capturing images of a user view relative to a reference frame using a mobile camera with a wide angle lens and an infrared sensor;   determining dimensions for the user view by motion tracking, area learning, and depth sensing of objects in the user view;   generating an updated model of the user view by selecting a closest 3D model to the user view and matching points on the closest 3D product model to one or more predetermined points on the user view; and   selecting a best-fit product based on the 3D model.