Multi-pass object rendering using a three-dimensional geometric constraint

Abstract

A device for performing multi-pass object rendering using a three-dimensional geometric constraint may include at least one processor configured to receive a mesh of points corresponding to a head of a user. The at least one processor may be further configured to render an image of a sphere and to render elements corresponding to facial features based at least in part on the mesh of points. The at least one processor may be further configured to render an element visibility mask based at least in part on the mesh of points, the element visibility mask being constrained to the surface of the sphere. The at least one processor may be further configured to composite the sphere, the elements, and the element visibility mask to generate an output image. The at least one processor may be further configured to provide the output image for display.

1 - 11 . (canceled) 
     
     
         12 . A device comprising:
 a memory; and   at least one processor configured to:
 render at least one element corresponding to at least one facial feature and a visibility mask that masks a portion of the at least one element with respect to a three-dimensional geometric object; and 
 render an output image based at least in part on an image of the three-dimensional geometric object, the at least one element, and the visibility mask. 
   
     
     
         13 . The device of  claim 12 , wherein the render of the visibility mask is constrained to a surface of the three-dimensional geometric object. 
     
     
         14 . The device of  claim 12 , wherein the three-dimensional geometric object comprises a sphere and points rendered on a surface of the sphere are constrained to a particular distance from a center point of the sphere. 
     
     
         15 . The device of  claim 12 , wherein the at least one processor is configured to render the output image based at least in part on the image of the three-dimensional geometric object, the at least one element, and the visibility mask by:
 multiplying the at least one element corresponding to the at least one facial feature by the visibility mask to generate at least one visible facial feature;   subtracting the visibility mask from the image of the three-dimensional geometric object to generate an image of a visible three-dimensional geometric object; and   adding the at least one visible facial feature to the image of the visible three-dimensional geometric object to generate the output image.   
     
     
         16 . The device of  claim 12 , wherein the at least one processor is further configured to:
 determine a position of the at least one element corresponding to the at least one facial feature is based at least in part on a position of the at least one facial feature on a head of a user and an orientation of the head of the user.   
     
     
         17 . The device of  claim 12 , wherein the at least one processor is further configured to:
 generate information corresponding to a head of a user based at least in part on a mesh of points generated from the head of the user; and   determine, based at least in part on information corresponding to a head of a user, at least one facial feature of the user.   
     
     
         18 . (canceled) 
     
     
         19 . (canceled) 
     
     
         20 . The device of  claim 12 , wherein least one facial feature comprises at least one of a mouth, an eye, or an eyebrow. 
     
     
         21 . A method comprising:
 rendering at least one element corresponding to at least one facial feature and a visibility mask that masks a portion of the at least one element with respect to a three-dimensional geometric object; and   rendering an output image based at least in part on an image of the three-dimensional geometric object, the at least one element, and the visibility mask.   
     
     
         22 . The method of  claim 21 , wherein the render of the visibility mask is constrained to a surface of the three-dimensional geometric object. 
     
     
         23 . The method of  claim 21 , wherein the three-dimensional geometric object comprises a sphere and points rendered on a surface of the sphere are constrained to a particular distance from a center point of the sphere. 
     
     
         24 . The method of  claim 21 , further comprising rendering the output image based at least in part on the image of the three-dimensional geometric object, the at least one element, and the visibility mask by:
 multiplying the at least one element corresponding to the at least one facial feature by the visibility mask to generate at least one visible facial feature;   subtracting the visibility mask from the image of the three-dimensional geometric object to generate an image of a visible three-dimensional geometric object; and   adding the at least one visible facial feature to the image of the visible three-dimensional geometric object to generate the output image.   
     
     
         25 . The method of  claim 21 , further comprising:
 determining a position of the at least one element corresponding to the at least one facial feature is based at least in part on a position of the at least one facial feature on a head of a user and an orientation of the head of the user.   
     
     
         26 . The method of  claim 21 , further comprising:
 generating information corresponding to a head of a user based at least in part on a mesh of points generated from the head of the user; and   determining, based at least in part on information corresponding to a head of a user, at least one facial feature of the user.   
     
     
         27 . The method of  claim 21 , further comprising:
 rendering the image of the dimensional geometric object.   
     
     
         28 . A non-transitory machine-readable medium comprising code that, when executed by one or more processors, causes the one or more processors to perform operations, the code comprising:
 code to render at least one element corresponding to at least one facial feature and a visibility mask that masks a portion of the at least one element with respect to a three-dimensional geometric object; and   code to render an output image based at least in part on an image of the three-dimensional geometric object, the at least one element, and the visibility mask.   
     
     
         29 . The non-transitory machine-readable medium of  claim 28 , wherein the render of the visibility mask is constrained to a surface of the three-dimensional geometric object. 
     
     
         30 . The non-transitory machine-readable medium of  claim 28 , wherein the three-dimensional geometric object comprises a sphere and points rendered on a surface of the sphere are constrained to a particular distance from a center point of the sphere. 
     
     
         31 . The non-transitory machine-readable medium of  claim 28 , further comprising code to render the output image based at least in part on the image of the three-dimensional geometric object, the at least one element, and the visibility mask by:
 multiplying the at least one element corresponding to the at least one facial feature by the visibility mask to generate at least one visible facial feature;   subtracting the visibility mask from the image of the three-dimensional geometric object to generate an image of a visible three-dimensional geometric object; and   adding the at least one visible facial feature to the image of the visible three-dimensional geometric object to generate the output image.   
     
     
         32 . The non-transitory machine-readable medium of  claim 28 , wherein the code further comprises:
 code to determine a position of the at least one element corresponding to the at least one facial feature is based at least in part on a position of the at least one facial feature on a head of a user and an orientation of the head of the user.   
     
     
         33 . The non-transitory machine-readable medium of  claim 28 , wherein the code further comprises:
 code to generate information corresponding to a head of a user based at least in part on a mesh of points generated from the head of the user; and   code to determine, based at least in part on information corresponding to a head of a user, at least one facial feature of the user.