Adaptive shading and reprojection

Abstract

Disclosed herein includes a system, a method, and a device for rendering an image through adaptive reprojection. A first reprojection can be performed to generate a portion of a first image of a first view of a virtual space at a first rate. An amount of change from the first view to a second view of the virtual space can be determined. A portion of a second image of the second view of the virtual space can be determined to generate through a second reprojection. The second reprojection can be performed at a second rate to the portion of the second image according to the amount of change from the first view to the second view of the virtual space.

What is claimed is: 
     
         1 . A method comprising:
 determining, by at least one processor, a first portion of a first view of a virtual space to generate through shading;   determining, by the at least one processor, a second portion of the first view of the virtual space to generate through reprojections;   performing, by the at least one processor, the shading to generate a first portion of an image corresponding to the first portion of the first view of the virtual space; and   performing, by the at least one processor, the reprojections at a reprojection rate corresponding to an amount of change from a second view to the first view of the virtual space to generate a second portion of the image corresponding to the second portion of the first view of the virtual space.   
     
     
         2 . The method of  claim 1 , further comprising:
 determining, by the at least one processor, the reprojection rate corresponding to the amount of change from the second view to the first view of the virtual space.   
     
     
         3 . The method of  claim 2 , wherein determining, by the at least one processor, the reprojection rate includes:
 determining, by the at least one processor, the reprojection rate to be a first value, if the amount of change from the second view to the first view of the virtual space exceeds a threshold amount, and   determining, by the at least one processor, the reprojection rate to be a second value higher than the first value, if the amount of change from the second view to the first view of the virtual space is below the threshold amount.   
     
     
         4 . The method of  claim 1 , further comprising:
 determining, by the at least one processor, a resolution of the reprojections, according to the amount of change from the second view to the first view of the virtual space,   wherein the reprojections are performed according to the determined resolution.   
     
     
         5 . The method of  claim 4 , wherein determining, by the at least one processor, the resolution of the reprojections includes:
 determining, by the at least one processor, the resolution of the reprojections to be a first value, if the amount of change from the second view to the first view of the virtual space exceeds a threshold amount, and   determining, by the at least one processor, the resolution of the reprojections to be a second value lower than the first value, if the amount of change from the second view to the first view of the virtual space is below the threshold amount.   
     
     
         6 . The method of  claim 1 , further comprising:
 determining, by the at least one processor, a type of filter to apply to perform the reprojections, according to the amount of change from the second view to the first view of the virtual space; and   wherein the reprojections are performed by applying the determined type of filter.   
     
     
         7 . The method of  claim 6 , wherein determining, by the at least one processor, the type of filter to apply to perform the reprojections includes:
 determining, by the at least one processor, the type of filter to be a bilinear filter, if the amount of change from the second view to the first view of the virtual space is below than a threshold amount; and   determining, by the at least one processor, the type of filter to be a bicubic filter, if the amount of change from the second view to the first view of the virtual space exceeds the threshold amount.   
     
     
         8 . The method of  claim 1 , wherein determining the second portion of the image to generate through the reprojections includes:
 determining the portion of the image associated with a motion vector less than a predetermined threshold.   
     
     
         9 . A device comprising:
 at least one processor configured to:
 determine a first portion of a first view of a virtual space to generate through shading, 
 determine a second portion of the first view of the virtual space to generate through reprojections, 
 perform the shading to generate a first portion of an image corresponding to the first portion of the first view of the virtual space, and 
 perform the reprojections at a reprojection rate corresponding to an amount of change from a second view to the first view of the virtual space to generate a second portion of the image corresponding to the second portion of the first view of the virtual space. 
   
     
     
         10 . The device of  claim 9 , wherein the at least one processor is configured to determine the reprojection rate corresponding to the amount of change from the second view to the first view of the virtual space. 
     
     
         11 . The device of  claim 10 , wherein the at least one processor is configured to determine the reprojection rate by:
 determining the reprojection rate to be a first value, if the amount of change from the second view to the first view of the virtual space exceeds a threshold amount, and   determining the reprojection rate to be a second value higher than the first value, if the amount of change from the second view to the first view of the virtual space is below the threshold amount.   
     
     
         12 . The device of  claim 9 ,
 wherein the at least one processor is configured to determine a resolution of the reprojections, according to the amount of change from the second view to the first view of the virtual space, and   wherein the reprojections are performed according to the determined resolution.   
     
     
         13 . The device of  claim 12 , wherein the at least one processor is configured to determine the resolution of the reprojections by:
 determining the resolution of the reprojections to be a first value, if the amount of change from the second view to the first view of the virtual space exceeds a threshold amount, and   determining the resolution of the reprojections to be a second value lower than the first value, if the amount of change from the second view to the first view of the virtual space is below the threshold amount.   
     
     
         14 . The device of  claim 9 ,
 wherein the at least one processor is configured to determine a type of filter to apply to perform the reprojections, according to the amount of change from the second view to the first view of the virtual space, and   wherein the reprojections are performed by applying the determined type of filter.   
     
     
         15 . The device of  claim 14 , wherein the at least one processor is configured to determine the type of filter to apply to perform the reprojections by:
 determining the type of filter to be a bilinear filter, if the amount of change from the second view to the first view of the virtual space is below than a threshold amount, and   determining the type of filter to be a bicubic filter, if the amount of change from the second view to the first view of the virtual space exceeds the threshold amount.   
     
     
         16 . The device of  claim 9 , wherein the at least one processor is configured to determine the second portion of the image to generate through the reprojections by determining the portion of the image associated with a motion vector less than a predetermined threshold. 
     
     
         17 . A non-transitory computer readable medium storing instructions when executed by one or more processors cause the one or more processors to:
 determine a first portion of a first view of a virtual space to generate through shading;   determine a second portion of the first view of the virtual space to generate through reprojections;   perform the shading to generate a first portion of an image corresponding to the first portion of the first view of the virtual space; and   perform the reprojections at a reprojection rate corresponding to an amount of change from a second view to the first view of the virtual space to generate a second portion of the image corresponding to the second portion of the first view of the virtual space.   
     
     
         18 . The non-transitory computer readable medium of  claim 17 , further storing instructions when executed by the one or more processors cause the one or more processors to determine the reprojection rate corresponding to the amount of change from the second view to the first view of the virtual space. 
     
     
         19 . The non-transitory computer readable medium of  claim 17 , further storing instructions when executed by the one or more processors cause the one or more processors to:
 determine a resolution of the reprojections, according to the amount of change from the second view to the first view of the virtual space,   wherein the reprojections are performed according to the determined resolution.   
     
     
         20 . The non-transitory computer readable medium of  claim 17 , further storing instructions when executed by the one or more processors cause the one or more processors to:
 determine a type of filter to apply to perform the reprojections, according to the amount of change from the second view to the first view of the virtual space, and   wherein the reprojections are performed by applying the determined type of filter.