Stabilizing gestures in artificial reality environments

Abstract

In one embodiment, a computing may display an artificial reality environment to a user wearing an artificial reality device. The artificial reality environment may include at least a first virtual object. The computing system may monitor a motion of a first gesture performed by the user when interacting with the first virtual object. The computing system may determine, using a motion-stabilization profile of the user, a motional range associated with the user. The computing system may compare the motion of the first gesture performed by the user with the motional range associated with the user. The computing system may stabilize one or more second gestures performed by the user during subsequent user interactions in the artificial reality environment responsive to determining that the motion of the first gesture performed by the user exceeds the motional range.

What is claimed is: 
     
         1 . A method comprising, by a computing system:
 displaying an artificial reality environment to a user wearing an artificial reality device, the artificial reality environment comprising at least a first virtual object;   monitoring a motion of a first gesture performed by the user when interacting with the first virtual object in the artificial reality environment displayed by the artificial reality device worn by the user;   determining, using a motion-stabilization profile of the user, a motional range associated with the user;   comparing the motion of the first gesture performed by the user with the motional range associated with the user; and   responsive to determining that the motion of the first gesture performed by the user exceeds the motional range, stabilizing one or more second gestures performed by the user during subsequent user interactions in the artificial reality environment displayed by the artificial reality device worn by the user.   
     
     
         2 . The method of  claim 1 , further comprising:
 determining, based on comparison, that the motion of the first gesture performed by the user is within the motional range; and   responsive to determining that the motion of the first gesture performed by the user is within the motional range, forgoing stabilizing the one or more second gestures performed by the user during the subsequent user interactions in the artificial reality environment displayed by the artificial reality device worn by the user.   
     
     
         3 . The method of  claim 1 , wherein a machine learning model is utilized to learn motional patterns of a plurality of gestures performed by the user with respect to various target virtual objects in the artificial reality environment displayed by the artificial reality device worn by the user, and wherein learned motional patterns are utilized to generate the motion-stabilization profile for the user. 
     
     
         4 . The method of  claim 1 , wherein the motional range comprises one or more of:
 a distance range;   a voxel range;   a pixel range; or   a pose range.   
     
     
         5 . The method of  claim 1 , wherein the motional range comprises a voxel or pixel region of interest that is specific to the user. 
     
     
         6 . The method of  claim 1 , wherein the first gesture and the one or more second gestures are hand gestures. 
     
     
         7 . The method of  claim 1 , wherein the motion-stabilization profile comprises learned hand motional pattern or hand movement pattern that is specific to the user. 
     
     
         8 . The method of  claim 1 , wherein the first gesture is a hand gesture, and wherein monitoring the motion of the first gesture comprises:
 determining an amount of hand pose translation and rotation performed by the user when interacting with the first virtual object in the artificial reality environment displayed by the artificial reality device worn by the user.   
     
     
         9 . The method of  claim 1 , further comprising:
 determining a context in which the user wearing the artificial reality device is interacting with the artificial reality environment;   determining, based on the context, that the user wearing the artificial reality device intends to use the first gesture to interact with the first virtual object displayed by the artificial reality device worn by the user;   monitoring, while the user wearing the artificial reality device is attempting to interact using the first gesture with the first virtual object displayed by the artificial reality device worn by the user, motional patterns of the first gesture performed by the user with respect to the first virtual object; and   generating the motion-stabilization profile associated with the user based on at least the monitored motional patterns of the first gesture performed by the user wearing the artificial reality device with respect to the first virtual object displayed by the artificial reality device worn by the user, wherein the motion-stabilization profile is configured to be utilized to stabilize the first gesture performed by the user during the subsequent user interactions within the artificial reality environment.   
     
     
         10 . The method of  claim 1 , wherein the motion-stabilization profile associated with the user is generated utilizing a process executing in the background with respect to the artificial reality environment. 
     
     
         11 . A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a computing system, cause the one or more processors to:
 display an artificial reality environment to a user wearing an artificial reality device, the artificial reality environment comprising at least a first virtual object;   monitor a motion of a first gesture performed by the user when interacting with the first virtual object in the artificial reality environment displayed by the artificial reality device worn by the user;   determine, using a motion-stabilization profile of the user, a motional range associated with the user;   compare the motion of the first gesture performed by the user with the motional range associated with the user; and   responsive to determining that the motion of the first gesture performed by the user exceeds the motional range, stabilize one or more second gestures performed by the user during subsequent user interactions in the artificial reality environment displayed by the artificial reality device worn by the user.   
     
     
         12 . The non-transitory computer-readable medium of  claim 11 , wherein the instructions that, when executed by the one or more processors of the computing system, further cause the one or more processors to:
 determine, based on comparison, that the motion of the first gesture performed by the user is within the motional range; and   responsive to determining that the motion of the first gesture performed by the user is within the motional range, forgo stabilizing the one or more second gestures performed by the user during the subsequent user interactions in the artificial reality environment displayed by the artificial reality device worn by the user.   
     
     
         13 . The non-transitory computer-readable medium of  claim 11 , wherein a machine learning model is utilized to learn motional patterns of a plurality of gestures performed by the user with respect to various target virtual objects in the artificial reality environment displayed by the artificial reality device worn by the user, and wherein learned motional patterns are utilized to generate the motion-stabilization profile for the user. 
     
     
         14 . The non-transitory computer-readable medium of  claim 11 , wherein the motional range comprises one or more of:
 a distance range;   a voxel range;   a pixel range; or   a pose range.   
     
     
         15 . The non-transitory computer-readable medium of  claim 11 , wherein the first gesture and the one or more second gestures are hand gestures. 
     
     
         16 . A system comprising:
 one or more non-transitory computer-readable storage media including instructions; and   one or more processors coupled to the storage media, the one or more processors configured to execute the instructions to:
 display an artificial reality environment to a user wearing an artificial reality device, the artificial reality environment comprising at least a first virtual object; 
 monitor a motion of a first gesture performed by the user when interacting with the first virtual object in the artificial reality environment displayed by the artificial reality device worn by the user; 
 determine, using a motion-stabilization profile of the user, a motional range associated with the user; 
 compare the motion of the first gesture performed by the user with the motional range associated with the user; and 
 responsive to determining that the motion of the first gesture performed by the user exceeds the motional range, stabilize one or more second gestures performed by the user during subsequent user interactions in the artificial reality environment displayed by the artificial reality device worn by the user. 
   
     
     
         17 . The system of  claim 16 , wherein the one or more processors are further configured to execute the instructions to:
 determine, based on comparison, that the motion of the first gesture performed by the user is within the motional range; and   responsive to determining that the motion of the first gesture performed by the user is within the motional range, forgo stabilizing the one or more second gestures performed by the user during the subsequent user interactions in the artificial reality environment displayed by the artificial reality device worn by the user.   
     
     
         18 . The system of  claim 16 , wherein a machine learning model is utilized to learn motional patterns of a plurality of gestures performed by the user with respect to various target virtual objects in the artificial reality environment displayed by the artificial reality device worn by the user, and wherein learned motional patterns are utilized to generate the motion-stabilization profile for the user. 
     
     
         19 . The system of  claim 16 , wherein the motional range comprises one or more of:
 a distance range;   a voxel range;   a pixel range; or   a pose range.   
     
     
         20 . The system of  claim 16 , wherein the first gesture and the one or more second gestures are hand gestures.