Multi-modal inputs for wearable devices, and systems and methods of use thereof

Abstract

A method of performing input gestures to control user interface elements is described. The method includes, at a first point in time while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset, detecting a first input via an input device of the at least two input devices and performing an action at the artificial-reality headset. In response to detecting a second input via another input device of the at least two input devices, performing another action within a user interface presented via the artificial-reality headset. The method further includes, at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset, detecting the first input via the input device of the at least two input devices.

What is claimed is: 
     
         1 . A non-transitory computer-readable storage medium comprising instructions which, when executed by one or more processors, causes the one or more processors to:
 while an artificial-reality headset is worn by a user:
 at a first point in time and while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset:
 in response to detecting a first input via a first input device of the at least two input devices, perform a first action the artificial-reality headset; 
 in response to detecting a second input via a second input device of the at least two input devices, perform a second action within a user interface presented via the artificial-reality headset; and 
 
 at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset: 
 in response to detecting the first input via the first input device of the at least two input devices, perform the second action within the user interface presented via the artificial-reality headset. 
   
     
     
         2 . The non-transitory computer-readable storage medium of  claim 1 , wherein:
 the first input is one input of a first input tier set including a first input tier and a second input tier,   the first input tier of the first input tier set includes one or more inputs associated with navigation control commands, and   the second input tier of the first input tier set includes one or more inputs associated with system control commands for the artificial-reality headset.   
     
     
         3 . The non-transitory computer-readable storage medium of  claim 2 , wherein:
 the first input tier of the first input tier set is associated with inputs performed with a single digit of a hand of the user, and   the second input tier of the first input tier set is associated with inputs performed with at least two digits of the hand of the user.   
     
     
         4 . The non-transitory computer-readable storage medium of  claim 2 , wherein the first input tier set includes a third input tier, the third input tier of the first input tier set including one or more inputs associated with media control commands. 
     
     
         5 . The non-transitory computer-readable storage medium of  claim 4 , wherein the third input tier of the first input tier set is associated with swipe gestures performed with at least two digits of a hand of the user. 
     
     
         6 . The non-transitory computer-readable storage medium of  claim 1 , wherein the second action includes navigation control commands and/or a system control command for the artificial-reality headset. 
     
     
         7 . The non-transitory computer-readable storage medium of  claim 1 , wherein:
 the second input is one input of a second input tier set including a first input tier and a second input tier,   the first input tier of the second input tier set includes one or more inputs associated with navigation control commands, and   the second input tier of the second input tier set includes one or more inputs associated with system control commands for the artificial-reality headset.   
     
     
         8 . The non-transitory computer-readable storage medium of  claim 7 , wherein:
 the first input tier of the second input tier set is associated with hand gestures performed using a first digit and a second digit of a hand of the user; and   the second input tier of the second input tier set is associated with hand gestures performed using the first digit and a third digit of the user.   
     
     
         9 . The non-transitory computer-readable storage medium of  claim 8 , wherein the second input tier set includes a third input tier, the third input tier of the second input tier set including one or more inputs associated with media control commands. 
     
     
         10 . The non-transitory computer-readable storage medium of  claim 9 , wherein:
 the third input tier of the second input tier set is associated with hand gestures performed using a first phalange and a fourth phalange of the user.   
     
     
         11 . The non-transitory computer-readable storage medium of  claim 1 , wherein causing the artificial-reality headset to perform an artificial-reality headset specific command includes initiating a virtual assistant, and the non-transitory computer-readable storage medium further includes instructions for causing the processor to:
 initiate a microphone of the artificial-reality headset and/or the second input device;   obtain an audio data via the microphone; and   in response to detecting of one or more user input commands from the audio data, cause the second input device and/or the artificial-reality headset to perform the one or more user input commands.   
     
     
         12 . A method, comprising:
 while an artificial-reality headset is worn by a user:
 at a first point in time and while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset:
 in response to detecting a first input via a first input device of the at least two input devices, performing a first action the artificial-reality headset; 
 in response to detecting a second input via a second input device of the at least two input devices, performing a second action within a user interface presented via the artificial-reality headset; and 
 
 at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset:
 in response to detecting the first input via the first input device of the at least two input devices, performing the second action within the user interface presented via the artificial-reality headset. 
 
   
     
     
         13 . The method of  claim 12 , wherein:
 the first input is one input of a first input tier set including a first input tier and a second input tier,   the first input tier of the first input tier set includes one or more inputs associated with navigation control commands, and   the second input tier of the first input tier set includes one or more inputs associated with system control commands for the artificial-reality headset.   
     
     
         14 . The method of  claim 13 , wherein:
 the first input tier of the first input tier set is associated with inputs performed with a single digit of a hand of the user, and   the second input tier of the first input tier set is associated with inputs performed with at least two digits of the hand of the user.   
     
     
         15 . The method of  claim 13 , wherein the first input tier set includes a third input tier, the third input tier of the first input tier set including one or more inputs associated with media control commands. 
     
     
         16 . The method of  claim 15 , wherein the third input tier of the first input tier set is associated with swipe gestures performed with at least two digits of a hand of the user. 
     
     
         17 . An artificial-reality headset, comprising:
 one or more processors; and   memory, comprising instructions which, when executed by the one or more processors, cause the one or more processors to:
 while the artificial-reality headset is worn by a user:
 at a first point in time and while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset:
 in response to detecting a first input via a first input device of the at least two input devices, perform a first action the artificial-reality headset; 
 in response to detecting a second input via a second input device of the at least two input devices, perform a second action within a user interface presented via the artificial-reality headset; and 
 
 at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset:
 in response to detecting the first input via the first input device of the at least two input devices, perform the second action within the user interface presented via the artificial-reality headset. 
 
 
   
     
     
         18 . The artificial-reality headset of  claim 17 , wherein:
 the first input is one input of a first input tier set including a first input tier and a second input tier,   the first input tier of the first input tier set includes one or more inputs associated with navigation control commands, and   the second input tier of the first input tier set includes one or more inputs associated with system control commands for the artificial-reality headset.   
     
     
         19 . The artificial-reality headset of  claim 18 , wherein:
 the first input tier of the first input tier set is associated with inputs performed with a single digit of a hand of the user, and   the second input tier of the first input tier set is associated with inputs performed with at least two digits of the hand of the user.   
     
     
         20 . The artificial-reality headset of  claim 18 , wherein the first input tier set includes a third input tier, the third input tier of the first input tier set including one or more inputs associated with media control commands.