Eyewear including shared object manipulation AR experiences

Abstract

Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group object manipulation task. During the shared group task, each user of the eyewear controls movement of a respective virtual object in a virtual scene based on a portion of the virtual scene the user is gazing at. Each user can also generate a verbal command to generate a virtual object that interacts with one or more of the other virtual objects.

What is claimed is: 
     
       1. Eyewear, comprising:
 a frame; 
 an eyewear display coupled to the frame; 
 an eye tracker configured to track a gaze of a first user's eye; and 
 a processor configured to:
 display a first image including an object on the eyewear display; 
 determine a first position of the object that the first user is gazing at using the eye tracker; 
 send a first message to a physically remote device indicating the first position of the object that the first user is gazing at; 
 receive a second message from the physically remote device indicating a location of the same first image that a second user of the physically remote device is gazing at; and 
 modify the first position of the object in the first image to a second position in the first image as a function of the eye tracker determination of gazing by the first user. 
 
 
     
     
       2. The eyewear of  claim 1 , wherein the processor is configured to display another object in the first image and modify a position of the other object on the eyewear display to another position responsive to the second message indicating what the second user is gazing at. 
     
     
       3. The eyewear of  claim 1 , wherein the processor is configured to respond to a verbal instruction by generating another object in the first image. 
     
     
       4. The eyewear of  claim 3 , wherein the other object extends from the object. 
     
     
       5. The eyewear of  claim 1 , wherein the processor is configured to automatically send the first message to the physically remote device that is indicative of the first user gaze. 
     
     
       6. The eyewear of  claim 1 , wherein the processor is configured to automatically receive the second message from the physically remote device that is indicative of the second user gaze. 
     
     
       7. The eyewear of  claim 1 , wherein the first image is a first virtual scene, and the object is a virtual object. 
     
     
       8. An interactive augmented reality method for use with an eyewear device having a frame, an eyewear display coupled to the frame, an eye tracker configured track a gaze of a first user's eye, and a processor, the processor:
 displaying a first image including an object on the eyewear display; 
 determining a first position of the object that the first user is gazing at using the eye tracker; 
 sending a first message to a physically remote device indicating the first position of the object that the first user is gazing at; 
 receiving a second message from the physically remote device indicating a location of the same first image that a second user of the physically remote device is gazing at; and 
 modifying the first position of the object in the first image to a second position in the first image as a function of the eye tracker determination of gazing by the first user. 
 
     
     
       9. The method of  claim 8 , the processor additionally displaying another object in the first image and modifying a position of the other object on the eyewear display to another location responsive to the second message indicating what the second user is gazing at. 
     
     
       10. The method of  claim 8 , the processor additionally generating another object in the first image responsive to a verbal instruction. 
     
     
       11. The method of  claim 10 , wherein the other object extends from the first object. 
     
     
       12. The method of  claim 8 , wherein the processor automatically sends the first message to the physically remote device that is indicative of the first user gaze. 
     
     
       13. The method of  claim 8 , wherein the processor automatically receives the second message from the physically remote device that is indicative of the second user gaze. 
     
     
       14. The method of  claim 8 , wherein the first image is a first virtual scene, and the first object is a first virtual object. 
     
     
       15. A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor of an eyewear device having a frame, an eyewear display coupled to the frame, and an eye tracker configured track a gaze of a first user's eye to perform the steps of:
 displaying a first image including an object on the eyewear display; 
 determining a first position of the object that the first user is gazing at using the eye tracker; 
 sending a first message to a physically remote device indicating the first position of the object that the first user is gazing at; 
 receiving a second message from the physically remote device indicating a location of the same first image that a second user of the physically remote device is gazing at; and 
 modifying the first position of the object in the first image to a second position in the first image as a function of the eye tracker determination of gazing by the first user. 
 
     
     
       16. The non-transitory computer-readable medium storing program code of  claim 15 , further including code to perform the steps of displaying another object in the first image and modifying a position of the other object on the eyewear display to another location responsive to the second message indicating what the second user is gazing at. 
     
     
       17. The non-transitory computer-readable medium storing program code of  claim 16 , further including code to perform the step of generating another object in the first image responsive to a verbal instruction. 
     
     
       18. The non-transitory computer-readable medium storing program code of  claim 17 , wherein the other object extends from the first object. 
     
     
       19. The non-transitory computer-readable medium storing program code of  claim 15 , wherein sending the first message to the physically remote device that is indicative of the first user gaze is automatic. 
     
     
       20. The non-transitory computer-readable medium storing program code of  claim 15 , wherein receiving the second message from the physically remote device that is indicative of the second user gaze is automatic.