Augmentation modification based on user interaction with augmented reality scene
Abstract
Apparatuses, methods, and storage media for modifying augmented reality in response to user interaction are described. In one instance, the apparatus for modifying augmented reality may include a processor, a scene capture camera coupled with the processor to capture a physical scene, and an augmentation management module to be operated by the processor. The augmentation management module may obtain and analyze the physical scene, generate one or more virtual articles to augment a rendering of the physical scene based on a result of the analysis, track user interaction with the rendered augmented scene, and modify or complement the virtual articles in response to the tracked user interaction. Other embodiments may be described and claimed.
Claims
exact text as granted — not AI-modified1 - 20 . (canceled)
21 . A computer comprising:
a first camera to collect images of a physical scene; at least one sensor to track an eye gaze of a user; at least one screen; at least one microphone to detect a voice command of the user; at least one storage device; instructions; and at least one processor to execute the instructions to:
cause display on the at least one screen of at least one virtual object, the at least one virtual object to be overlaid with respect to the physical scene;
determine a first interaction with the at least one virtual object based on detection of a combination of (a) the eye gaze of the user, (b) the voice command of the user, and (c) a head pose of the user; and
cause a simulation of a manipulation of the at least one virtual object to be displayed on the at least one screen in response to detection of the combination.
22 . The computer as defined in claim 21 , wherein the at least one processor is to determine the interaction with the at least one virtual object based on detection of a hand gesture in the physical scene.
23 . The computer as defined in claim 22 , wherein the hand gesture includes at least one of a point gesture or a wave gesture.
24 . The computer as defined in claim 21 , wherein the at least one processor is to identify physical objects of the physical scene.
25 . The computer as defined in claim 24 , wherein the at least one processor is to update a database of locations corresponding to the identified physical objects of the physical scene.
26 . The computer as defined in claim 21 , wherein the computer includes at least one of a laptop, a tablet or a mobile phone.
27 . The computer as defined in claim 21 , wherein the at least one processor is to cause display of the at least one virtual object based on detection of one or more markers of the physical scene.
28 . At least one non-transitory computer-readable medium comprising machine-readable instructions that, when executed, cause at least one processor to at least:
cause tracking of an eye gaze of a user; cause monitoring of a voice command of the user; cause display on at least one screen of at least one virtual object, wherein the at least one virtual object is overlaid with respect to a physical scene; determine a first interaction with the at least one virtual object based on detection of a combination of (a) the eye gaze of the user, (b) the voice command of the user, and (c) a head pose of the user; and cause simulation of a manipulation of the at least one virtual object to be displayed on the at least one screen in response to detection of the combination.
29 . The at least one non-transitory computer-readable medium as defined in claim 28 , wherein the instructions, when executed, cause the at least one processor to determine the interaction with the at least one virtual object based on detection of a hand gesture in the physical scene.
30 . The at least one non-transitory computer-readable medium as defined in claim 29 , wherein the instructions, when executed, cause the at least one processor to detect the hand gesture as at least one of a point gesture or a wave gesture.
31 . The at least one non-transitory computer-readable medium as defined in claim 28 , wherein the instructions, when executed, cause the at least one processor to identify physical objects of the physical scene.
32 . The at least one non-transitory computer-readable medium as defined in claim 31 , wherein the instructions, when executed, cause the at least one processor to update a database of locations corresponding to the identified physical objects of the physical scene.
33 . The at least one non-transitory computer-readable medium as defined in claim 28 , wherein the instructions, when executed, cause the at least one processor to cause display of the at least one virtual object based on detection of one or more markers of the physical scene.
34 . A mobile computing device comprising:
at least one screen; memory; and processor circuitry to:
cause tracking of an eye gaze of a user;
cause monitoring of a voice command of the user;
cause display on the at least one screen of at least one virtual object, the at least one virtual object to be overlaid with respect to a physical scene;
determine a first interaction with the at least one virtual object based on detection of a combination of (a) the eye gaze of the user, (b) the voice command of the user, and (c) a head pose of the user; and
cause simulation of a manipulation of the at least one virtual object to be displayed on the at least one screen in response to detection of the combination.
35 . The mobile computing device as defined in claim 34 , wherein the processor circuitry is to determine the interaction with the at least one virtual object based on detection of a hand gesture in the physical scene, wherein the hand gesture is at least one of a point gesture or a wave gesture.
36 . The mobile computing device as defined in claim 34 , wherein the processor circuitry is to identify physical objects of the physical scene.
37 . The mobile computing device as defined in claim 36 , wherein the processor circuitry is to update a database of locations corresponding to the identified physical objects of the physical scene.
38 . The mobile computing device as defined in claim 34 , wherein the processor circuitry is to cause display of the at least one virtual object based on detection of one or more markers of the physical scene.Join the waitlist — get patent alerts
Track US2022236787A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.