Systems and methods for dynamic interaction with an augmented reality environment

Abstract

Methods and systems are provided for dynamic interaction with an augmented reality environment. In some embodiments, the systems and methods are directed at dynamically interacting with machinery within the augmented reality environment via an augmented reality device. The method involves analyzing a site in which the machinery is to be operated to capture environment data; displaying on the augmented reality device an augmented reality representation of the machinery as an overlay of a portion of an augmented reality environment; receiving an interaction request for interacting with the augmented reality representation of the machinery; determining whether the interaction request can be completed in respect of the machinery within the site; and in response to determining that the interaction request can be completed, displaying the augmented reality representation of the machinery in accordance with the interaction request, otherwise, indicating that the interaction request cannot be completed within the site.

We claim: 
     
       1. A method for dynamically interacting with an augmented reality environment via an augmented reality device, the method comprising:
 analyzing, with the augmented reality device, a site in which an object is to be placed to capture environment data related to the site; 
 displaying on the augmented reality device an augmented reality representation of the object as an overlay of a portion of the augmented reality environment corresponding to the site; 
 automatically detecting one or more site limitations restricting one or more interaction requests for interacting with the augmented reality representation of the object within the site; 
 in response to detecting the one or more site limitations, generating a recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object; and 
 receiving an active interaction request via the augmented reality device for interacting with the augmented reality representation of the object and displaying, on the augmented reality device, the augmented reality representation of the object in accordance with the active interaction request. 
 
     
     
       2. The method of  claim 1 , wherein automatically detecting the one or more site limitations restricting the one or more interaction requests comprises:
 determining an operating range of the object; 
 determining whether the operating range exceeds a site boundary of the site; and 
 in response to determining that the operating range exceeds the site boundary, identifying an exceeded boundary as a site limitation of the one or more site limitations. 
 
     
     
       3. The method of  claim 1 , wherein automatically detecting the one or more site limitations restricting the one or more interaction requests comprises:
 displaying on the augmented reality device at least one cause of the one or more site limitations. 
 
     
     
       4. The method of  claim 3  further comprises:
 receiving an override input, via the augmented reality device, to disregard at least one site limitations of the one or more site limitations. 
 
     
     
       5. The method of  claim 1 , wherein generating the recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object comprises:
 determining one or more alternative objects that are suitable for the site; and 
 recommending the one or more alternative objects for the site. 
 
     
     
       6. The method of  claim 5  further comprises determining the one or more alternative objects based on one or more of a user preference and a historical user data. 
     
     
       7. The method of  claim 1 , wherein generating the recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object comprises:
 recommending that the site be analyzed again with the augmented reality device. 
 
     
     
       8. The method of  claim 1 , wherein generating the recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object comprises:
 determining one or more alternative sites suitable for the object based on historical site data; and 
 recommending the one or more alternative sites. 
 
     
     
       9. The method of  claim 8  further comprises recommending the one or more alternative sites based on one or more of a user preference and a historical user data. 
     
     
       10. The method of  claim 1 , wherein generating the recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object comprises:
 automatically adjusting a size of the augmented reality representation of the object to be suitable for the site. 
 
     
     
       11. The method of  claim 1 , wherein generating the recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object comprises:
 generating one or more directional prompts to navigate a user operating the augmented reality device to avoid the one or more site limitations. 
 
     
     
       12. The method of  claim 1 , wherein the object comprises a merchandisable item. 
     
     
       13. The method of  claim 1  further comprises receiving a transaction request for the object via the augmented reality device. 
     
     
       14. The method of  claim 1 , wherein the object comprises machinery and the one or more interaction requests comprises:
 operating a component of the augmented reality representation of the machinery, the operation of the component of the augmented reality representation corresponding to a real-life operation of the component within the site. 
 
     
     
       15. The method of  claim 14 , wherein generating the recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object comprises:
 recommending an alternative component compatible for the machinery and suitable for the site. 
 
     
     
       16. A system for dynamically interacting with an augmented reality environment via an augmented reality device, the system comprising a processor operable to:
 analyze a site in which an object is to be placed to capture environment data related to the site; 
 display on the augmented reality device an augmented reality representation of the object as an overlay of a portion of the augmented reality environment corresponding to the site; 
 automatically detect one or more site limitations restricting one or more interaction requests for interacting with the augmented reality representation of the object within the site; 
 in response to detecting the one or more site limitations, generate a recommendation on the augmented reality device for avoiding restricting the one or more interaction requests for interacting with the augmented reality representation of the object; and 
 receive an active interaction request via the augmented reality device for interacting with the augmented reality representation of the object and display, on the augmented reality device, the augmented reality representation of the object in accordance with the active interaction request. 
 
     
     
       17. The system of  claim 16 , wherein the processor is operable to:
 determine an operating range of the object; 
 determine whether the operating range exceeds a site boundary of the site; and 
 in response to determining that the operating range exceeds the site boundary, identify an exceeded boundary as a site limitation of the one or more site limitations. 
 
     
     
       18. The system of  claim 16 , wherein the processor is operable to display on the augmented reality device at least one cause of the one or more site limitations. 
     
     
       19. The system of  claim 18 , wherein the processor is operable to receive an override input, via the augmented reality device, to disregard at least one site limitations of the one or more site limitations. 
     
     
       20. The system of  claim 16 , wherein the processor is operable to:
 determine one or more alternative objects that are suitable for the site; and 
 recommend the one or more alternative objects for the site. 
 
     
     
       21. The system of  claim 20 , wherein the processor is operable to determine the one or more alternative objects based on one or more of a user preference and a historical user data. 
     
     
       22. The system of  claim 16 , wherein the processor is operable to recommend that the site be analyzed again with the augmented reality device. 
     
     
       23. The system of  claim 16 , wherein the processor is operable to:
 determine one or more alternative sites suitable for the object based on historical site data; and 
 recommend the one or more alternative sites. 
 
     
     
       24. The system of  claim 23 , wherein the processor is operable to recommend the one or more alternative sites based on one or more of a user preference and a historical user data. 
     
     
       25. The system of  claim 16 , wherein the processor is operable to adjust a size of the augmented reality representation of the object to be suitable for the site. 
     
     
       26. The system of  claim 16 , wherein the processor is operable to generate one or more directional prompts to navigate a user operating the augmented reality device to avoid the one or more site limitations. 
     
     
       27. The system of  claim 16 , wherein the object comprises a merchandisable item. 
     
     
       28. The system of  claim 16 , wherein the processor is operable to receive a transaction request for the object via the augmented reality device. 
     
     
       29. The system of  claim 16 , wherein the object comprises machinery and the processor is operable to operate a component of the augmented reality representation of the machinery, the operation of the component of the augmented reality representation corresponding to a real-life operation of the component within the site. 
     
     
       30. The system of  claim 29 , wherein the processor is operable to recommend an alternative component compatible for the machinery and suitable for the site.