User augmented reality for camera-enabled mobile devices

Abstract

A user augmented reality (UAR) service for a camera-enabled mobile device obtains meta data regarding one or more images/video that are captured with such device and provides the meta data in the display of the mobile device. The meta data is interactive and allows the user to obtain additional information or specific types of information, such as information that will aid the user in making a decision regarding the identified objects or selectable action options that can be used to initiate actions with respect to the identified objects.

1 . A computer-implemented method for providing information in association with a visual representation of a scene captured by a camera of a mobile device, comprising:
 determining a location of the mobile device;   determining a direction in which the camera of the mobile device is pointed;   identifying information relating to one or more businesses near the location in the direction in which the camera of the mobile device is pointed; and   presenting a visual representation of the information for each of the one or more businesses in conjunction with the visual representation of the scene in a display of the mobile device.   
     
     
         2 . The method of  claim 1  wherein presenting the visual representation of the information in conjunction with the visual representation of the scene comprises overlaying the visual representation of the information on the visual representation of the scene in the display of the mobile device. 
     
     
         3 . The method of  claim 1  wherein presenting the visual representation of the information in conjunction with the visual representation of the scene comprises replacing the visual representation of the scene with the visual representation of the information in the display of the mobile device. 
     
     
         4 . The method of  claim 1  wherein the visual representation of the information is presented as one or more of text, an image, video, audio, or a link. 
     
     
         5 . The method of  claim 1  wherein the information comprises one or more of ratings, directions, reviews, comments, menus, price information, or hours of operation relating to the one or more businesses. 
     
     
         6 . The method of  claim 1  further comprising enabling a user of the mobile device to take one or more actions relating to the one or more businesses via the mobile device. 
     
     
         7 . The method of  claim 6  wherein the one or more actions include one or more of make a reservation, rate the one or more businesses, review the one or more businesses, or enter a comment relating to the one or more businesses. 
     
     
         8 . A mobile device for providing information in association with a visual representation of a scene, comprising:
 a camera for capturing the scene;   a display;   at least one a processor and at least one memory, the at least one processor and at least one memory being configured to:
 determine a location of the mobile device;
 determine a direction in which the camera is pointed; 
 identify information relating to one or more businesses near the location in the direction in which the camera is pointed; and 
 present a visual representation of the information for each of the one or more businesses in conjunction with the visual representation of the scene in the display. 
 
   
     
     
         9 . The mobile device of  claim 8  wherein the at least one processor and at least one memory are configured to present the visual representation of the information in conjunction with the visual representation of the scene by overlaying the visual representation of the information on the visual representation of the scene in the display. 
     
     
         10 . The mobile device of  claim 8  wherein the at least one processor and at least one memory are configured to present the visual representation of the information in conjunction with the visual representation of the scene by replacing the visual representation of the scene with the visual representation of the information in the display. 
     
     
         11 . The mobile device of  claim 8  wherein the visual representation of the information is presented as one or more of text, an image, video, audio, or a link. 
     
     
         12 . The mobile device of  claim 8  wherein the information comprises one or more of ratings, directions, reviews, comments, menus, price information, or hours of operation relating to the one or more businesses. 
     
     
         13 . The mobile device of  claim 8  wherein the at least one processor and at least one memory are further configured to enable a user of the mobile device to take one or more actions relating to the one or more businesses. 
     
     
         14 . The mobile device of  claim 13  wherein the one or more actions include one or more of make a reservation, rate the one or more businesses, review the one or more businesses, or enter a comment relating to the one or more businesses. 
     
     
         15 . A computer program product for providing information in association with a visual representation of a scene captured by a camera of a mobile device, the computer program product comprising at least one non-transitory computer-readable storage medium having computer program instructions stored therein that are arranged such that when executed by one or more computing devices they cause the one or more computing devices to:
 determine a location of the mobile device;   determine a direction in which the camera of the mobile device is pointed;   identify information relating to one or more businesses near the location in the direction in which the camera of the mobile device is pointed; and   present a visual representation of the information for each of the one or more businesses in conjunction with the visual representation of the scene in a display of the mobile device.   
     
     
         16 . The computer program product of  claim 15  wherein the computer program instructions are arranged such that when executed by the one or more computing devices they cause the one or more computing devices to present the visual representation of the information in conjunction with the visual representation of the scene by overlaying the visual representation of the information on the visual representation of the scene in the display of the mobile device. 
     
     
         17 . The computer program product of  claim 15  wherein the computer program instructions are arranged such that when executed by the one or more computing devices they cause the one or more computing devices to present the visual representation of the information in conjunction with the visual representation of the scene by replacing the visual representation of the scene with the visual representation of the information in the display of the mobile device. 
     
     
         18 . The computer program product of  claim 15  wherein the visual representation of the information is presented as one or more of text, an image, video, audio, or a link. 
     
     
         19 . The computer program product of  claim 15  wherein the information comprises one or more of ratings, directions, reviews, comments, menus, price information, or hours of operation relating to the one or more businesses. 
     
     
         20 . The mobile device of  claim 8  wherein the computer program instructions are further arranged such that when executed by the one or more computing devices they cause the one or more computing devices to enable a user of the mobile device to take one or more actions relating to the one or more businesses, the one or more actions including one or more of make a reservation, rate the one or more businesses, review the one or more businesses, or enter a comment relating to the one or more businesses.