Image capture and identification system and process

Abstract

A digital image of the object is captured and the object is recognized from plurality of objects in a database. An information address corresponding to the object is then used to access information and initiate communication pertinent to the object.

What is claimed is: 
     
       1. A mobile device comprising:
 an image sensor configured to capture image data of at least a portion of a physical environment that includes at least a first object; and 
 an image processing platform coupled with the image sensor and configured to:
 obtain the image data from the image sensor; 
 recognize a first target object based at least in part on a visual appearance derived from the image data; 
 retrieve information related to the first target object via an information address; 
 determine at least one of a position and an orientation of the first object with respect to a second object in the physical environment based on the visual appearance; and 
 enable an interaction with a computer-system based software application via the information address as a function of the information, and as a function of at least one of the position and the orientation. 
 
 
     
     
       2. The mobile device of  claim 1 , wherein the image processing platform is further configured to determine the at least one of the position and the orientation of the first object by using a database having different views of the first target object from different orientations. 
     
     
       3. The mobile device of  claim 1 , wherein the interaction with the computer-system based software application comprises playing a sound. 
     
     
       4. The mobile device of  claim 1 , wherein the interaction with the computer-system based software application comprises displaying at least one of a text, a graphic, an animation, a video, an advertisement, and an indicator light. 
     
     
       5. The mobile device of  claim 1 , wherein the interaction with the computer-based software application comprises initiating a transaction. 
     
     
       6. The mobile device of  claim 5 , wherein the transaction comprises a purchase related to the first object via an online transaction. 
     
     
       7. The mobile device of  claim 1 , wherein the interaction with the computer-based software application comprises an interaction with an account. 
     
     
       8. The mobile device of  claim 7 , wherein the account comprises an account linked to the mobile device. 
     
     
       9. The mobile device of  claim 7 , wherein the account comprises an account linked to a user of the mobile device. 
     
     
       10. The mobile device of  claim 7 , wherein the account comprises an account linked to a terminal. 
     
     
       11. The mobile device of  claim 7 , wherein the account comprises an account linked to a credit card. 
     
     
       12. The mobile device of  claim 7 , wherein the account comprises a bank account. 
     
     
       13. The mobile device of  claim 1 , wherein the interaction with the computer-based software application comprises streaming audio samples. 
     
     
       14. The mobile device of  claim 1 , wherein the interaction with the computer-based software application comprises interacting with an enterprise that manufactured the first object. 
     
     
       15. The mobile device of  claim 1 , wherein the interaction with the computer-based software application comprises interacting with the first target object. 
     
     
       16. The mobile device of  claim 1 , wherein the second object comprises the mobile device. 
     
     
       17. The mobile device of  claim 1 , where in the image data comprises video data. 
     
     
       18. The mobile device of  claim 1 , wherein the first object comprises a tag. 
     
     
       19. The mobile device of  claim 1 , wherein the first object lacks a tag. 
     
     
       20. The mobile device of  claim 1 , wherein the mobile device further comprises a location tracking sensor configured to track a current location of the mobile device. 
     
     
       21. The mobile device of  claim 20 , wherein the location tracking sensor comprises a GPS transceiver. 
     
     
       22. The mobile device of  claim 20 , wherein the image processing platform is further configured to enable the interaction with the computer-system based software application as a function of the information, as a function of at least one of the position and the orientation, and as a function of the current location of the mobile device. 
     
     
       23. The mobile device of  claim 1 , wherein the mobile device further comprises at least one of a robot and a security apparatus. 
     
     
       24. The mobile device of  claim 1 , wherein the image sensor comprises a security camera. 
     
     
       25. The mobile device of  claim 1 , wherein the image data comprises a representation of on screen content. 
     
     
       26. The mobile device of  claim 1 , wherein the first object comprises a game object. 
     
     
       27. The mobile device of  claim 1 , further comprising an audio module configured to present audio information to a visually impaired user based on the image data. 
     
     
       28. The mobile device of  claim 1 , wherein the interaction with the computer-based software application comprises registering a vote. 
     
     
       29. A mobile device comprising:
 a location tracking sensor configured to track a current location of the mobile device; 
 an image sensor configured to capture image data of a physical environment that includes at least a first object; and 
 an image processing platform coupled with the image sensor and configured to:
 obtain the image data from the image sensor; 
 recognize a first target object based at least in part on a visual appearance derived from the image data; 
 retrieve information related to the first target object via an information address; 
 determine at least one of a position and an orientation of the first object with respect to a second object in the physical environment based on the visual appearance; and 
 enable an interaction with a computer-system based software application via the information address as a function of (i) the information, (ii) at least one of the position and the orientation, and (iii) the current location of the mobile device. 
 
 
     
     
       30. A mobile device comprising:
 an image sensor configured to capture image data of a physical environment that includes at least a first object; and 
 an image processing platform coupled with the image sensor and configured to: 
 obtain the image data from the image sensor;
 recognize a first target object based at least in part on a visual appearance derived from the image data; 
 retrieve information related to the first target object via an information address; 
 determine at least one of a position and an orientation of the first object with respect to a second object in the physical environment based on the visual appearance; and 
 enable an interaction with a computer-system based software application via the information address as a function of (i) the information, (ii) a time, and (iii) at least one of the position and the orientation.