Systems and methods for car shopping using messaging framework

Abstract

Disclosed embodiments provide devices, methods, and computer-readable storage media for determining information of an object from a captured image. Further, the disclosed device responds to a user input by capturing, with the camera, image data representing an object. The device then transmits, via a messaging application through a network interface to a server, the image data and a request for information relating to the object. The object information is received via the messaging application through the network from the server and is displayed on the display screen.

What is claimed is: 
     
         1 . A mobile device for determining object information, the device comprising:
 at least one memory device storing instructions, the instructions comprising an operating system with a built-in messaging application;   a camera;   a network interface;   a display screen; and   at least one processor executing the instructions to perform operations comprising:
 responding to a user input by capturing, with the camera, image data representing an object; 
 transmitting, via the messaging application through the network interface to a server, the image data and a request for information relating to the object, wherein requesting information relating to the object from the server comprises:
 generating temporary images based on the captured image; 
 comparing the temporary images to a plurality of reference images; 
 assigning scores to the reference images, based on similarity to the test images; 
 aggregating scores assigned to the references images by the test images; 
 identifying a reference image with a highest aggregated score as the identity of the object; and 
 determining information related to the object based on the identity of the object. 
 
 receiving the object information via the messaging application through the network interface from the server; and 
 displaying the object information on the display screen. 
   
     
     
         2 . The device of  claim 1 , wherein the object information comprises an identification of the object. 
     
     
         3 . The device of  claim 1 , wherein the object information comprises an identification of an entity offering the identified object for sale. 
     
     
         4 . The device of  claim 3 , wherein the object information comprises a physical location where the identified object is sold. 
     
     
         5 . The device of  claim 3 , wherein the object information comprises an address of a web site offering the object for sale. 
     
     
         6 . The device of  claim 1 , wherein the camera comprises a video camera. 
     
     
         7 . The device of  claim 6 , wherein:
 responding to the user input comprises capturing video data representing the object; and   the operations further comprise extracting the image data of the object from the video data.   
     
     
         8 . The device of  claim 3 , wherein the physical location is determined based on the location information embedded in the captured image data. 
     
     
         9 . The device of  claim 2 , wherein the object information of the identified object further comprises review information of the identified object. 
     
     
         10 . A non-transitory computer-readable storage medium storing instructions that, when executable by at least one processor of mobile device, cause the mobile device to perform a method for determining object information, the method comprising:
 responding to a user input by capturing, with a camera, image data representing an object;
 transmitting via a messaging application through a network interface to a server, the image data and a request for information relating to the object, wherein requesting information relating to the object from the server comprises:
 generating temporary images based on the captured image; 
 comparing the temporary images to a plurality of reference images; 
 assigning scores to the reference images based on similarity to the test images; 
 aggregating scores assigned to the references images by the test images; 
 identifying a reference image with a highest aggregated score as the identity of the object; and 
 determining information related to the object based on the identity of the object. 
 
   receiving the object information via the messaging application through the network interface from the server; and   displaying the object information on a display screen.   
     
     
         11 . The non-transitory computer-readable medium of  claim 10 , wherein displaying the object information comprises displaying an identification of the object. 
     
     
         12 . The non-transitory computer readable medium of  claim 10 , wherein displaying the object information comprises displaying an identification of an entity offering the identified object for sale. 
     
     
         13 . The non-transitory computer readable medium of  claim 12 , wherein displaying the object information comprises displaying a physical location where the identified object is sold. 
     
     
         14 . The non-transitory computer readable medium of  claim 12 , wherein displaying the object information comprises displaying an address of a website where the identified object is sold. 
     
     
         15 . The non-transitory computer-readable medium of  claim 11 , wherein displaying the object information of the identified object further comprises displaying review information of the identified object. 
     
     
         16 . A method performed by a mobile device, comprising:
 responding to a user input by capturing, with a camera, image data representing an object;
 transmitting via a message application through a network interface to a server, the image data and a request for information relating to the object, wherein requesting information relating to the object from the server comprises:
 generating temporary images based on the captured image; 
 comparing the temporary images to a plurality of reference images; 
 assigning scores to the reference images based on the similarity to the test images; 
 aggregating scores assigned to the references images by the test images; 
 identifying a reference image with a highest aggregated score as the identity of the object; and 
 determining information related to the object based on the identity of the object. 
 
   receiving the object information via the messaging application through the network interface from the server; and   displaying the object information on the display screen.   
     
     
         17 . The method of  claim 16 , wherein displaying the object information on the display screen comprises displaying an identification of the object. 
     
     
         18 . The method of  claim 16 , wherein displaying the object on the display screen comprises displaying an identification of an entity offering the identified object for sale. 
     
     
         19 . The method of  claim 18 , wherein displaying the identification of the entity offering the identified object for sale comprises displaying a physical location where the identified object is sold. 
     
     
         20 . The method of  claim 18 , wherein displaying the identification of the entity offering the identified object for sale comprises displaying an address of a website offering the object for sale.