Environment Object Recognition

Abstract

Methods, systems, and devices for displaying additional or targeted content to a user are disclosed. An image or data capture device associated with a display device may capture an image of a space associated with the user or capture data related to what is being viewed by the viewer's eyes. Objects in the captured image or objects being viewed may be recognized, including any identifiable image, item, detail, or article and the like. A recognized object may then be compared to a target list to determine a match. If matched, and if there is additional content associated with the target object, the additional content may be presented to the user.

1 . A method comprising:
 outputting content for display to a user;   responsive to determining that an image capture device is authorized to capture an image of a space outside of the image capture device based on information identifying the user and user preferences, using the image capture device to capture the image;   recognizing a first object in the captured image;   comparing the first recognized object to a target list;   determining that the first recognized object matches at least a first target object on the target list; and   selecting additional content based on the matched first target object.   
     
     
         2 . The method of  claim 1 , further comprising:
 outputting, for display a display device, the additional content, wherein the additional content comprises at least one advertisement associated with the first recognized object.   
     
     
         3 . The method of  claim 1 , further comprising:
 recognizing a second object in the captured image;   comparing the second recognized object to the target list; and   determining the second recognized object matches at least a second target object on the target list,   wherein selecting the additional content further comprises selecting the additional content based on the matched at least one second target object.   
     
     
         4 . The method of  claim 1 , further comprising:
 accessing information associated with a previously recognized object in a previously captured image,   wherein selecting the additional content further comprises selecting the additional content based on the accessed information.   
     
     
         5 . The method of  claim 1 , further comprising:
 recognizing a second object in the captured image;   comparing the second recognized object to the target list;   determining that the second recognized object is different from at least one target object on the target list; and   asking the user to input information about the second recognized object.   
     
     
         6 . The method of  claim 5 , further comprising:
 sending user-inputted information to a computing device for identification of the second recognized object; and   adding the second recognized object to the target list after identifying the second recognized object.   
     
     
         7 . The method of  claim 1  further comprising:
 asking the user to identify time ranges during which the image capture device is authorized to capture images of the space. 
 
     
     
         8 . The method of  claim 1 ,
 wherein determining that the image capture device is authorized to capture the image comprises determining that the user has left the space, and   wherein using the image capture device to capture the image comprises using a camera to capture the image of the space after the user has left the space.   
     
     
         9 . The method of  claim 1 , further comprising:
 selecting a second additional content based on the matched first target object; and   outputting, for display on a second display device different from a first display device displaying the content the second additional content.   
     
     
         10 . The method of  claim 1 , further comprising:
 determining a number of instances the first recognized object appears in the image;   determining a number of instances the first recognized object appears in a second image, wherein the second image is an image of a second space different from the space; and   comparing the determined number of instances the first recognized object appears in the image with the determined number of instances the first recognized object appears in the second images,   wherein selecting the additional content further comprises selecting the additional content based on the comparing.   
     
     
         11 - 20 . (canceled) 
     
     
         21 . A method, comprising:
 determining whether an image capture device is authorized to capture an image of at least part of a room in which first content is presented based on a characteristic of the first content;   recognizing, by a computing device, a first object in the image;   comparing the first object to a target list;   determining that the first object matches at least a first target object on the target list; and   selecting, based on the first target object, second content for presentation with the first content.   
     
     
         22 . The method of  claim 21 , wherein selecting the second content based on the first target object comprises selecting at least one advertisement associated with the first object. 
     
     
         23 . The method of  claim 21 , further comprising:
 recognizing a second object in the image;   comparing the second object to the target list; and   determining that the second object matches at least a second target object on the target list,   wherein selecting the second content further comprises selecting the second content based on the second target object.   
     
     
         24 . The method of  claim 21 , further comprising:
 accessing information associated with a previously recognized object in a previously captured image,   wherein selecting the second content further comprises selecting the second content based on the accessed information.   
     
     
         25 . The method of  claim 21 , further comprising:
 recognizing a second object in the image;   comparing the second object to the target list;   determining that the second object is different from at least one target object on the target list; and   prompting a user to input information about the second object.   
     
     
         26 . The method of  claim 25 , further comprising:
 identifying the second object based on user-inputted information; and   adding the second object to the target list after identifying the second object.   
     
     
         27 . The method of  claim 21 , further comprising:
 prompting a user to identify time ranges during which the image capture device is authorized to capture images.   
     
     
         28 . The method of  claim 21 , further comprising authorizing the image capture device to capture the image upon determining that a user has left the room. 
     
     
         29 . The method of  claim 21 , further comprising:
 selecting a third content based on the first target object; and   transmitting the third content to a display device different from a device used to present the first content.   
     
     
         30 . The method of  claim 21 , further comprising:
 determining a first number of instances the first object appears in the image;   determining a second number of instances the first object appears in a second image of at least part of a second room on a premises different from the room; and   comparing the first number of instances and the second number of instances,   wherein selecting the second content further comprises selecting the second content based on the comparing.   
     
     
         31 . The method of  claim 21 , further comprising determining the first object based on determining a direction in which a user's eyes are looking. 
     
     
         32 . The method of  claim 21 , further comprising:
 recognizing, using the image, a plurality of objects corresponding to a plurality of users; and   determining that the plurality of objects match a plurality of target objects,   wherein selecting the second content further comprises selecting the second content based on the plurality of target objects.   
     
     
         33 . A method, comprising:
 prompting a user for approval to use a captured image of an environment in which content is presented; and   selecting, by a computing device, additional content based on an object in the captured image.   
     
     
         34 . The method of  claim 33 , wherein the prompting comprises outputting the captured image for presentation to the user. 
     
     
         35 . The method of  claim 33 , further comprising overlaying the additional content on the content, delivering the additional content to a user device separate from a display presenting the content, or transmitting an email comprising the additional content.