Systems and methods for image classification by correlating contextual cues with images

Abstract

A sample set of images is received. Each image in the sample set may be associated with one or more social cues. Correlation of each image in the sample set with an image class is scored based on the one or more social cues associated with the image. Based on the scoring, a training set of images to train a classifier is determined from the sample set. In an embodiment, an extent to which an evaluation set of images correlates with the image class is determined. The determination may comprise ranking a top scoring subset of the evaluation set of images.

What is claimed: 
     
         1 . A system comprising:
 at least one processor; and   a memory storing instructions configured to instruct the at least one processor to perform:   receiving a sample set of images, each image in the sample set associated with one or more social cues;   scoring correlation of each image in the sample set with an image class based on the one or more social cues associated with the image; and   determining a training set of images to train a classifier from the sample set based on the scoring.   
     
     
         2 . The system of  claim 1 , further comprising specifying the image class. 
     
     
         3 . The system of  claim 1 , wherein the determining comprises ranking each image in the sample set of images based on the scoring. 
     
     
         4 . The system of  claim 1 , wherein the determining comprises selecting a top scoring subset of the sample set of images. 
     
     
         5 . The system of  claim 4 , wherein the top scoring subset is the training set of images. 
     
     
         6 . The system of  claim 1 , further comprising training the classifier based on the training set of images. 
     
     
         7 . The system of  claim 1 , further comprising generating a visual pattern template associated with the image class. 
     
     
         8 . The system of  claim 1 , wherein the classifier is configured to use a bag of visual words image classification technique or a neural network image classification technique. 
     
     
         9 . The system of  claim 1 , further comprising determining an extent to which an evaluation set of images correlates with the image class. 
     
     
         10 . The system of  claim 9 , wherein the evaluation set of images is different from the sample set of images. 
     
     
         11 . The system of  claim 9 , wherein the evaluation set of images comprises a larger set of images than the sample set of images. 
     
     
         12 . The system of  claim 9 , further comprising scoring correlation of each image of the evaluation set of images with a visual pattern template associated with the image class. 
     
     
         13 . The system of  claim 12 , further comprising ranking each image of the evaluation set based on the scoring correlation of each image of the evaluation set of images. 
     
     
         14 . The system of  claim 12 , further comprising associating a top scoring subset of the evaluation set of images with the image class. 
     
     
         15 . The system of  claim 1 , wherein the one or more social cues comprises one or more image tags. 
     
     
         16 . The system of  claim 15 , further comprising determining a number of instances of a particular image tag among a total number of the one or more image tags associated with an image. 
     
     
         17 . The system of  claim 1 , wherein the one or more social cues comprises one or more of: location data associated with an image of the sample set of images; or an identity of an uploader, a tagger, or an owner of the image of the sample set of images. 
     
     
         18 . The system of  claim 1 , wherein the one or more social cues are received by a social networking system. 
     
     
         19 . A computer implemented method comprising:
 receiving, by a computer system, a sample set of images, each image in the sample set associated with one or more social cues;   scoring, by the computer system, correlation of each image in the sample set with an image class based on the one or more social cues associated with the image; and   determining, by the computer system, a training set of images to train a classifier from the sample set based on the scoring.   
     
     
         20 . A computer storage medium storing computer-executable instructions that, when executed, cause a computer system to perform a computer-implemented method comprising:
 receiving a sample set of images, each image in the sample set associated with one or more social cues;   scoring correlation of each image in the sample set with an image class based on the one or more social cues associated with the image; and   determining a training set of images to train a classifier from the sample set based on the scoring.