Generating multiple language training data for seach classifier

Abstract

A system and method for training a search query classifier may be used to develop a large database of search queries used to access inappropriate sensitive or offensive content in multiple languages.

What is claimed is: 
     
         1 . A non-transitory computer-readable storage medium comprising instructions, which, when executed by one or more computers, cause the one or more computers to perform actions comprising:
 obtaining, from a search engine, a set of terms related to a particular type of content in a second language based on search queries in a first language;   obtaining, from the search engine, search queries in the second language that include (i) a substring matching one or more terms related to the particular type of content in the second language and (ii) a substring in the second language related to a subset of the particular type of content;   classifying one or more substrings in the obtained search queries that include (i) the substring matching one or more terms related to the particular type of content in the second language and (ii) the substring in the second language related to the subset of the particular type of content, as being related to inappropriate sensitive or offensive content;   providing the classified one or more substrings as training data for training a search query classifier; and   training, using the training data, the search query classifier to classify search queries in the second language that contain the classified one or more substrings as attempting to seek the inappropriate sensitive or offensive content.   
     
     
         2 . The non-transitory computer-readable storage medium of  claim 1 , wherein:
 the particular type of content corresponds to child-related content;   the subset of the particular type of content corresponds to child pornography; and   the inappropriate sensitive of offensive content corresponds to images, video, and data that include child pornography.   
     
     
         3 . The non-transitory computer-readable storage medium of  claim 1 , wherein obtaining the set of child-related terms in the second language based on search queries in the first language, comprises:
 obtaining a first collection of terms related to the particular type of content in the first language;   identifying, from among a collection of search queries in the first language, the search queries in the first language that include one of more of the terms related to the particular type of content; and   translating terms included in the search queries that include the one of more of the terms related to the particular type of content to terms in the second language.   
     
     
         4 . The non-transitory computer-readable storage medium of  claim 1 , wherein obtaining search queries in the second language that include (i) the substring matching one or more terms related to the particular type of content in the second language and (ii) the substring in the second language related to a subset of the particular type of content, comprises:
 for each search query:
 determining a number of times that the search query is listed in a collection of search queries in the second language; and 
 determining that the number of times satisfies a first threshold. 
   
     
     
         5 . The non-transitory computer-readable storage medium of  claim 1 , wherein classifying one or more substrings in the obtained search queries that include (i) the substring matching one or more terms related to the particular type of content in the second language and (ii) the substring in the second language related to the subset of the particular type of content, as being related to inappropriate sensitive or offensive content, comprises:
 generating a set of one or more substrings extracted from each of the obtained search queries;   for each substring in the set of one or more substrings:
 determining (i) a frequency of occurrence of the substring in a collection of search queries in the second language, and (ii) a frequency of occurrence of the substring in search queries in the second language that are classified as related to the subset of the particular type of content; and 
 classifying the substring as being related to inappropriate sensitive or offensive content, or not being related to inappropriate sensitive or offensive content, based at least on (i) the frequency of occurrence of the substring in the collection of search queries in the second language, and (ii) the frequency of occurrence of the substring in search queries in the second language that are classified as related to the subset of the particular type of content. 
   
     
     
         6 . The non-transitory computer-readable storage medium of  claim 1 , wherein providing the classified one or more substrings as training data for training the search query classifier to classify search queries in the second language that contain the classified one or more substrings as attempting to seek the inappropriate sensitive or offensive content, comprises:
 identifying, in a collection of search queries in the second language, one or more search queries that include the one or more substrings classified as being related to inappropriate sensitive or offensive content; and   providing the identified one or more search queries as training data to the search query classifier.   
     
     
         7 . The non-transitory computer-readable storage medium of  claim 1 , further comprising:
 training the search query classifier, for a third language, to identify search queries in the third language that contain one or more substrings classified as being related to the inappropriate sensitive or offensive content based on one or more of (i) the search queries in the first language, or (ii) the training data for the second language.   
     
     
         8 . A computer-implemented method comprising:
 obtaining a first collection of one or more child-related terms in a first language;   identifying, from among a collection of search queries in a first language received from a search engine, a first set of search queries that each include one or more of the child-related terms;   generating a second collection of search terms in a second language based on the first set of search queries from the first language;   identifying, from among a collection of search queries in the second language received from the search engine, a second set of search queries in the second language;   for each of the search queries in the second set, determining whether the search query includes (i) a substring corresponding to a term in the second collection of search terms, and (ii) a substring corresponding to a term in the second language associated with child pornography;   for each of the search queries in the second set determined as including (i) a substring corresponding to a term in the second collection of search terms, and (ii) a substring corresponding to a term in the second language associated with child pornography, classifying the search query as (i) related to child pornography, or (ii) not related to child pornography;   generating a set of one or more substrings from each of the search queries that are classified as related to child pornography;   for each substring in the set of one or more substrings, determining (i) a frequency of occurrence of the substring in the collection of search queries in the second language that were received from the search engine, and (ii) a frequency of occurrence of the substring in the search queries that are classified as related to child pornography;   for each substring in the set of one or more of substrings, classifying the substring as (i) a child pornography-related substring or (ii) not a child-pornography-related substring, based at least on (i) the frequency of occurrence of the substring in the collection of search queries in the second language that were received from the search engine, and (ii) the frequency of occurrence of the substring in the search queries that are classified as related to child pornography;   identifying, in the second set of search queries in the second language, a subset of the search queries that each include one or more of the substrings that are classified as a child pornography-related substring; and   providing, as training data for training a classifier, the subset of the search queries that each include one or more of the substrings classified as child pornography-related substrings.   
     
     
         9 . The computer-implemented method of  claim 8 , wherein identifying, from among the collection of search queries in the first language received from the search engine, the first set of search queries that each include one or more of the child-related terms, comprises:
 determining a number of times that the search queries in the first language are submitted by users of the search engine; and   determining that the number of times satisfies a first particular threshold.   
     
     
         10 . The computer-implemented method of  claim 8 , wherein identifying, from among the collection of search queries in the second language received from the search engine, the second set of search queries in the second language, comprises:
 determining a number of times that the search queries in the second language are submitted by users of the search engine; and   determining that the number of times satisfies a second particular threshold.   
     
     
         11 . The computer-implemented method of  claim 8 , wherein generating the second collection of search terms in the second language based on the first set of search queries from the first language, comprises:
 translating the first set of search queries from the first language to the second collection of search terms in the second language.   
     
     
         12 . The computer-implemented method of  claim 8 , further comprising:
 determining that a subsequent search query in the second language is received by the search engine, the subsequent search query including the one or more of the substrings that are classified as a child pornography-related substring;   identifying one or more search queries in the second language that are received by the search engine within a determined period of time of receiving the subsequent search query; and   providing, as training data for training the classifier, the one or more search queries in the second language that are received by the search engine within the determined period of time of receiving the subsequent search query.   
     
     
         13 . The computer-implemented method of  claim 8 , wherein classifying the substring as (i) a child pornography-related substring or (ii) not a child-pornography-related substring, comprises:
 determining a ratio of (i) the frequency of occurrence of the substring in the collection of search queries in the second language that were received from the search engine to (ii) the frequency of occurrence of the substring in the search queries that are classified as related to child pornography; and   classifying the substring as (i) a child pornography-related substring or (ii) not a child-pornography-related substring based on the ratio satisfying a third particular threshold.   
     
     
         14 . A system comprising:
 one or more computers and one or more storage devices storing instructions that are operable and when executed by one or more computers, cause the one or more computers to perform actions comprising:
 obtaining, from a search engine, a set of terms related to a particular type of content in a second language based on search queries in a first language; 
 obtaining, from the search engine, search queries in the second language that include (i) a substring matching one or more terms related to the particular type of content in the second language and (ii) a substring in the second language related to a subset of the particular type of content; 
 classifying one or more substrings in the obtained search queries that include (i) the substring matching one or more terms related to the particular type of content in the second language and (ii) the substring in the second language related to the subset of the particular type of content, as being related to inappropriate sensitive or offensive content; 
 providing the classified one or more substrings as training data for training a search query classifier; and 
 training, using the training data, the search query classifier to classify search queries in the second language that contain the classified one or more substrings as attempting to seek the inappropriate sensitive or offensive content. 
   
     
     
         15 . The system of  claim 14 , wherein:
 the particular type of content corresponds to child-related content;   the subset of the particular type of content corresponds to child pornography; and   the inappropriate sensitive of offensive content corresponds to images, video, and data that include child pornography.   
     
     
         16 . The system of  claim 14 , wherein obtaining the set of child-related terms in the second language based on search queries in the first language, comprises:
 obtaining a first collection of terms related to the particular type of content in the first language;   identifying, from among a collection of search queries in the first language, the search queries in the first language that include one of more of the terms related to the particular type of content; and   translating terms included in the search queries that include the one of more of the terms related to the particular type of content to terms in the second language.   
     
     
         17 . The system of  claim 14 , wherein obtaining search queries in the second language that include (i) the substring matching one or more terms related to the particular type of content in the second language and (ii) the substring in the second language related to a subset of the particular type of content, comprises:
 for each search query:
 determining a number of times that the search query is listed in a collection of search queries in the second language; and 
 determining that the number of times satisfies a first threshold. 
   
     
     
         18 . The system of  claim 14 , wherein classifying one or more substrings in the obtained search queries that include (i) the substring matching one or more terms related to the particular type of content in the second language and (ii) the substring in the second language related to the subset of the particular type of content, as being related to inappropriate sensitive or offensive content, comprises:
 generating a set of one or more substrings extracted from each of the obtained search queries;   for each substring in the set of one or more substrings:
 determining (i) a frequency of occurrence of the substring in a collection of search queries in the second language, and (ii) a frequency of occurrence of the substring in search queries in the second language that are classified as related to the subset of the particular type of content; and 
 classifying the substring as being related to inappropriate sensitive or offensive content, or not being related to inappropriate sensitive or offensive content, based at least on (i) the frequency of occurrence of the substring in the collection of search queries in the second language, and (ii) the frequency of occurrence of the substring in search queries in the second language that are classified as related to the subset of the particular type of content. 
   
     
     
         19 . The system of  claim 14 , wherein providing the classified one or more substrings as training data for training the search query classifier to classify search queries in the second language that contain the classified one or more substrings as attempting to seek the inappropriate sensitive or offensive content, comprises:
 identifying, in a collection of search queries in the second language, one or more search queries that include the one or more substrings classified as being related to inappropriate sensitive or offensive content; and   providing the identified one or more search queries as training data to the search query classifier.   
     
     
         20 . The system of  claim 14 , wherein the one or more computers are configured to perform actions further comprising:
 training the search query classifier, for a third language, to identify search queries in the third language that contain one or more substrings classified as being related to the inappropriate sensitive or offensive content based on one or more of (i) the search queries in the first language, or (ii) the training data for the second language.