Searching based on audio and/or visual features of documents

Abstract

One or more computer devices may generate a keyword based on a visual feature or an audible feature of a document. The visual feature may include a color of a background of the document, a color of text in the document, a size of the text in the document, or a feature relating to a video in the document. The audible feature may relate to sound or music that is associated with the document. The one or more computer devices may further associate, in an index, the keyword with information identifying the document, receive a search query from a client, the search query including a term related to the keyword, identify documents based on the search query and using the index, the identified documents including the document, and provide a search results document to the client. The search results document may identify one or more of the identified documents.

1 - 20 . (canceled) 
     
     
         21 . A system comprising:
 one or more computer devices to:
 generate a keyword for a document based on a visual appearance of the document when the document is rendered for display,
 the visual appearance excluding textual content of the document; 
 
 associate, in an index, the keyword with information identifying the document; 
 receive a search query,
 the search query including a term related to the keyword; 
 
 identify documents based on the search query and using the index,
 the identified documents including the document; and 
 
 provide a search results document for display,
 the search results document identifying one or more of the identified documents. 
 
   
     
     
         22 . The system of  claim 21 , where, when generating the keyword, the one or more computer devices are to:
 identify a color of a background of the document; and   generate the keyword based on the color,
 where the keyword identifies the color and that the color is associated with the background of the document. 
   
     
     
         23 . The system of  claim 21 , where, when generating the keyword, the one or more computer devices are to:
 identify a color of text in the document when the document is rendered for display or a size of the text in the document when the document is rendered for display; and   generate the keyword based on the color of the text or the size of the text,
 where the keyword indicates the identified color or the identified size and indicates that the identified color or the identified size is associated with the text in the document. 
   
     
     
         24 . The system of  claim 21 , where, when generating the keyword, the one or more computer devices are to:
 identify an object in an image in the document or a quantity of images in the document; and   generate the keyword based on the object or the quantity of images,
 where the keyword identifies:
 the object and that the object is in the image in the document, or 
 the quantity of images. 
 
   
     
     
         25 . The system of  claim 21 , where, when generating the keyword, the one or more computer devices are to:
 analyze hypertext markup language (HTML) code corresponding to the document; and   generate the keyword based on analyzing the HTML code.   
     
     
         26 . The system of  claim 21 , where the one or more computer devices are further to:
 generate another keyword based on an audible feature of the document,
 where the audible feature corresponds to:
 an indication of whether a sound is generated when the document is rendered for display, 
 an indication of whether music is generated when the document is rendered for display, 
 a name of music that is generated when the document is rendered for display, or 
 a name of an artist that is associated with music that is generated when the document is rendered for display; 
 
   associate, in the index, the other keyword with the information identifying the document;   receive another search query,
 where the other search query includes another term related to the other keyword; 
   identify other documents based on the other search query and using the index,
 where the identified other documents include the document; and 
   provide another search results document,
 where the other search results document identifies one or more of the identified other documents. 
   
     
     
         27 . The system of  claim 26 , where, when generating the other keyword, the one or more computer devices are to:
 obtain an audio file corresponding to the audible feature;   obtain information based on analyzing the audio file; and   generate the other keyword based on the obtained information.   
     
     
         28 . A computer-readable medium for storing instructions, the instructions comprising:
 one or more instructions, which when executed by one or more processors, cause the one or more processors to:
 associate, in an index, keywords with information identifying a document,
 the keywords representing different features of a visual appearance of the document when the document is rendered for display, 
 the different features corresponding to two or more of:
 a color of a background of the document when the document is rendered for display, 
 a color of text in the document when the document is rendered for display, 
 a size of the text in the document when the document is rendered for display, 
 a length of the document when the document is rendered for display, 
 a style of the document when the document is rendered for display, 
 a feature relating to an image in the document when the document is rendered for display, or 
 a feature relating to a video in the document when the document is rendered for display, 
 
 
   receive a search query; and   use the index to determine whether the document is related to the received search query.   
     
     
         29 . The computer-readable medium of  claim 28 , where the one or more instructions to associate the keywords with the information identifying the document include:
 one or more instructions to analyze hypertext markup language (HTML) code associated with the document; and   one or more instructions to generate at least one keyword, of the keywords, based on analyzing the HTML code.   
     
     
         30 . The computer-readable medium of  claim 28 , where the one or more instructions to associate the keywords with the information identifying the document include:
 one or more instructions to render the document; and   one or more instructions to generate at least one keyword, of the keywords, based on rendering the document.   
     
     
         31 . The computer-readable medium of  claim 28 , where the different features include the feature relating to the image in the document, and
 where the one or more instructions to associate the keywords with the information identifying the document include:
 one or more instructions to obtain the image, 
 one or more instructions to obtain information from the obtained image, and 
 one or more instructions to generate at least one keyword, of the keywords, based on the obtained information. 
   
     
     
         32 . The computer-readable medium of  claim 28 , where the instructions further include:
 one or more instructions to generate at least one other keyword based on an audible feature of the document,
 where the audible feature corresponds to at least one of:
 an indication of whether a sound is generated when the document is rendered for display, 
 an indication of whether music is generated when the document is rendered for display, 
 a name of music that is generated when the document is rendered for display, or 
 a name of an artist that is associated with music that is generated when the document is rendered for display, 
 
   one or more instructions to associate, in the index, the at least one other keyword with the information identifying the document,   one or more instructions to receive another search query,
 where the other search query includes a term related to the at least one other keyword, and 
   one or more instructions to use the index to determine that the document is related to the other search query.   
     
     
         33 . The computer-readable medium of  claim 32 , where the one or more instructions to generate the at least one other keyword include:
 one or more instructions to obtain an audio file corresponding to the audible feature;   one or more instructions to obtain information based on analyzing the audio file; and   one or more instructions to generate the at least one other keyword based on the obtained information.   
     
     
         34 . A method comprising:
 receiving, by one or more processors, a search query,
 the search query including a term related to a keyword,
 the keyword being generated based on a visual appearance of a document when the document is rendered for display, 
 the keyword being associated, in an index, with information identifying the document, 
 the visual appearance corresponding to:
 a color of a background of the document when the document is rendered for display, 
 a color of text in the document when the document is rendered for display, or 
 a size of the text in the document when the document is rendered for display; 
 
 
   identifying, by the one or more processors, documents based on the search query and using the index,
 the identified documents including the document; and 
   providing, by the one or more processors, a search results document for display,
 the search results document identifying one or more of the identified documents. 
   
     
     
         35 . The method of  claim 34 , further comprising:
 analyzing hypertext markup language (HTML) code corresponding to the document; and   generating the keyword based on analyzing the HTML code.   
     
     
         36 . The method of  claim 34 , further comprising:
 receiving another search query,
 where the other search query includes a term related to another keyword,
 the other keyword being associated, in the index, with the information identifying the document 
 the other keyword being based on an audible feature of the document, 
 the audible feature corresponding to:
 a name of music that is generated when the document is rendered for display, or 
 a name of an artist that is associated with music that is generated when the document is rendered for display; 
 
 
   identifying one or more documents based on the other search query and using the index,
 where the identified one or more documents include the document; and 
   providing the identified one or more documents for display.   
     
     
         37 . The method of  claim 36 , further comprising:
 obtaining an audio file corresponding to the audible feature;   obtaining information based on analyzing the audio file; and   generating the other keyword based on the obtained information.   
     
     
         38 . The method of  claim 34 , further comprising:
 rendering the document; and   generating the keyword based on rendering the document.   
     
     
         39 . The method of  claim 34 , further comprising:
 generating another keyword based on another visual appearance of the document when the document is rendered for display,
 the other visual appearance corresponding to one of:
 a length of the document when the document is rendered for display, 
 a style of the document when the document is rendered for display, or 
 a feature relating to an image in the document when the document is rendered for display; and 
 
   associating, in the index, the other keyword with the information identifying the document,
 where the search query further includes another term that relates to the other keyword. 
   
     
     
         40 . The method of  claim 34 , further comprising:
 generating another keyword based on an audible feature of the document,
 the audible feature corresponding to:
 an indication of whether a sound is generated when the document is rendered for display, or 
 an indication of whether music is generated when the document is rendered for display; and 
 
   associating, in the index, the other keyword with the information identifying the document,
 where the search query further includes another term that relates to the other keyword.