Automated augmentation of text, web and physical environments using multimedia content

Abstract

Provided is an example method for automated augmentation of text, web and physical environments using multimedia content. The method may comprise determining that a user device displays a portion of the text document in a predetermined format, analyzing the portion of the text document to generate one or more keywords, generating, based on the one or more keywords, at least one search query for a multimedia content search via a search engine, retrieving, from one or more data storages, one or more pieces of multimedia associated with the one or more keywords, and enabling the user device to display the one or more pieces of multimedia concurrently with the portion of the text document, wherein the one or more pieces of multimedia are displayed on the user device according to predetermined user settings.

What is claimed is: 
     
         1 . A computer-implemented method for automated augmentation of text, web and physical environments using multimedia content, the method comprising:
 determining that a user device displays a portion of the text document in a predetermined format;   analyzing the portion of the text document to generate one or more keywords;   generating, based on the one or more keywords, at least one search query for a multimedia content search via a search engine;   retrieving, from one or more data storages, one or more pieces of multimedia associated with the one or more keywords; and   enabling the user device to display the one or more pieces of multimedia concurrently with the portion of the text document, wherein the one or more pieces of multimedia are displayed on the user device according to predetermined user settings.   
     
     
         2 . The method of  claim 1 , wherein the analyzing of the portion of the text document to generate the one or more keywords includes:
 parsing the portion of the text document;   identifying terms that start with an uppercase letter;   identifying terms related to contextual data; and   identifying sentences that contain multiple contextual data to be used as keyword combinations.   
     
     
         3 . The method of  claim 1 , wherein the analysis of the portion of the text document to generate the one or more keywords is carried out on a remote web server. 
     
     
         4 . The method of  claim 1 , wherein the displayable text document is a user-generated presentation or essay. 
     
     
         5 . The method of  claim 1 , wherein the one or more keywords are predetermined by the user and stored in the keywords database. 
     
     
         6 . The method of  claim 1 , further comprising adding, to the portion of the text document, hyperlinks to web resources related to the one or more keywords. 
     
     
         7 . The method of  claim 1 , further comprising applying an optical character recognition to process an image containing text to generate the one or more keywords. 
     
     
         8 . The method of  claim 1 , wherein the data storage includes one or more of the following: a remote database, a web site, a local database, and a cache of the user device. 
     
     
         9 . The method of  claim 1 , wherein the search engine includes one or more of the following: a third party image search engine, a web search engine, and a local search engine embedded within the user device. 
     
     
         10 . The method of  claim 1 , further comprising storing the pieces of multimedia associated with the one or more keywords to a local or remote data storage. 
     
     
         11 . The method of  claim 1 , further comprising generating one or more unique identifiers associated with a piece of multimedia and the one or more keywords associated with the piece of multimedia, wherein the one or more unique identifiers are stored in the local or remote data storage along with the piece of multimedia and the one or more keywords. 
     
     
         12 . The method of  claim 1 , wherein the predetermined user settings include one or more of the following: a first number of displayable pieces of multimedia per a portion of the text document, a second number of the displayable pieces of multimedia per a slideshow, types of the displayable pieces of multimedia, a size of the user device screen allocated for displaying the pieces of multimedia, a number of slideshows, and a grid style used for arrangement of multiple pieces of multimedia on the user device screen. 
     
     
         13 . The method of  claim 1 , wherein the pieces of multimedia are displayed dynamically depending on a currently displayable portion of the text document. 
     
     
         14 . The method of  claim 1 , further comprising sharing the text, to which multimedia content has been added, or individual pieces of multimedia via a social network. 
     
     
         15 . A system for automated augmentation of text, web and physical environments using multimedia content, the system comprising:
 a determining module configured to determine whether a user device displays a portion of the text document in a predetermined format;   an analyzing module configured to analyze the portion of the text document to generate one or more keywords;   a search query generator configured to generate, based on the one or more keywords, at least one search query for a multimedia content search via a search engine;   a retrieving module configured to retrieve, from one or more data storages, one or more pieces of multimedia associated with the one or more keywords; and   a displaying module configured to enable the user device to display the one or more pieces of multimedia concurrently with the portion of the text document, wherein the one or more pieces of multimedia are displayed on the user device according to predetermined user settings.   
     
     
         16 . The system of  claim 15 , wherein the analyzing module is further configured to:
 parse the portion of the text document;   identify terms that start with an uppercase letter;   identify terms that constitute contextual data; and   identify sentences that contain multiple contextual data to be used as keyword combinations.   
     
     
         17 . The system of  claim 15 , wherein the displaying module is further configured to add to the portion of the text document hyperlinks to web resources related to the one or more keywords. 
     
     
         18 . The system of  claim 15 , further comprising an optical character recognition module configured to process an image containing text to generate the one or more keywords. 
     
     
         19 . The system of  claim 15 , wherein the one or more pieces of multimedia are displayed dynamically depending on a currently displayable portion of the text document. 
     
     
         20 . A computer-readable medium having instructions stored thereon, which when executed by one or more computers, causes the one or more computers to:
 determine that a user device displays a portion of the text document in a predetermined format;   analyze the portion of the text document to generate one or more keywords;   generate, based on the one or more keywords, at least one search query for a multimedia content search via a search engine;   retrieve, from one or more data storages, one or more pieces of multimedia associated with the one or more keywords; and   enable the user device to display the one or more pieces of multimedia concurrently with the portion of the text document, wherein the one or more pieces of multimedia are displayed in the user device according to predetermined user settings.