System and method for using speech for data searching during presentations

Abstract

There is provided for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. A method for the retrieval of information on the basis of its content for real-time incorporation into an electronic presentation is discussed. One method includes controlling a media presentation using a multimodal interface. The method involves receiving from a presenter a content-based request associated with a plurality of segments within a media presentation preprocessed for context-based searching; displaying the media presentation and displaying to the presenter results in response to the content-based request; receiving a selection from the presenter of at least one result; and displaying the selected result to an audience.

We claim: 
     
         1 . A method comprising:
 transmitting, from a first device, a current segment of a media presentation to a second device;   displaying, on the first device, a current segment of a media presentation and a search result set in response to a query, the search result set comprising a portion of a plurality of segments within the media presentation, the search result set not being transmitted to the second device;   receiving, via input from a user, a selection from the search result set, to yield a selected segment; and   transmitting the selected segment to the second device for display, the selected segment replacing a current segment being displayed on the second device.   
     
     
         2 . The method of  claim 1 , wherein the search result set is obtained from a network. 
     
     
         3 . The method of  claim 1 , wherein each of the plurality of segments further comprises a string of text. 
     
     
         4 . The method of  claim 1 , further comprising:
 receiving, at the first device, the query to search the plurality of segments within the media presentation, wherein the query is related to text associated with the plurality of segments.   
     
     
         5 . The method of  claim 4 , wherein the text comprises one of text within the segment, file names, metadata, presenter notes, and words describing non-text content. 
     
     
         6 . The method of  claim 1 , wherein the media presentation is processed by extracting text and using linguistics associated with the text for content-based searching. 
     
     
         7 . The method of  claim 4 , wherein the query is distinguishable from other vocalizations of a presenter by way of a speech control initiation. 
     
     
         8 . The method of  claim 1 , wherein the media presentation is processed via an n-gram analysis of the plurality of segments. 
     
     
         9 . A system comprising:
 a processor; and   a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:
 transmitting, from a first device, a current segment of a media presentation to a second device; 
 displaying, on a first device, a current segment of a media presentation and a search result set in response to a query, the search result set comprising a portion of a plurality of segments within the media presentation, the search result set not being transmitted to the second device; 
 receiving, via input from a user, a selection from the search result set, to yield a selected segment; and 
 transmitting the selected segment to a second device for display, the selected segment replacing a current segment being displayed on the second device. 
   
     
     
         10 . The system of  claim 9 , wherein the search result set is obtained from a network. 
     
     
         11 . The system of  claim 9 , wherein each of the plurality of segments further comprises a string of text. 
     
     
         12 . The system of  claim 9 , the computer-readable storage medium having instructions storing additional which, when executed by the processor, cause the processor to perform further operations comprising:
 receiving, at the first device, the query to search the plurality of segments within the media presentation, wherein the query is associated with content comprising text associated with the plurality of segments.   
     
     
         13 . The system of  claim 12 , wherein the text comprises one of text within the segment, file names, metadata, presenter notes, and words describing non-text content. 
     
     
         14 . The system of  claim 9 , wherein the media presentation is processed by extracting text and using linguistics associated with the text for content-based searching. 
     
     
         15 . The system of  claim 9 , wherein the query is a spoken command. 
     
     
         16 . A non-transitory computer-readable storage device having instructions stored which, when executed by a processor, cause the processor to perform operations comprising:
 transmitting, from a first device, a current segment of a media presentation to a second device;   displaying, on a first device, a current segment of a media presentation and a search result set in response to a query, the search result set comprising a portion of a plurality of segments within the media presentation, the search result set not being transmitted to the second device;   receiving, via input from a user, a selection from the search result set, to yield a selected segment; and   transmitting the selected segment to a second device for display, the selected segment replacing a current segment being displayed on the second device.   
     
     
         17 . The non-transitory computer-readable storage device of  claim 16 , wherein the search result set is obtained from a network. 
     
     
         18 . The non-transitory computer-readable storage device of  claim 19 , wherein each of the plurality of segments further comprises a string of text. 
     
     
         19 . The non-transitory computer-readable storage device of  claim 16 , non-transitory computer-readable storage device storing additional instructions stored which, when executed by the processor, cause the processor to perform further operations comprising:
 receiving, at the first device, the query to search the plurality of segments within the media presentation, wherein the query is associated with content comprising text associated with the plurality of segments.   
     
     
         20 . The non-transitory computer-readable storage device of  claim 19 , wherein the text comprises one of text within the segment, file names, metadata, presenter notes, and words describing non-text content.