Method of and system for real time feedback in an incremental speech input interface

Abstract

The present disclosure provides systems and methods for selecting and presenting content items based on user input. The method includes receiving first input intended to identify a desired content item among content items associated with metadata, determining that an input portion has an importance measure exceeding a threshold, and providing feedback identifying the input portion. The method further includes receiving second input, and inferring user intent to alter or supplement the first input with the second input. The method further includes, upon inferring intent to alter the first input, determining an alternative query by modifying the first input based on the second input, and, upon inferring intent to supplement the first input, determining an alternative query by combining the first input and the second input. The method further includes selecting and presenting a subset of content items based on comparing the alternative query and metadata associated with the subset.

What is claimed is: 
     
         1 - 20 . (canceled) 
     
     
         21 . A computer-implemented method for selecting and presenting content items based on user input, the method comprising:
 providing access to a plurality of content items;   beginning to receive of a voice input intended by the user to identify at least one desired content item;   determining, prior to receiving the completed voice input, that a portion of the voice input has a measure of importance that exceeds a threshold value;   selecting a content item from the plurality of content items;   interrupting receipt of the voice input; and   presenting the selected content item to the user.   
     
     
         22 . The method of  claim 21  wherein each of the plurality of content items is associated with metadata that describes a corresponding content item 
     
     
         23 . The method of  claim 22  wherein selecting a content item from the plurality of content items further comprises comparing the portion of the voice input with the metadata of each of the plurality of the content item. 
     
     
         24 . The method of  claim 21  further comprising presenting the selected content item to the user prior to receiving the completed voice input upon a determination of a strong recognition match for the voice input and upon determination that a responsiveness measure of the selected content item of the plurality of content items would be above a threshold. 
     
     
         25 . The method of  claim 21  further comprising providing a feedback response prior to receiving the completed voice input based on a count of nodes in a graph data structure, wherein the count of nodes in the graph data structure measures a path between a first node representing an item of interest from a previous conversational interaction and a second node representing the portion of the voice input. 
     
     
         26 . The method of  claim 21  further comprising providing a feedback response prior to receiving the completed voice input based on a duration of an identified disfluency in the portion of the voice input. 
     
     
         27 . The method of  claim 21  further comprising providing a feedback response prior to receiving the completed voice output based on a count of ambiguities detected in the portion of the voice input. 
     
     
         28 . The method of  claim 21  further comprising providing a feedback response prior to receiving the completed voice input based on a count of error corrections needed to identify the portion of the voice input. 
     
     
         29 . The method of  claim 21  further comprising providing a feedback response prior to receiving the completed voice input based on a measure of confidence in correct speech-to-text recognition of the portion of the voice input. 
     
     
         30 . The method of  claim 21  further comprising providing a feedback response prior to receiving the completed voice input, wherein the feedback response is one of an audio, visual or combinations thereof. 
     
     
         31 . A system for selecting and presenting content items based on user input, the system comprising:
 computer readable instructions encoded on a non-transitory computer readable medium, the computer readable instructions causing the computer system to be configured to:
 beginning to receive of a voice input intended by the user to identify at least one desired content item; 
 determine, prior to receiving the completed voice input, that a portion of the voice input has a measure of importance that exceeds a threshold value; 
 select a content item from the plurality of content items; 
 interrupt receipt of the voice input; and 
 present the selected content item to the user. 
   
     
     
         32 . The system of  claim 31  wherein each of the plurality of content items is associated with metadata that describes a corresponding content item 
     
     
         33 . The system of  claim 32  wherein the computer readable instructions cause the computer system, when selecting a content item from the plurality of content items, to compare the portion of the voice input with the metadata of each of the plurality of the content item. 
     
     
         34 . The method of  claim 31  wherein the computer-readable instructions causing the system to be configured to present the selected content item to the user prior to receiving the completed voice input upon a determination of a strong recognition match for the voice input and upon determination that a responsiveness measure of the selected content item of the plurality of content items would be above a threshold. 
     
     
         35 . The method of  claim 31  wherein the computer-readable instructions causing the system to be configured to provide a feedback response prior to receiving the completed voice input based on a count of nodes in a graph data structure, wherein the count of nodes in the graph data structure measures a path between a first node representing an item of interest from a previous conversational interaction and a second node representing the portion of the voice input. 
     
     
         36 . The method of  claim 31  wherein the computer-readable instructions causing the system to be configured to provide a feedback response prior to receiving the completed voice input based on a duration of an identified disfluency in the portion of the voice input. 
     
     
         37 . The method of  claim 31  wherein the computer-readable instructions causing the system to be configured to provide a feedback response prior to receiving the completed voice output based on a count of ambiguities detected in the portion of the voice input. 
     
     
         38 . The method of  claim 31  wherein the computer-readable instructions causing the system to be configured to provide a feedback response prior to receiving the completed voice input based on a count of error corrections needed to identify the portion of the voice input. 
     
     
         39 . The method of  claim 31  wherein the computer-readable instructions causing the system to be configured to provide a feedback response prior to receiving the completed voice input based on a measure of confidence in correct speech-to-text recognition of the portion of the voice input. 
     
     
         40 . The method of  claim 31  wherein the computer-readable instructions causing the system to be configured to provide a feedback response prior to receiving the completed voice input, wherein the feedback response is one of an audio, visual or combinations thereof.