Sequence dependent data message consolidation in a voice activated computer network environment

Abstract

Systems and methods to combine multiple voice activated audio input data packets that indicate sequence dependent operations are provided. A natural language processor component can receive first and second input audio signal from a client computing device, and can identify respective requests and corresponding trigger keywords. A direct action application programming interface (“API”) can generate respective action data structures, and can construct respective data transmissions including the respective action data structures. A thread optimization component can obtain data packets of the first data transmission, and can obtain data packets of the second data transmission. The thread optimization component can determine, based on a heuristic technique applied to the data packets of the respective data transmissions a sequence dependency parameter. The thread optimization component can merge, based on a comparison of the sequence dependency parameter with a threshold, the first and second data transmissions into a single thread.

What is claimed is: 
     
         1 .- 20 . (canceled) 
     
     
         21 . A system to perform sequence dependent operations in a voice-based computing environment, comprising:
 a data processing system comprising memory and one or more processors to:   receive data packets comprising one or more input audio signals detected by a sensor of a client computing device;   parse the one or more input audio signals to identify one or more requests and one or more keywords corresponding to the one or more requests;   generate, based on the one or more keywords, a first action data structure and a second action data structure;   determine a sequence dependency parameter for the first action data structure and the second action data structure;   combine, based on the sequence dependency parameter, the first action data structure and the second action data structure into a single thread comprising a series of sequence dependent actions;   select a content item for at least one action in the series of sequence dependent actions; and   provide the content item to the client computing device.   
     
     
         22 . The system of  claim 21 , comprising:
 the data processing system to combine, based on a comparison of the sequence dependency parameter with a threshold, the first action data structure and the second action data structure into the single thread.   
     
     
         23 . The system of  claim 21 , comprising the data processing system to:
 construct a first data transmission including the first action data structure to establish a first communication session between a first service provider computing device and the client computing device.   
     
     
         24 . The system of  claim 23 , comprising:
 the data processing system to merge, based on a comparison of the sequence dependency parameter with a threshold, the first data transmission with a second data transmission of the second action data structure into the single thread.   
     
     
         25 . The system of  claim 21 , comprising the data processing system to:
 generate the first action data structure responsive to receipt of a first input audio signal of the one or more input audio signals; and   generate the second action data structure responsive to receipt of a second input audio signal of the one or more input audio signals.   
     
     
         26 . The system of  claim 21 , comprising:
 the data processing system to generate the first action data structure and the second action data structure based on a first input audio signal of the one or more input audio signals.   
     
     
         27 . The system of  claim 21 , comprising the data processing system to:
 establish, responsive to the first action data structure, a first communication session between a first service provider computing device and the client computing device; and   establish, responsive to the second action data structure, a second communication session between a second service provider computing device and the client computing device.   
     
     
         28 . The system of  claim 21 , comprising the data processing system to:
 detect a completion of a first action of the first action data structure; and   transmit data packets of the single thread to a service provider computing device subsequent to the completion of the first action, wherein the single thread indicates that the first action is scheduled to occur prior to a second action of the second action data structure.   
     
     
         29 . The system of  claim 21 , wherein the sequence dependency parameter indicates that an action corresponding to the first action data structure is scheduled to occur prior to an action corresponding to the second action data structure. 
     
     
         30 . The system of  claim 21 , comprising the data processing system to:
 identify a condition associated with the second action data structure based on a time associated with the first action data structure; and   prevent transmission of data packets of the second action data structure to a service provider computing device responsive to the condition.   
     
     
         31 . The system of  claim 21 , wherein the single thread indicates the series of sequence dependent actions for the single thread, the series of sequence dependent actions including a first action, a second action subsequent to the first action, and a third action subsequent to the second action. 
     
     
         32 . A method of performing sequence dependent operations in a voice-based computing environment, comprising:
 receiving, by one or more processors, data packets comprising one or more input audio signals detected by a sensor of a client computing device;   parsing, by the one or more processors, the one or more input audio signals to identify one or more requests and one or more keywords corresponding to the one or more requests;   generating, by the one or more processors, based on the one or more keywords, a first action data structure and a second action data structure;   determining, by the one or more processors, a sequence dependency parameter for the first action data structure and the second action data structure;   combining, by the one or more processors based on the sequence dependency parameter, the first action data structure and the second action data structure into a single thread comprising a series of sequence dependent actions;   selecting, by the one or more processors, a content item for at least one action in the series of sequence dependent actions; and   providing, by the one or more processors, the content item to the client computing device.   
     
     
         33 . The method of  claim 32 , comprising:
 combining, by the one or more processors based on a comparison of the sequence dependency parameter with a threshold, the first action data structure and the second action data structure into the single thread.   
     
     
         34 . The method of  claim 32 , comprising:
 constructing, by the one or more processors, a first data transmission including the first action data structure to establish a first communication session between a first service provider computing device and the client computing device.   
     
     
         35 . The method of  claim 34 , comprising:
 merging, by the one or more processors, based on a comparison of the sequence dependency parameter with a threshold, the first data transmission with a second data transmission of the second action data structure into the single thread.   
     
     
         36 . The method of  claim 32 , comprising:
 generating, by the one or more processors, the first action data structure responsive to receipt of a first input audio signal of the one or more input audio signals; and   generating, by the one or more processors, the second action data structure responsive to receipt of a second input audio signal of the one or more input audio signals.   
     
     
         37 . The method of  claim 32 , comprising:
 generating, by the one or more processors, the first action data structure and the second action data structure based on a first input audio signal of the one or more input audio signals.   
     
     
         38 . The method of  claim 32 , comprising:
 establishing, by the one or more processors, responsive to the first action data structure, a first communication session between a first service provider computing device and the client computing device; and   establishing, by the one or more processors, responsive to the second action data structure, a second communication session between a second service provider computing device and the client computing device.   
     
     
         39 . The method of  claim 32 , comprising:
 detecting, by the one or more processors, a completion of a first action of the first action data structure; and   transmitting, by the one or more processors, data packets of the single thread to a service provider computing device subsequent to the completion of the first action, wherein the single thread indicates that the first action is scheduled to occur prior to a second action of the second action data structure.   
     
     
         40 . The method of  claim 32 , wherein the sequence dependency parameter indicates that an action corresponding to the first action data structure is scheduled to occur prior to an action corresponding to the second action data structure.