Sequence dependent operation processing of packet based data message transmissions

Abstract

Optimization of sequence dependent operations in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. A prediction component can determine a thread based on the trigger keyword and the request that includes a first action, a second action subsequent to the first action, and a third action subsequent to the second action. A content selector component can select, based on the third action and the trigger keyword, a content item. An audio signal generator component can generate an output signal comprising the content item. An interface can transmit the output signal to cause a client computing device to drive a speaker to generate an acoustic wave corresponding to the output signal prior to occurrence of at least one of the first action and the second action.

What is claimed is: 
     
         1 .- 20 . (canceled) 
     
     
         21 . A system to process sequence dependent operations in a voice activated data packet based computer network environment, comprising:
 a data processing system comprising memory and one or more processors to:   receive input data packets comprising an input audio signal detected by a sensor of a client computing device;   parse the input audio signal to identify a keyword;   determine a sequence of actions based on the keyword, the sequence of actions comprising a first action, a second action subsequent to the first action, and a third action subsequent to the second action;   bypass at least one action in the sequence of actions to generate an output signal comprising a content item; and   transmit, to the client computing device, data packets comprising the output signal to cause the client computing device to drive a speaker of the client computing device to generate an acoustic wave corresponding to the output signal.   
     
     
         22 . The system of  claim 21 , comprising:
 the data processing system to bypass content selection based on the first action and the second action in order to identify the content item based at least in part on the third action.   
     
     
         23 . The system of  claim 21 , comprising:
 the data processing system to identify the content item via a real-time content selection process.   
     
     
         24 . The system of  claim 21 , comprising:
 the data processing system to identify, prior to occurrence of at least one of the first action and the second action, the content item based at least in part on the third action.   
     
     
         25 . The system of  claim 21 , comprising:
 the data processing system to transmit the output signal to the client computing device prior to occurrence of at least one of the first action and the second action.   
     
     
         26 . The system of  claim 21 , comprising:
 the data processing system to select the content item in an order that does not match the sequence of actions.   
     
     
         27 . The system of  claim 21 , wherein the data processing system is configured to initiate, perform or execute at least one of the first action, the second action and the third action in the sequence of actions. 
     
     
         28 . The system of  claim 21 , wherein the client computing device is configured to initiate, perform or execute at least one of the first action, the second action and the third action in the sequence of actions. 
     
     
         29 . The system of  claim 21 , comprising the data processing system to:
 identify a second content item subsequent to occurrence of the first action; and   transmit the second content item to cause the client computing device to present the second content item prior to occurrence of the third action.   
     
     
         30 . The system of  claim 21 , comprising the data processing system to:
 the data processing system to receive, from the client computing device a data message that includes a response to the content item prior to occurrence of at least one of the first action or the second action.   
     
     
         31 . The system of  claim 21 , comprising:
 a direct action application programming interface of the data processing system to initiate the third action subsequent to completion of at least one of the first action and the second action.   
     
     
         32 . A method of processing sequence dependent operations in a voice activated data packet based computer network environment, comprising:
 receiving, by a data processing system comprising one or more processors and memory, input data packets comprising an input audio signal detected by a sensor of a client computing device;   parsing, by the data processing system, the input audio signal to identify a keyword;   determining, by the data processing system, a sequence of actions based on the keyword, the sequence of actions comprising a first action, a second action subsequent to the first action, and a third action subsequent to the second action;   bypassing, by the data processing system, at least one action in the sequence of actions to generate an output signal comprising a content item; and   transmitting, by the data processing system to the client computing device, data packets comprising the output signal to cause the client computing device to drive a speaker of the client computing device to generate an acoustic wave corresponding to the output signal.   
     
     
         33 . The method of  claim 32 , comprising:
 bypassing, by the data processing system, content selection based on the first action and the second action in order to identify the content item based at least in part on the third action.   
     
     
         34 . The method of  claim 32 , comprising:
 identifying, by the data processing system, the content item via a real-time content selection process.   
     
     
         35 . The method of  claim 32 , comprising:
 transmitting, by the data processing system, the output signal to the client computing device prior to occurrence of at least one of the first action and the second action.   
     
     
         36 . The method of  claim 32 , comprising:
 selecting, by the data processing system, the content item in an order that does not match the sequence of actions.   
     
     
         37 . The method of  claim 32 , comprising:
 initiating, performing or executing, by the data processing system, at least one of the first action, the second action and the third action in the sequence of actions.   
     
     
         38 . The method of  claim 32 , comprising:
 identifying, by the data processing system, a second content item subsequent to occurrence of the first action; and   transmitting, by the data processing system, the second content item to cause the client computing device to present the second content item prior to occurrence of the third action.   
     
     
         39 . The method of  claim 32 , comprising:
 receiving, by the data processing system from the client computing device, a data message that includes a response to the content item prior to occurrence of at least one of the first action or the second action.   
     
     
         40 . The method of  claim 32 , comprising:
 initiating, by the data processing system, the third action subsequent to completion of at least one of the first action and the second action.