US2020388280A1PendingUtilityA1

Action validation for digital assistant-based applications

Assignee: GOOGLE LLCPriority: Jun 5, 2019Filed: Jun 8, 2020Published: Dec 10, 2020
Est. expiryJun 5, 2039(~12.9 yrs left)· nominal 20-yr term from priority
G06F 11/3698G06F 11/0769G06F 9/455G06F 3/167G10L 15/22G10L 2015/223G06F 9/453G10L 2015/225G06F 16/24565G06F 16/243G06F 11/3692G06F 11/366
57
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Validating actions in a digital assistant-based application is provided. The system identifies an application with a conversational interface. The system selects an action from an action repository and generates, via a natural language processor, a trigger phrase for input into the application. The system executes the application to process the trigger phrase to identify an action of the application. The system identifies a parameter used by the application to execute the action, and generates, based on the parameter and via execution of the conversational interface of the application, a first query responsive to the trigger phrase. The system generates a first response to the first query for input into the application. The system determines, based on execution of the application to process the first response, a state of the application. The system evaluates the state to determine an error code and provide a notification based on the error code.

Claims

exact text as granted — not AI-modified
1 .- 20 . (canceled) 
     
     
         21 . A system to validate actions in a digital assistant-based application, comprising:
 a data processing system comprising one or more processors to:   identify an application provided by an application developer device of an application developer, the application having a conversational interface and the application configured for execution with a digital component placement campaign to provide a digital component;   select, for the application, an action from an action repository of the data processing system;   generate, based on the action and via a natural language processor of the data processing system, a trigger phrase for input into the application;   execute the application to process the trigger phrase via the conversational interface, and identify an action of the application responsive to the trigger phrase;   generate, based on a parameter used by the application to execute the action and via execution of the conversational interface of the application, a first query responsive to the trigger phrase;   generate, via the natural language processor, a first response to the first query for input into the application;   determine, based on execution of the application to process the first response, a state of the application; and   provide, to the application developer device, a notification based on the state of the application.   
     
     
         22 . The system of  claim 21 , comprising the data processing system to:
 determine the parameter used by the application comprises an electronic account identifier;   generate the first query comprising a request for the electronic account identifier; and   generate, via the natural language processor, the first response comprising a simulation value for the electronic account identifier.   
     
     
         23 . The system of  claim 21 , comprising the data processing system to:
 prevent the application from executing the action of the application responsive to a value provided with the first response.   
     
     
         24 . The system of  claim 21 , comprising the data processing system to:
 determine the state of the application is a termination state;   evaluate the state of the application to determine a resource utilized by the application is active; and   generate an error code indicating that the application failed to deactivate the resource responsive to the termination state.   
     
     
         25 . The system of  claim 21 , comprising the data processing system to:
 determine the state of the application is a termination state;   detect that a sensor utilized by the application is active; and   generate an error code indicating that the application failed to deactivate the sensor responsive to the termination state.   
     
     
         26 . The system of  claim 21 , comprising the data processing system to:
 generate the first response based on a model trained with historical logs comprising responses detected by microphones of computing devices.   
     
     
         27 . The system of  claim 21 , comprising the data processing system to:
 select, based on a metric associated with a model trained with historical logs, one of the model or a predetermined response repository for generation of the first query; and   generate, based on the selection, the first response via the one of the model or the predetermined response repository.   
     
     
         28 . The system of  claim 21 , comprising the data processing system to:
 establish, responsive to the first response, a telecommunication channel between a virtual client device and the application; and   provide, via the virtual client device and through the telecommunication channel, a second response to the application.   
     
     
         29 . The system of  claim 21 , comprising the data processing system to:
 establish, responsive to the first response, a telecommunication channel between a device associated with the application developer and a virtual client device; and   provide, via the virtual client device and through the telecommunication channel, a second response to the device associated with the application developer.   
     
     
         30 . The system of  claim 21 , comprising the data processing system to:
 establish, responsive to the first response, a telecommunication channel between a device associated with the application developer and a virtual client device;   detect termination of the telecommunication channel;   identify, responsive to termination of the telecommunication channel, a state of a microphone of the virtual client device; and   set an error code based on the state of the microphone of the virtual client device being active.   
     
     
         31 . The system of  claim 21 , comprising the data processing system to:
 generate a second response based on a semantic analysis of the first response, the first query, and the trigger phrase; and   provide the second response for processing by the application executed by the data processing system.   
     
     
         32 . The system of  claim 21 , comprising the data processing system to:
 identify a virtual client account; and   provide information associated with the virtual client account to the application to process the action of the application responsive to the first response.   
     
     
         33 . The system of  claim 21 , comprising the data processing system to:
 identify a virtual client account;   provide information associated with the virtual client account to the application to process the action responsive to the first response; and   block, responsive to detection of the virtual client account, execution of the action of the application by the application.   
     
     
         34 . A method of validating actions in a digital assistant-based application, comprising:
 identifying, by a data processing system comprising at least one processor, an application provided by an application developer device of an application developer, the application having a conversational interface and the application configured for execution with a digital component placement campaign to provide a digital component;   selecting, by the data processing system based on the application, an action from an action repository of the data processing system;   generating, via a natural language processor of the data processing system and based on the action and, a trigger phrase for input into the application;   executing, by the data processing system, the application to process the trigger phrase via the conversational interface;   identifying, by the data processing system, an action of the application responsive to the trigger phrase;   generating, by the data processing system, based on a parameter used by the application to execute the action and via execution of the conversational interface of the application, a first query responsive to the trigger phrase;   generating, by the natural language processor of the data processing system, a first response to the first query for input into the application;   determining, by the data processing system based on execution of the application to process the first response, a state of the application; and   providing, by the data processing system to the application developer device, a notification based on the state of the application.   
     
     
         35 . The method of  claim 34 , comprising:
 determining the parameter used by the application comprises an electronic account identifier;   generating the first query comprising a request for the electronic account identifier;   generating, via the natural language processor, the first response comprising a simulation value for the electronic account identifier; and   
     
     
         36 . The method of  claim 34 , comprising:
 preventing the application from executing the action of the application responsive to a value provided with the first response.   
     
     
         37 . The method of  claim 34 , comprising:
 determining the state of the application is a termination state;   evaluating the state of the application to determine a resource utilized by the application is active; and   generating an error code indicating that the application failed to deactivate the resource responsive to the termination state.   
     
     
         38 . The method of  claim 34 , comprising:
 determining the state of the application is a termination state;   detecting that a sensor utilized by the application is active; and   generating an error code indicating that the application failed to deactivate the sensor responsive to the termination state.   
     
     
         39 . The method of  claim 34 , comprising:
 generating the first response based on a model trained with historical logs comprising responses detected by microphones of computing devices.   
     
     
         40 . The method of  claim 34 , comprising:
 establishing, responsive to the first response, a telecommunication channel between a virtual client device and the application; and   providing, via the virtual client device and through the telecommunication channel, a second response to the application.

Join the waitlist — get patent alerts

Track US2020388280A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.