Action validation for digital assistant-based applications
Abstract
Validating actions in a digital assistant-based application is provided. The system identifies an application with a conversational interface. The system selects an action from an action repository and generates, via a natural language processor, a trigger phrase for input into the application. The system executes the application to process the trigger phrase to identify an action of the application. The system identifies a parameter used by the application to execute the action, and generates, based on the parameter and via execution of the conversational interface of the application, a first query responsive to the trigger phrase. The system generates a first response to the first query for input into the application. The system determines, based on execution of the application to process the first response, a state of the application. The system evaluates the state to determine an error code and provide a notification based on the error code.
Claims
exact text as granted — not AI-modified1 .- 20 . (canceled)
21 . A system to validate actions in a digital assistant-based application, comprising:
a data processing system comprising one or more processors to: identify an application provided by an application developer device of an application developer, the application having a conversational interface and the application configured for execution with a digital component placement campaign to provide a digital component; select, for the application, an action from an action repository of the data processing system; generate, based on the action and via a natural language processor of the data processing system, a trigger phrase for input into the application; execute the application to process the trigger phrase via the conversational interface, and identify an action of the application responsive to the trigger phrase; generate, based on a parameter used by the application to execute the action and via execution of the conversational interface of the application, a first query responsive to the trigger phrase; generate, via the natural language processor, a first response to the first query for input into the application; determine, based on execution of the application to process the first response, a state of the application; and provide, to the application developer device, a notification based on the state of the application.
22 . The system of claim 21 , comprising the data processing system to:
determine the parameter used by the application comprises an electronic account identifier; generate the first query comprising a request for the electronic account identifier; and generate, via the natural language processor, the first response comprising a simulation value for the electronic account identifier.
23 . The system of claim 21 , comprising the data processing system to:
prevent the application from executing the action of the application responsive to a value provided with the first response.
24 . The system of claim 21 , comprising the data processing system to:
determine the state of the application is a termination state; evaluate the state of the application to determine a resource utilized by the application is active; and generate an error code indicating that the application failed to deactivate the resource responsive to the termination state.
25 . The system of claim 21 , comprising the data processing system to:
determine the state of the application is a termination state; detect that a sensor utilized by the application is active; and generate an error code indicating that the application failed to deactivate the sensor responsive to the termination state.
26 . The system of claim 21 , comprising the data processing system to:
generate the first response based on a model trained with historical logs comprising responses detected by microphones of computing devices.
27 . The system of claim 21 , comprising the data processing system to:
select, based on a metric associated with a model trained with historical logs, one of the model or a predetermined response repository for generation of the first query; and generate, based on the selection, the first response via the one of the model or the predetermined response repository.
28 . The system of claim 21 , comprising the data processing system to:
establish, responsive to the first response, a telecommunication channel between a virtual client device and the application; and provide, via the virtual client device and through the telecommunication channel, a second response to the application.
29 . The system of claim 21 , comprising the data processing system to:
establish, responsive to the first response, a telecommunication channel between a device associated with the application developer and a virtual client device; and provide, via the virtual client device and through the telecommunication channel, a second response to the device associated with the application developer.
30 . The system of claim 21 , comprising the data processing system to:
establish, responsive to the first response, a telecommunication channel between a device associated with the application developer and a virtual client device; detect termination of the telecommunication channel; identify, responsive to termination of the telecommunication channel, a state of a microphone of the virtual client device; and set an error code based on the state of the microphone of the virtual client device being active.
31 . The system of claim 21 , comprising the data processing system to:
generate a second response based on a semantic analysis of the first response, the first query, and the trigger phrase; and provide the second response for processing by the application executed by the data processing system.
32 . The system of claim 21 , comprising the data processing system to:
identify a virtual client account; and provide information associated with the virtual client account to the application to process the action of the application responsive to the first response.
33 . The system of claim 21 , comprising the data processing system to:
identify a virtual client account; provide information associated with the virtual client account to the application to process the action responsive to the first response; and block, responsive to detection of the virtual client account, execution of the action of the application by the application.
34 . A method of validating actions in a digital assistant-based application, comprising:
identifying, by a data processing system comprising at least one processor, an application provided by an application developer device of an application developer, the application having a conversational interface and the application configured for execution with a digital component placement campaign to provide a digital component; selecting, by the data processing system based on the application, an action from an action repository of the data processing system; generating, via a natural language processor of the data processing system and based on the action and, a trigger phrase for input into the application; executing, by the data processing system, the application to process the trigger phrase via the conversational interface; identifying, by the data processing system, an action of the application responsive to the trigger phrase; generating, by the data processing system, based on a parameter used by the application to execute the action and via execution of the conversational interface of the application, a first query responsive to the trigger phrase; generating, by the natural language processor of the data processing system, a first response to the first query for input into the application; determining, by the data processing system based on execution of the application to process the first response, a state of the application; and providing, by the data processing system to the application developer device, a notification based on the state of the application.
35 . The method of claim 34 , comprising:
determining the parameter used by the application comprises an electronic account identifier; generating the first query comprising a request for the electronic account identifier; generating, via the natural language processor, the first response comprising a simulation value for the electronic account identifier; and
36 . The method of claim 34 , comprising:
preventing the application from executing the action of the application responsive to a value provided with the first response.
37 . The method of claim 34 , comprising:
determining the state of the application is a termination state; evaluating the state of the application to determine a resource utilized by the application is active; and generating an error code indicating that the application failed to deactivate the resource responsive to the termination state.
38 . The method of claim 34 , comprising:
determining the state of the application is a termination state; detecting that a sensor utilized by the application is active; and generating an error code indicating that the application failed to deactivate the sensor responsive to the termination state.
39 . The method of claim 34 , comprising:
generating the first response based on a model trained with historical logs comprising responses detected by microphones of computing devices.
40 . The method of claim 34 , comprising:
establishing, responsive to the first response, a telecommunication channel between a virtual client device and the application; and providing, via the virtual client device and through the telecommunication channel, a second response to the application.Join the waitlist — get patent alerts
Track US2020388280A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.