Personalized situation awareness using human emotions and incident properties

Abstract

The disclosure provides systems and methods for generating and delivering situational-dependent incident responses. An incident response is generated based on incident characterizations as well as emotional data pertaining to a reporting person. The generated response may also involve an interactive component in order to obtain further situational details from the reporting person and other sources, thereby further refine the response and recommendations. Persons reporting incidents are aided by appropriate recommendations and assistance from appropriate service providers.

The invention claimed is: 
     
       1. A method comprising:
 receiving an incident report from a user device, the incident report pertaining to an incident involving a target; 
 obtaining, from at least one sensor of the user device, emotional data pertaining to a reporting person using the user device, wherein the emotional data includes at least one of heat, heartbeat, conductivity, text, speech, image, and video data; 
 processing the emotional data to determine an emotional status of the reporting person, wherein processing the emotional data includes at least one of face detection, voice/speech analytics, and text analytics; 
 processing the incident report to determine an incident type, incident category, and incident characteristic; and 
 transmitting an initiation dialog sequence to the user device, the initiation dialog sequence configured to initiate on the user device a cognitive dialog module that prompts a further interaction with the reporting person, wherein the further interaction is based at least in part on the emotional status of the reporting person and at least in part on the incident characteristics. 
 
     
     
       2. The method of  claim 1 , further comprising initiating a visible or audible alert on an emergency service provider device based at least in part on the processed incident report and at least in part on the emotional data. 
     
     
       3. The method of  claim 1 , further comprising receiving, by a system discrete from the user device, situation data pertaining to the incident, wherein the system provides the initiation dialog sequence in response to the situation data. 
     
     
       4. The method of  claim 1 , further comprising receiving, by a system discrete from the user device, situation data pertaining to the incident, wherein the situation data is from a source selected from the user device and an external source. 
     
     
       5. The method of  claim 1 , wherein the further interaction is selected from an audio interaction, a text interaction, a visual interaction, a gesture interaction, and a combination thereof. 
     
     
       6. The method of  claim 1 , wherein the further interaction is further based on identity data of the reporting person. 
     
     
       7. The method of  claim 1 , further comprising initiating the cognitive dialog module on the user device based on the initiation dialog sequence or based on an interaction pattern of the reporting person. 
     
     
       8. The method of  claim 1 , further comprising:
 initiating the cognitive dialog module on the user device based on the initiation dialog sequence; 
 receiving, by the cognitive dialog module, additional data selected from further emotional data pertaining to the reporting person and situation data; and 
 customizing the further interaction based on the additional data. 
 
     
     
       9. The method of  claim 1 , wherein the further interaction comprises communication of data and instructions with a system discrete from the user device to further customize the further interaction. 
     
     
       10. A system comprising:
 a processor; and 
 a memory coupled to the processor, the memory configured to store program instructions for instructing the processor to carry out the method of  claim 1 . 
 
     
     
       11. The system of  claim 10 , wherein the system comprises:
 a reasoning module; and 
 an advisory module. 
 
     
     
       12. The system of  claim 10 , wherein the system comprises a communications module for communicating via a network with a cognitive dialog module on a user device. 
     
     
       13. The system of  claim 10 , wherein the system comprises a communications module for communicating via a network with a cognitive dialog module on a user device, the cognitive dialog module comprising natural language processing (NLP) and visual analytics software utility configured to analyze input from the reporting person and determine a response based on the input. 
     
     
       14. The system of  claim 10 , wherein the system comprises a communications module for communicating via a network with a cognitive dialog module on a user device, the cognitive dialog module comprising a linguistics analyzer component configured to process the language, dialect, or slang of the reporting person. 
     
     
       15. A user device comprising:
 at least one sensor collecting emotional data from a reporting person, wherein the emotional data includes at least one of heat, heartbeat, text, speech, image, and video data; 
 a reasoning module implementing at least one of face detection, voice/speech analytics, and text analytics to infer an emotional status of the reporting person; 
 a communications module communicating the emotional data, the emotional status, and an incident report to a server; and 
 a cognitive dialog module implementing a metaphor generator to prompt a further interaction with the reporting person. 
 
     
     
       16. The user device of  claim 15 , wherein the cognitive dialog module implements the metaphor generator in response to an initiation dialog sequence received from the server via the communications module. 
     
     
       17. The user device of  claim 15 , wherein the further interaction is selected from an audio interaction, a text interaction, a visual interaction, a gesture interaction, and a combination thereof. 
     
     
       18. The user device of  claim 15 , wherein the further interaction is selected from a situation awareness dialog and a question and answer dialog. 
     
     
       19. The user device of  claim 15 , wherein the cognitive dialog module implements the metaphor generator in response to an interaction pattern of the reporting person. 
     
     
       20. The user device of  claim 15 , wherein the metaphor generator takes into consideration user cohort based on historical data.