Transaction tracking and fraud detection using voice and/or video data

Abstract

A device receives recording data, for a recording of a user associated with an account, that captures the user describing a transaction. The device processes the recording data to identify one or more characteristics of an individual that described the transaction in the recording. The device determines, based on the one or more characteristics of the individual, whether the individual that described the transaction in the recording is the user associated with the account. The device causes the recording data to be stored in association with transaction data that identifies a list of transactions that are associated with the account of the user, wherein causing the recording data to be stored in association with the transaction data allows the recording to be made accessible to the user via an interface of an application used to manage the account.

1 - 20 . (canceled) 
     
     
         21 . A method, comprising:
 analyzing, by a device and based on receiving an indication that a transaction involving an account is to be processed, recording data to determine one or more transaction characteristics that describe the transaction,
 wherein the recording data includes a recording of an authorized user associated with the account describing the transaction; 
   applying, by the device, the one or more transaction characteristics as input to a risk score model;   determining, by the device, a risk score associated with the transaction based on an output of the risk score model,
 wherein the risk score model is a neural network model trained on historical transaction data including historical transaction characteristics; and 
   causing, by the device and based on the risk score meeting or exceeding a threshold, the recording data to be stored in association with transaction data that identifies a list of transactions that are associated with the account.   
     
     
         22 . The method of claim  1 , wherein causing the recording data to be stored comprises:
 causing a data structure to store the recording to enable the authorized user to search for the recording via a search feature.   
     
     
         23 . The method of claim  1 , wherein the recording captures one or more gestures associated with the authorized user. 
     
     
         24 . The method of claim  1 , further comprising:
 comparing a first dataset that identifies a set of facial characteristics of an individual, associated with the recording, with a second dataset that identifies a corresponding set of facial characteristics of the authorized user, or   comparing a third dataset that identifies the set of voice-related characteristics of the individual with a fourth dataset that identifies a corresponding set of voice-related characteristics of the authorized user.   
     
     
         25 . The method of claim  1 , further comprising:
 using machine learning to determine whether an individual associated with the recording is the authorized user.   
     
     
         26 . The method of claim  1 , further comprising:
 identifying one or more missing transaction characteristics that are not identified in the recording; and   performing one or more actions based on identifying the one or more missing transaction characteristics.   
     
     
         27 . The method of claim  1 , further comprising:
 determining to permit the transaction or prevent the transaction from being processed based on the risk score.   
     
     
         28 . A device, comprising:
 one or more memories; and   one or more processors, coupled to the one or more memories, configured to:
 analyze, based on receiving an indication that a transaction involving an account is to be processed, recording data to determine one or more transaction characteristics that describe the transaction,
 wherein the recording data includes a recording of an authorized user associated with the account describing the transaction; 
 
 apply the one or more transaction characteristics as input to a risk score model; 
 determine a risk score associated with the transaction based on an output of the risk score model,
 wherein the risk score model is a neural network model trained on historical transaction data including historical transaction characteristics; and 
 
 cause, based on the risk score meeting or exceeding a threshold, the recording data to be stored in association with transaction data that identifies a list of transactions that are associated with the account. 
   
     
     
         29 . The device of claim  8 , wherein the one or more processors, to cause the recording data to be stored, are configured to:
 cause a data structure to store the recording to enable the authorized user to search for the recording via a search feature.   
     
     
         30 . The device of claim  8 , wherein the recording captures one or more gestures associated the authorized user. 
     
     
         31 . The device of claim  8 , wherein the one or more processors are further configured to:
 compare a first dataset that identifies a set of facial characteristics of an individual, associated with the recording, with a second dataset that identifies a corresponding set of facial characteristics of the authorized user, or   compare a third dataset that identifies the set of voice-related characteristics of the individual with a fourth dataset that identifies a corresponding set of voice-related characteristics of the authorized user.   
     
     
         32 . The device of claim  8 , wherein the one or more processors are further configured to:
 use machine learning to determine whether an individual associated with transaction is the authorized user.   
     
     
         33 . The device of claim  8 , wherein the one or more processors are further configured to:
 identify one or more missing transaction characteristics that are not identified in the recording; and   perform one or more actions based on identifying the one or more missing transaction characteristics.   
     
     
         34 . The device of claim  8 , wherein the one or more processors are further configured to:
 determine to permit the transaction or prevent the transaction from being processed based on the risk score.   
     
     
         35 . A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:
 one or more instructions that, when executed by one or more processors of a device, cause the device to:
 analyze, based on receiving an indication that a transaction involving an account is to be processed, recording data to determine one or more transaction characteristics that describe the transaction,
 wherein the recording data includes a recording of an authorized user associated with the account describing the transaction; 
 
 apply the one or more transaction characteristics as input to a risk score model; 
 determine a risk score associated with the transaction based on an output of the risk score model,
 wherein the risk score model is a neural network model trained on historical transaction data including historical transaction characteristics; and 
 
 cause, based on the risk score meeting or exceeding a threshold, the recording data to be stored in association with transaction data that identifies a list of transactions that are associated with the account. 
   
     
     
         36 . The non-transitory computer-readable medium of claim  15 , wherein the one or more instructions, that cause the device to cause the recording data to be stored, cause the device to:
 cause a data structure to store the recording to enable the authorized user to search for the recording via a search feature.   
     
     
         37 . The non-transitory computer-readable medium of claim  15 , wherein the one or more instructions further cause the device to:
 compare a first dataset that identifies a set of facial characteristics of an individual, associated with the recording, with a second dataset that identifies a corresponding set of facial characteristics of the authorized user, or   compare a third dataset that identifies the set of voice-related characteristics of the individual with a fourth dataset that identifies a corresponding set of voice-related characteristics of the authorized user.   
     
     
         38 . The non-transitory computer-readable medium of claim  15 , wherein the one or more instructions further cause the device to:
 use machine learning to determine whether an individual associated with transaction is the authorized user.   
     
     
         39 . The non-transitory computer-readable medium of claim  15 , wherein the one or more instructions further cause the device to:
 identify one or more missing transaction characteristics that are not identified in the recording; and   perform one or more actions based on identifying the one or more missing transaction characteristics.   
     
     
         40 . The non-transitory computer-readable medium of claim  15 , wherein the one or more instructions further cause the device to:
 determine to permit the transaction or prevent the transaction from being processed based on the risk score.