Video content analysis using point of sale data

Abstract

In an embodiment, a method of performing video content analysis using transactional data is provided. The method comprises identifying and receiving the transactional data and a segment of video corresponding to a transaction, integrating the transactional data with the segment of video, and analyzing the integrated video to determine an action to take in relation to the transaction.

1 . A method for determining an employee's compliance to a policy, the method comprising:
 receiving video of transactions at a point-of-sale (POS) terminal operated by the employee;   receiving transactional data from the POS terminal, the transactional data corresponding to the transactions at the POS terminal;   integrating the video with the transactional data to obtain video segments corresponding to transactions;   identifying, based on the transactional data, video segments corresponding to transactions for which the employee is required to take an action to comply with a policy;   analyzing the identified video segments to determine the employee's compliance to the policy.   
     
     
         2 . The method according to  claim 1 , further comprising:
 coaching or training the employee based on the determined compliance.   
     
     
         3 . The method according to  claim 1 , further comprising:
 transmitting an alert based on the determined compliance.   
     
     
         4 . The method according to  claim 3 , wherein the alert is transmitted to the employee through a user interface when the employee does not take the action to comply with the policy. 
     
     
         5 . The method according to  claim 4 , further comprising:
 preventing the POS terminal from completing the transaction for which the employee is required to take an action until the analysis determines that the employee has taken the action.   
     
     
         6 . The method according to  claim 1 , wherein the transactional data comprises an indication that the transaction requires a documentation check. 
     
     
         7 . The method according to  claim 6 , wherein the transaction that requires a documentation check is a purchase of tobacco or alcohol 
     
     
         8 . The method according to  claim 6 , wherein the action to comply with a policy is checking an identification for proof of age. 
     
     
         9 . The method according to  claim 1 , wherein the received transactional data for a particular transaction comprises an indication of when the particular transaction starts/ends and information about a product in the particular transaction. 
     
     
         10 . The method according to  claim 1 , wherein each video segment includes audio corresponding to a transaction and wherein the analyzing includes analyzing the audio to determine the employee's compliance to the policy. 
     
     
         11 . A system for evaluating employees in a retail setting, the system comprising:
 a plurality of point of sale (POS) terminals, wherein each point of sale terminal is operated by an employee;   a plurality of cameras, wherein each camera captures video of transactions at on of the plurality of POS terminals; and   a video processing system comprising a processor and memory, wherein software stored in the memory configures the processor to:
 receive video of the transactions at each POS terminal, 
 receive transactional data from each POS terminal, 
 integrate the video with the transactional data to obtain video segments corresponding to transactions at each POS terminal, 
 identify, based on the transactional data, video segments corresponding to transactions for which each employee is required to take an action to comply with a policy, and 
 analyze the identified video segments to determine each employee's compliance to the policy. 
   
     
     
         12 . The system according to  claim 11 , wherein the software stored in the memory further configures the processor to:
 transmit an alert to a particular employee based on the determined compliance for the particular employee.   
     
     
         13 . The system according to  claim 12 , wherein the alert is transmitted to the particular employee through a user interface when the particular employee does not take the action to comply with the policy. 
     
     
         14 . The system according to  claim 13 , wherein the software stored in the memory further configures the processor to:
 prevent the POS terminal from completing the transaction for which the employee is required to take an action until the analysis determines that the employee has taken the action.   
     
     
         15 . The system according to  claim 11 , wherein the transactional data comprises an indication that the transaction requires a documentation check. 
     
     
         16 . The system according to  claim 15 , wherein the transaction that requires a documentation check is a purchase of tobacco or alcohol. 
     
     
         17 . The system according to  claim 16 , wherein the action to comply with a policy is checking an identification for proof of age. 
     
     
         18 . The system according to  claim 11 , wherein the received transactional data for a particular transaction comprises an indication of when the particular transaction starts/ends and information about a product in the particular transaction. 
     
     
         19 . The system according to  claim 11 , wherein:
 each of the plurality of cameras comprises an audio capturing device to capture audio corresponding to a transaction, and wherein:   the software stored in the memory further configures the processor to analyze the audio to determine each employee's compliance to the policy.   
     
     
         20 . A non-transitory computer readable medium having stored thereon program instructions that, when executed by a video processing system to perform video content analysis using transactional data, direct the video processing system to:
 receive video of transactions at a point-of-sale (POS) terminal operated by the employee;   receive transactional data from the POS terminal, the transactional data corresponding to the transactions at the POS terminal;   integrate the video with the transactional data to obtain video segments corresponding to transactions;   identify, based on the transactional data, video segments corresponding to transactions for which the employee is required to take an action to comply with a policy;   analyze the identified video segments to determine the employee's compliance to the policy.