Location-aware event detection

Abstract

Techniques for detecting one or more events are provided. The techniques include using multiple overlapping regions of interest on a video sequence to cover a location for one or more events, wherein each event is associated with at least one of the multiple overlapping regions of interest, applying multiple-instance learning to the video sequence to select one or more of the multiple overlapping regions of interest to construct one or more location-aware event models, and applying the models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events.

What is claimed is: 
     
         1 . A method for detecting one or more events, comprising:
 using multiple overlapping regions of interest on a video sequence to cover a respective location for two or more events at a point of sale, wherein the two or more events include a pickup event and a drop event, wherein each event is associated with at least one of the multiple overlapping regions of interest;   applying event models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events; and   identifying missing correspondences using multiple overlapping regions of interest.   
     
     
         2 . The method of  claim 1 , wherein the two or more events at the point of sale comprise the pickup event, a scan event, and the drop event, wherein the pickup event comprises a cashier picking up an item, the scan event comprises a cashier at least one of reading the barcode on an item via a scanner and weighing an item, and the drop event comprises a cashier placing an item onto a take-away belt area. 
     
     
         3 . The method of  claim 1 , wherein the multiple overlapping regions of interest comprise one or more shapes. 
     
     
         4 . The method of  claim 1 , wherein the multiple overlapping regions of interest comprise one or more sizes. 
     
     
         5 . The method of  claim 1 , further comprising extracting one or more features from each region of interest. 
     
     
         6 . The method of  claim 5 , wherein the one or more features comprise at least one of color, edge and motion. 
     
     
         7 . A computer program product comprising a tangible computer readable recordable storage medium having computer readable program code for detecting one or more events, said computer program product including:
 computer readable program code for using multiple overlapping regions of interest on a video sequence to cover a respective location for two or more events at a point of sale, wherein the two or more events includes a pickup event and a drop event, wherein each event is associated with at least one of the multiple overlapping regions of interest;   computer readable program code for applying event models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events; and   computer readable program code for identifying missing correspondences using multiple overlapping regions of interest.   
     
     
         8 . The computer program product of  claim 7 , wherein the two or more events at the point of sale comprise the pickup event, a scan event, and the drop event, wherein the pickup event comprises a cashier picking up an item, the scan event comprises a cashier at least one of reading the barcode on an item via scanner and weighing an item, and the drop event comprises a cashier placing an item onto a take-away belt area. 
     
     
         9 . The computer program product of  claim 7 , further comprising computer readable program code for extracting one or more features from each region of interest. 
     
     
         10 . The computer program product of  claim 9 , wherein the one or more features comprise at least one of color, edge and motion. 
     
     
         11 . The computer program product of  claim 7 , wherein the multiple overlapping regions of interest comprise one or more shapes and one or more sizes. 
     
     
         12 . A system for detecting one or more events, comprising:
 a memory; and   at least one processor coupled to said memory and operative to:
 use multiple overlapping regions of interest on a video sequence to cover a respective location for two or more events at a point of sale, wherein the two or more events include a pickup event and a drop event, wherein each event is associated with at least one of the multiple overlapping regions of interest; 
 apply event models to the video sequence to detect the one or more events and to determine the one or more regions of interest that are associated with the one or more events; and 
 identify missing correspondences using multiple overlapping regions of interest. 
   
     
     
         13 . The system of  claim 12 , wherein the two or more events at the point of sale comprise the pickup event, a scan event, and the drop event, wherein the pickup event comprises a cashier picking up an item, the scan event comprises a cashier at least one of reading the barcode on an item via a scanner and weighing an item, and the drop event comprises a cashier placing an item onto a take-away belt area. 
     
     
         14 . The system of  claim 12 , wherein the at least one processor coupled to said memory is further operative to extract one or more features from each region of interest.