System and method for determining a pupillary response to a multimedia data element

Abstract

A system and method for determining a pupillary response to a multimedia data element. The method includes receiving a first image including a pupil; receiving a second image including the pupil, wherein the second image is captured after a display of a MMDE; generating, for each of the first image and the second image, a signature; comparing the signature of the first image and the signature of the second image; determining, based on the signature comparison, a user attention to the displayed MMDE; and associating the displayed MMDE with the determined user attention.

What we claim is: 
     
         1 . A method for determining a pupillary response to a multimedia data element (MMDE), comprising:
 receiving a first image including a pupil;   receiving a second image including the pupil, wherein the second image is captured after a display of a MMDE;   generating, for each of the first image and the second image, a signature;   comparing the signature of the first image and the signature of the second image;   determining, based on the signature comparison, a user attention to the displayed MMDE; and   associating the displayed MMDE with the determined user attention.   
     
     
         2 . The method of  claim 1 , further comprising:
 correlating the displayed MMDE with the determined user attention; and   determining, based on the correlation, at least one user preference.   
     
     
         3 . The method of  claim 2 , wherein determining the at least one user preference further comprises:
 querying a deep-content-classification (DCC) system to determine whether at least one concept structure matches the displayed MMDE;   receiving metadata of the at least one concept structure, when it is determined that at least one concept structure matches the displayed MMDE, wherein the at least one user preference is determined based on the received metadata.   
     
     
         4 . The method of  claim 3 , wherein querying the DCC system further comprises:
 generating a signature for the displayed MMDE, wherein the query is based on the signature of the displayed MMDE.   
     
     
         5 . The method of  claim 4 , wherein a concept structure matches the displayed MMDE when a signature representing the concept structure matches the generated signature of the displayed MMDE above a predetermined threshold. 
     
     
         6 . The method of  claim 1 , further comprising:
 comparing the signature of the second image to a signature of a concept structure representing a pupil dilation, wherein the user attention is determined further based on the comparison between the signature of the second image and the signature of the pupil dilation concept structure.   
     
     
         7 . The method of  claim 1 , wherein the MMDE is at least one of: an image, graphics, a video stream, a video clip, an audio stream, an audio clip, a video frame, a photograph, images of signals, medical signals, geophysical signals, subsonic signals, supersonic signals, electromagnetic signals, and infrared signals. 
     
     
         8 . The method of  claim 1 , wherein the DCC system comprises:
 an attention processor (AP) for generating a plurality of items from the received sensory signal and determining which of the generated items are of interest for signature generation;   a signature generator (SG) for generating at least one signature responsive to at least one item of interest of the sensory signal; and   a concept generator (CG) for matching between the at least one signature generated responsive to at least one item of interest of the sensory signal and a plurality of signature reduced clusters associated with a plurality of cluster structures to identify at least the first set of metadata.   
     
     
         9 . The method of  claim 1 , wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of computational cores configured to receive a plurality of unstructured data elements, each computational core of the plurality of computational cores having properties that are at least partly statistically independent of other of the computational cores, the properties are set independently of each other core. 
     
     
         10 . A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute a method, the method comprising:
 receiving a second image including the pupil, wherein the second image is captured after a display of a MMDE;   generating, for each of the first image and the second image, a signature;   comparing the signature of the first image and the signature of the second image;   determining, based on the signature comparison, a user attention to the displayed MMDE; and   associating the displayed MMDE with the determined user attention.   
     
     
         11 . A system for determining pupillary response to a multimedia data element (MMDE), comprising:
 a processing circuitry; and   a memory connected to the processor, the memory containing instructions that, when executed by the processing circuitry, configure the system to:   receive a second image including the pupil, wherein the second image is captured after a display of a MMDE;   generate, for each of the first image and the second image, a signature;   compare the signature of the first image and the signature of the second image;   determine, based on the signature comparison, a user attention to the displayed MMDE; and   associate the displayed MMDE with the determined user attention.   
     
     
         12 . The system of  claim 11 , wherein the system is further configured to:
 correlate the displayed MMDE with the determined user attention; and   determine, based on the correlation, at least one user preference.   
     
     
         13 . The system of  claim 2 , wherein the system is further configured to:
 query a deep-content-classification (DCC) system to determine whether at least one concept structure matches the displayed MMDE; and   receive metadata of the at least one concept structure, when it is determined that at least one concept structure matches the displayed MMDE, wherein the at least one user preference is determined based on the received metadata.   
     
     
         14 . The system of  claim 13 , wherein the system is further configured to:
 generate a signature for the displayed MMDE, wherein the query is based on the signature of the displayed MMDE.   
     
     
         15 . The system of  claim 14 , wherein a concept structure matches the displayed MMDE when a signature representing the concept structure matches the generated signature of the displayed MMDE above a predetermined threshold. 
     
     
         16 . The system of  claim 11 , wherein the system is further configured to:
 compare the signature of the second image to a signature of a concept structure representing a pupil dilation, wherein the user attention is determined further based on the comparison between the signature of the second image and the signature of the pupil dilation concept structure.   
     
     
         17 . The system of  claim 11 , wherein the MMDE is at least one of: an image, graphics, a video stream, a video clip, an audio stream, an audio clip, a video frame, a photograph, images of signals, medical signals, geophysical signals, subsonic signals, supersonic signals, electromagnetic signals, and infrared signals. 
     
     
         18 . The system of  claim 11 , wherein the DCC system includes:
 an attention processor (AP) for generating a plurality of items from the received sensory signal and determining which of the generated items are of interest for signature generation;   a signature generator (SG) for generating at least one signature responsive to at least one item of interest of the sensory signal; and   a concept generator (CG) for matching between the at least one signature generated responsive to at least one item of interest of the sensory signal and a plurality of signature reduced clusters associated with a plurality of cluster structures to identify at least the first set of metadata.   
     
     
         19 . The system of  claim 11 , further comprising:
 a signature generator system, wherein each signature is generated by the signature generator system, wherein the signature generator system includes a plurality of computational cores configured to receive a plurality of unstructured data elements, each computational core of the plurality of computational cores having properties that are at least partly statistically independent of other of the computational cores, the properties are set independently of each other core.