Systems and methods for media annotation, selection and display of background data

Abstract

Video content is a time varying presentation of scenes or video frames. Each frame can contain a number of scene elements such as actors, foreground items, background items, or other items. A person enjoying video content can select a scene element by specifying a screen coordinate while the video content plays. Frame specification data identifies the specific frame or scene being displayed when the coordinate is selected. The coordinate in combination with the frame specification data is sufficient to identify the scene element that the person has chosen. Information about the scene element can then be presented to the person. An annotation database can relate the scene elements to the frame specification data and coordinates.

1 . A system, comprising:
 an annotation module that automatically annotates content ding video content comprising a plurality of frames;   an annotation database that stores at least one element identifier, and wherein said annotation database communicates with said annotation module; and   at least one element identifier provided by said annotation database in response to a query comprising frame specification data and a coordinate, wherein said frame specification data identifies which frames among said plurality of frames was displayed when said coordinate is selected.   
     
     
         2 . The system of  claim 1  further comprising:
 a display device that displays said video content comprising said plurality of frames; and 
 a pointing device for selecting said coordinate on said display device. 
 
     
     
         3 . The system of  claim 2  further comprising a media device that provides said video content to said display device. 
     
     
         4 . The system of  claim 1  wherein the frame specification data comprises a timestamp and a media tag, wherein said media tag identifies said video content, wherein said timestamp identifies at least one frame among said plurality of frames of said video content and wherein said at least one frame is displayed said coordinate is selected. 
     
     
         5 . The system of  claim 1  further comprising:
 an additional data server that produces element data based on said at least one element identifier; and 
 a data presentation that displays said element data. 
 
     
     
         6 . The system of  claim 1  wherein said at least one element identifier corresponds to an item for sale and said data presentation comprises an offer to purchase said item. 
     
     
         7 . The system of  claim 1  wherein said at least one element identifier corresponds to a person and said data presentation provides information about that person. 
     
     
         8 . The system of  claim 1  wherein said at least one element identifier corresponds to a song and said data presentation comprises an offer to purchase a copy of said song. 
     
     
         9 . The system of  claim 1  wherein said at least one element identifier corresponds to a location and said data presentation comprises travel information for reaching said location. 
     
     
         10 . A method, comprising:
 automatically annotating via an annotation module, content including video content comprising a plurality of frames;   storing in an annotation database that communicates with said annotation module, at least one element identifier; and   providing from said at least one element identifier from said annotation database in response to a query comprising frame specification data and a coordinate, wherein said frame specification data identifies which frames among said plurality of frames was displayed when said coordinate is selected.   
     
     
         11 . The method of  claim 10  further comprising:
 displaying via a display device, said video content comprising said plurality of frames; and 
 selecting via a pointing device, said coordinate on said display device. 
 
     
     
         12 . The method of  claim 11  further comprising providing said video content to said display device from a media device. 
     
     
         13 . The method of  claim 10  wherein said frame specification data comprises a timestamp and a media tag, wherein said media tag identifies said video content, wherein said timestamp identifies at least one frame among said plurality of frames of said video content and wherein said at least one frame is displayed said coordinate is selected. 
     
     
         14 . The method of  claim 10  further comprising:
 providing an additional data server that produces element data based on said at least one element identifier; and 
 providing a data presentation that displays said element data. 
 
     
     
         15 . The method of  claim 10  wherein said at least one element identifier corresponds to an item for sale and said data presentation comprises an offer to purchase said item. 
     
     
         16 . The method of  claim 10  wherein said at least one element identifier corresponds to a person and said data presentation provides information about that person. 
     
     
         17 . The method of  claim 10  wherein said at least one element identifier corresponds to a song and said data presentation comprises an offer to purchase a copy of said song. 
     
     
         18 . The method of  claim 10  wherein said at least one element identifier corresponds to a location and said data presentation comprises travel information for reaching said location. 
     
     
         19 . A processor-readable medium storing code representing instructions to cause a processor to perform a process, said code comprising code to:
 automatically annotate via an annotation module, content including video content comprising a plurality of frames;   store in an annotation database that communicates with said annotation module, at least one element identifier; and   provide from said at least one element identifier from said annotation database in response to a query comprising frame specification data and a coordinate, wherein said frame specification data identifies which frames among said plurality of frames was displayed when said coordinate is selected.   
     
     
         20 . The processor-readable medium of  claim 19 , wherein said frame specification data comprises a timestamp and a media tag, wherein said media tag identifies said video content, wherein said timestamp identifies at least one frame among said plurality of frames of said video content and wherein said at least one frame is displayed said coordinate is selected.