Methods and systems for controlling video compositing in an interactive entertainment system

Abstract

An interactive video compositing device includes a chroma-key mixer, video switcher and control circuitry. The chroma-key mixer generates a composite image by combining a real-time image, such as one captured by a video recorder, with a prerecorded video image, such as a movie. The composite image includes the modified real-time image superimposed, or overlaid, onto the prerecorded image. The video switcher automatically selects either the composite image or the prerecorded image to be output to a display. The control circuitry controls the video switcher and other outputted signals based on data file information that corresponds to content of the prerecorded image or media. For example, the data files may contain information relating to the presence (or absence) of a particular character in a movie scene, thus allowing for the output and display, at appropriate times, of the real-time composite image instead of the prerecorded image.

1 . A method for coordinating the display of multiple signals, the method comprising:
 accessing a first signal comprising video content having multiple frames;   accessing a second signal comprising a video image of a participant;   forming a combined video signal comprising at least a portion of the first signal and at least a portion of the second signal, wherein the combined video signal is configured to cause the display of the video image of the participant in place of a scene element of the video content;   accessing reference data that corresponds to the first signal, the reference data comprising first reference data that identifies a first frame of the multiple frames in which the scene element is associated with a scene of the video content, and wherein the reference data comprises second reference data that identifies a second frame of the multiple frames in which the scene element is no longer associated with the scene of the video content; and   switching between displaying the first signal and displaying the combined video signal, wherein a timing of said switching is based on the reference data such that the combined video signal is selected at a first time identified by the first reference data whereby the participant appears in the scene in place of the scene element, and such that the first signal is selected at a second time identified by the second reference data whereby the participant no longer appears in the scene of the video content.   
     
     
         2 . The method of  claim 1 , wherein the video image of the participant comprises a real-time image of the participant. 
     
     
         3 . The method of  claim 2 , wherein said switching is performed in real time. 
     
     
         4 . The method of  claim 1 , wherein said accessing the second signal comprises receiving the second signal via a network. 
     
     
         5 . The method of  claim 4 , further comprising accessing a third signal comprising a second video image of a second participant. 
     
     
         6 . The method of  claim 5 , wherein the combined video signal comprises at least portions of the first, second and third signals. 
     
     
         7 . The method of  claim 6 , wherein the reference data comprises third reference data that identifies a third frame of the multiple frames in which a second scene element is associated with the scene of the video content. 
     
     
         8 . The method of  claim 1 , wherein the first signal further comprises a first audio signal that corresponds to the video content. 
     
     
         9 . The method of  claim 8 , wherein the second signal comprises a second audio signal that corresponds to audio of the participant, wherein at the first time identified by the first reference data the second audio signal is associated with the combined video signal. 
     
     
         10 . The method of  claim 1 , wherein said forming the combined video signal comprises overlaying the at least the portion of the second signal on the first signal. 
     
     
         11 . The method of  claim 1 , wherein the scene element comprises an actor or actress of the video content. 
     
     
         12 . A system for providing interactive entertainment, the system comprising:
 a first input configured to receive a first signal, the first signal comprising video content including a plurality of frames representing a scene;   a second input configured to receive a second signal, the second signal comprising an image of a participant; and   a processor in communication with the first input and the second input, the processor being configured to combine at least a portion of the first signal and at least a portion of the second signal, wherein the portion of the second signal comprises the image of the participant,   the processor being further configured to receive first reference data that identifies a first frame of the plurality of frames in which a scene element appears in the scene of the video content and to receive second reference data that identifies a second frame of the plurality of frames in which the scene element no longer appears in the scene of the video content,   and the processor being further configured to output the combined signal at a first time identified by the first reference data such that the participant appears in the scene as the scene element and to output the first video signal at a second time identified by the second reference data such that the participant no longer appears in the scene.   
     
     
         13 . The system of  claim 12 , wherein the image comprises a real-time image of the participant. 
     
     
         14 . The system of  claim 12 , wherein the second input is configured to receive the second signal via a network. 
     
     
         15 . The system of  claim 12 , wherein the processor is further configured to adjust one or more attributes of the image of the participant when forming the combined signal. 
     
     
         16 . The system of  claim 15 , wherein the one or more attributes comprises a size of the image of the participant. 
     
     
         17 . The system of  claim 15 , wherein the one or more attributes comprises a color of the image of the participant. 
     
     
         18 . The system of  claim 12 , wherein the video content comprises at least one of movie content, video game content and television program content. 
     
     
         19 . The system of  claim 12 , wherein the scene element comprises a character of the video content. 
     
     
         20 . A system for providing interactive entertainment, the system comprising:
 means for receiving a first video signal, the first video signal comprising video content including a plurality of frames, the plurality of frames representing a scene;   means for receiving a second video signal, the second video signal comprising a video image of a participant; and   processing means for combining the first video signal and at least a portion of the second video signal, wherein the portion of the second video signal comprises the video image of the participant, and wherein the combined signal comprises a combined video signal with the participant as a character in the scene,   wherein the processing means further receives first reference data that identifies a first frame of the plurality of frames in which the character appears in the scene of the video content and receives second reference data that identifies a second frame of the plurality of frames in which the character exits the scene of the video content,   wherein the processing means further outputs the combined signal at a first time identified by the first reference data such that the participant appears in the scene as the character, and outputs the first video signal at a second time identified by the second reference data such that the participant no longer appears in the scene.