Method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set

Abstract

An improved method for enhanced puppetry or similar types of performances utilizing a virtual set having a key-color screen behind the set to do live action filming. All objects on the set, except for the performing puppet, or other objects which are to appear in the final product, are wrapped in a material which matches the color of the key-color screen. A virtual background is generated and combined with the live action whereby only the puppet (or other object) appears on the virtual background in real time, with all other objects on the live set, including puppeteers, for example, being eliminated from the final product.

What is claimed is:  
     
         1 . Apparatus for improved puppetry for film and/or video productions utilizing a virtual production set comprising: 
 a key-color background screen;    a source for creating a virtual background;    a puppet manipulated by a plurality of puppeteers, said puppeteers covered in a material which matches the color of said key-color screen;    a camera for recording live images of the puppet and puppeteers against the background of the key-color screen;    apparatus for combining said live images and said virtual background and removing from said combined image the appearance of said puppeteers; and    a monitor to display said combined image.    
     
     
         2 . The apparatus of  claim 1  wherein said puppet is capable of providing at least three orthogonal views, each view having two non-zero dimensions.  
     
     
         3 . A method for creating improved puppetry productions utilizing a virtual set comprising the steps of: 
 positioning an articulated performing puppet to be filmed in front of a key-color background screen, said articulated puppet being manipulated by a plurality of puppeteers, each puppeteer being covered in a material which matches the color of said key-color background screen;    filming, in real time, movements of said articulated puppet as it is manipulated by said puppeteers;    creating a virtual background to appear in said film or video production; and    combining in real time said live film and said virtual background whereby said puppet appears in said virtual background minus any appearance of said puppeteers.    
     
     
         4 . The method of  claim 3  wherein said puppet is capable of providing at least three orthogonal views, each view having two non-zero dimensions.  
     
     
         5 . A method for creating a virtual film or video production comprising the steps of: 
 positioning an articulated puppet to be filmed on a set in front of a key-color background screen;    said set further including additional supporting objects not to be included in a final film product;    covering some or all of said additional supporting objects, prior to commencement of filming, with a material that matches the color of said key-color background screen;    filming, in real time, movements of said articulated puppet and said additional supporting objects;    creating a virtual background to appear in said film; and    combining in real time said film and said virtual background whereby said articulated puppet appears in said virtual background minus any appearance of said covered additional supporting objects and wherein said additional supporting objects are puppeteers.    
     
     
         6 . The method of  claim 5  wherein said puppet is capable of providing at least three orthogonal views, each view having two non-zero dimensions.  
     
     
         7 . Apparatus for improved puppetry for film and/or video productions utilizing a virtual production set comprising: 
 a key-color background screen;    a source for creating a virtual background;    a puppet including at least one articulating mechanism for use by a puppeteer, each such mechanism connected to an associated portion of said puppet and having a color which matches that of said key-color screen, each articulating mechanism adapted for use by a puppeteer also having an associated color which matches that of said key-color screen, and wherein movement of that articulating mechanism by said puppeteer produces a corresponding movement of said puppet;    a camera for recording live images of the puppet, articulating mechanism and puppeteers against the background of the key-color screen;    apparatus for combining said live images and said virtual background and removing from said combined image the appearance of said puppeteers and said articulating mechanism; and    a monitor to display said combined image.    
     
     
         8 . Method for creating improved productions utilizing a virtual set comprising the steps of: 
 positioning an articulated performing puppet to be filmed in front of a key-color background screen, said articulated puppet being manipulated by a plurality of puppeteers, each puppeteer providing puppet manipulation via at least one articulating mechanism such that movement of each articulating mechanism provides a corresponding movement of said puppet, each puppeteer and each articulating mechanism having an associated color which matches that of said key-color background screen;    filming in real-time, movements of said articulated puppet as it is manipulated by said puppeteers via said articulating mechanisms;    creating a virtual background to appear in said film or video production; and    combining in real time said live film and said virtual background whereby said puppet appears in said virtual background minus any appearance of said puppeteers and said articulating mechanisms.    
     
     
         9 . A method for creating a virtual film or video production comprising the steps of: 
 positioning an articulated puppet to be filmed on a set in front of a key-color background screen, said set further including additional supporting objects not to be included in a final film product, said articulated puppet including an articulating mechanism wherein movement of said articulating mechanism produces a corresponding movement of said puppet;    providing said articulating mechanism and some or all of said additional supporting objects, prior to commencement of filming, with an associated color which matches that of said key-color background screen;    creating a virtual background to appear in said film; and    combining in real time said film and said virtual background whereby said puppet appears in said virtual background minus any appearance of said covered articulating mechanism and said additional supporting objects and wherein said additional supporting objects are puppeteers.