Method and system for facilitating wireless, full-body, real-time user interaction with digitally generated text data

Abstract

An interactive display system includes an electronic camera which intermittently records a participant's image and digitally inputs the video image into a computer, creating a digitized “virtual user image”. The camera is positioned behind a large viewing screen which faces the user and records the user's image through an opening provided within the screen. The computer further receives a text string having a fall rate value. For each digital image received by the camera, a software program determines the destination of each line of text according to its fall rate, and then uses pixel color comparison techniques to determine if a “virtual obstacle” is located at the particular destination. If not, the text is displayed at the destination so that the text appears to “fall” on the screen. If a virtual obstacle is present, a new higher destination is determined until the virtual obstacle is no longer detected. This arrangement causes the falling text displayed on the screen to be selectively “caught” by the user and otherwise manipulated in the virtual environment.

1. A method for facilitating real-time interaction between a user and a digitally represented visual environment within which the user's moving image is integrated, said method including the use of a computer, electronic memory, a display, a video camera, and a video input device, the method comprising the steps of:
 storing a first computer generated digital image in said electronic memory;  
 assigning a velocity of movement to said digital image, said velocity of movement including a rate of movement and a direction of movement of said digital image;  
 recording the image of said user using said video camera;  
 simultaneously displaying the image of said user and said stored first digital image onto said display, at a predetermined refresh rate;  
 digitally repositioning said displayed first digital image on said display according to said assigned velocity of movement;  
 comparing the relative position of said displayed image of said user and said displayed first digital image;  
 determining when said displayed first digital image and the displayed image of said user are within a predetermined distance on said display;  
 changing said velocity of movement of said displayed first digital image in response to determining that said displayed first digital image and the displayed image of said user are within said predetermined distance; and  
 simultaneously displaying said first digital image at said new velocity of movement, and the image of said user.  
 
     
     
       2. A method for facilitating real-time interaction between a user and digitally represented text data on a display within which the user image is integrated, the method comprising the steps of:
 storing text data in said electronic memory;  
 assigning a velocity of movement to said text data, said velocity of movement including a rate of movement and a direction of movement of said text data;  
 recording the image of said user using a video camera;  
 simultaneously displaying the image of said user and said stored text data onto said display, at a predetermined refresh rate;  
 digitally repositioning said displayed text data on said display by said assigned velocity of movement;  
 comparing the relative position of said displayed image of said user and said displayed text data;  
 determining when said displayed text data and the displayed image of said user are within a predetermined distance on said display;  
 changing the velocity of movement of said displayed text data in response to determining that said displayed text data and the displayed image of said user are within said predetermined distance; and  
 simultaneously displaying said text data at said new velocity of movement and the image of said user.  
 
     
     
       3. The method of  claim 2 , wherein said display includes an upper edge and a lower edge, and said velocity of movement of said text data includes a direction towards said lower edge of the display. 
     
     
       4. The method of  claim 2 , wherein said velocity of movement of said text data includes a first rate of movement, and said new velocity of movement of said text data includes a second rate of movement. 
     
     
       5. The method of  claim 2 , wherein said new velocity of movement of said text data includes no movement. 
     
     
       6. The method of  claim 2 , wherein said assigned velocity of movement of said text data includes a first direction of movement, and said new velocity of movement of said text data includes a second direction of movement, said second direction of movement being opposite said first direction of movement. 
     
     
       7. The method of  claim 2 , wherein said text data is initially displayed on said display at a predetermined location prior to moving at said assigned velocity. 
     
     
       8. The method of  claim 2 , wherein prior to performing the step of storing text data into electronic memory, a step of receiving text data from a keyboard is performed. 
     
     
       9. A method for facilitating real-time interaction between a user and digitally represented text data on a display within which the user image is integrated, the method comprising the steps of:
 storing text data in an electronic memory;  
 assigning a velocity of movement to said text data, said velocity of movement including a rate of movement and a direction of movement of said text data;  
 storing a threshold pixel color value in electronic memory;  
 recording the image of said user using a video camera;  
 simultaneously displaying the image of said user and said stored text data onto said display, at a predetermined refresh rate, thereby creating a combined image;  
 determining a destination of said text data, according to the assigned velocity, said text data destination being the point within the combination image where the text will next be displayed;  
 measuring the pixel color value of the display image at the determined text data destination;  
 comparing the measured pixel color value at the text data destination with said stored threshold color value;  
 displaying said text data at said text data destination in response to said comparing step determining that said measured pixel color value at the text data destination is less than said stored threshold color value; and  
 displaying said text data at a position within said combined image on said display other than said text data destination in response to determining in said comparing step that said measured pixel color value at the text data destination is greater than the stored threshold color value.  
 
     
     
       10. The method of  claim 9 , further comprising the step of changing the velocity of the text data in response to said comparing step determining that said measured pixel color value at the text data destination is greater than the stored threshold color value. 
     
     
       11. An arrangement capable of facilitating an interaction of at least one portion of a physical object with at least one portion of a virtual object when being executed by a processing arrangement, comprising:
   a first set of instructions which, when executed by the processing arrangement, is configured to receive first information associated with the at least one portion of a first representation of the virtual object and second information associated with at least one section of a second representation of the at least one portion of the physical object, wherein the second representation is generated irrespective of an implementation of a particular characteristic associated with at least one of a color or an illumination of a background associated with the at least one portion of the physical object;        a second set of instructions which, when executed by the processing arrangement, is configured to determine a spatial relationship between respective positions associated with the first representation and the second representation by analyzing the first and second information;        a third set of instructions which, when executed by the processing arrangement, is configured to modify at least one portion of the first information based on the determination made by the second set of instructions; and        a fourth set of instructions which, when executed by the processing arrangement, is configured to provide further data associated with the first and second representations based on the modified portion at least one of for display or in a virtual space.      
     
     
       12. The arrangement according to  claim 11 , wherein the third set of instructions is configured to modify the at least one portion of the first information by repositioning at least one of the relative position associated with at least one section of the first representation of the at least one portion of the virtual object and the respective position associated with at least one section of the second representation of the at least one portion of the physical object.  
     
     
       13. The arrangement according to  claim 11 , wherein the first representation is associated with a first digital image of the virtual object.  
     
     
       14. The arrangement according to  claim 13 , wherein the second representation is associated with a second digital image of the at least one portion of the physical object.  
     
     
       15. The arrangement according to  claim 14 , further comprising a fifth set of instructions which, when executed by the processing arrangement, is configured to reposition at least one of the first digital image and the second digital image at least one of for display or in the virtual space.  
     
     
       16. The arrangement according to  claim 15 , wherein the fourth set of instructions is capable of providing at least one of the first repositioned digital image or the second repositioned digital image at least one of for display or in the virtual space.  
     
     
       17. The arrangement according to  claim 16 , wherein the first digital image is capable of being repositioned in a direction relative to the second digital image.  
     
     
       18. The arrangement according to  claim 14 , wherein the spatial relationship is provided as a function of a determination of when the first digital image at least one of reaches or is positioned at a predetermined distance from the second digital image.  
     
     
       19. The arrangement according to  claim 11 , wherein the second representation is associated with a digital image for the at least one portion of the physical object.  
     
     
       20. The arrangement according to  claim 11 , wherein the further data is associated with data provided for at least one of marketing, advertising, sales, entertainment, learning, education, games, conveying weather or conveying news.  
     
     
       21. The arrangement according to  claim 11 , further comprising a sixth set of instructions which, when executed by the processing arrangement, is configured to obtain destination data of the virtual object, the destination data being related to a particular position which is targeted to be reached by the virtual object.  
     
     
       22. The arrangement according to  claim 21 , wherein the destination data is related to a particular position which it targeted to be reached by the relative position associated with the first representation based on the second information.  
     
     
       23. The arrangement according to  claim 11 , further comprising a seventh set of instructions which, when executed by the processing arrangement, is configured to obtain third information associated with a speed of movement of the virtual object which is associated with the first representation.  
     
     
       24. The arrangement according to  claim 23 , wherein at least one portion of the third information is capable of being modified based on the determination by the seventh set of instructions.  
     
     
       25. The arrangement according to  claim 11 , further comprising an eighth set of instructions which, when executed by the processing arrangement, is configured to modify a speed of a movement of the relative position associated with the virtual object as a function of the second representation.  
     
     
       26. The arrangement according to  claim 11 , further comprising a tenth set of instructions which, when executed by the processing arrangement, is configured to reposition at least one of the relative position associated with at least one section of the first representation of the at least one portion of the virtual object and the respective position association with at least one section of the second representation of the at least one portion of the physical object.  
     
     
       27. A method for facilitating an interaction of at least one portion of a physical object with at least one portion of a virtual object, comprising:
   receiving first information associated with the at least one portion of a first representation of the virtual object and second information associated with at least one section of a second representation of the at least one portion of the physical object, wherein the second representation is generated irrespective of an implementation of a particular characteristic associated with at least one of a color or an illumination of a background associated with the at least one portion of the physical object;        determining a spatial relationship between respective positions associated with the first representation and the second representation by analyzing the first and second information;        modifying at least one portion of the first data based on the determination of the special relationship; and        providing further data associated with the first and second representations based on the modified portion at least one of for display or in a virtual space.      
     
     
       28. A system for facilitating an interaction of at least one portion of a physical object with at least one portion of a virtual object, comprising:
   a first arrangement configured to receive first information associated with the at least one portion of a first representation of the virtual object and second information associated with at least one section of a second representation of the at least one portion of the physical object, wherein the second representation is generated irrespective of an implementation of a particular characteristic associated with at least one of a color or an illumination of a background associated with the at least one portion of the physical object;        a second arrangement configured to determine a spatial relationship between respective positions associated with the first representation and the second representation by analyzing the first and second information;        a third arrangement configured to modify at least one portion of the first data based on the determination made by the determination made by the second arrangement; and        a fourth arrangement configured to provide further data associated with the first and second representations based on the modified portion at least one for display or in a virtual space.      
     
     
       29. An arrangement capable of facilitating an interaction of at least one portion of a physical object with at least one portion of a virtual object when being executed by a processing arrangement, comprising:
   a first set of instructions which, when executed by the processing arrangement, is configured to receive first information associated with the at least one portion of a first representation of the virtual object and second information associated with at least one section of a representation of the at least one portion of the physical object;        a second set of instructions which, when executed by the processing arrangement, is configured to obtain destination data associated with the virtual object, the destination data being related to a particular position which is targeted to be reached by the virtual object;        a third set of instructions which, when executed by the processing arrangement, is configured to determine whether the destination data is at least one of reached or configured to be reached by the representation;        a fourth set of instructions which, when executed by the processing arrangement, is configured to modify at least one portion of the first information based on the determination; and        a fifth set of instructions which, when executed by the processing arrangement, is configured to provide the modified first information and the second information at least one of for display or in a virtual space.      
     
     
       30. The arrangement according to  claim 29 , wherein the first representation is associated with a first digital image of the virtual object, and the second representation is associated with a second digital image of the at least one portion of the physical object.  
     
     
       31. The arrangement according to  claim 29 , wherein the destination data is determined based on the second information.  
     
     
       32. An arrangement capable of facilitating an interaction of at least one portion of a physical object with at least one portion of a virtual object when being executed by a processing arrangement, comprising:
   a first set of instructions which, when executed by the processing arrangement, is configured to receive first information associated with the at least one portion of a first representation of the virtual object and second information associated with at least one section of a second representation of the at least one portion of the physical object;        a second set of instructions which, when executed by the processing arrangement, is configured to obtain third information associated with a speed of movement of the virtual object;        a third set of instructions which, when executed by the processing arrangement, is configured to determine whether a relative position associated with the first representation at least one of reaches, is configured to reach or is provided at a predetermined distance from a relative position associated with the second representation by analyzing the first and second information;        a fourth set of instructions which, when executed by the processing arrangement, is configured to modify at least one portion of the third information based on the determination;        a fifth set of instructions which, when executed by the processing arrangement, is configured to reposition the relative position of the first representation as a function of the at least one modified portion of the third information; and        a sixth set of instructions which, when executed by the processing arrangement, is configured to provide the first modified representation and the second representation at least one of for display or in a virtual space.      
     
     
       33. The arrangement according to  claim 31 , wherein the first representation is associated with a first digital image of the virtual object, and the second representation is associated with a second digital image the at least one portion of the physical object.