Simulator with enhanced depth perception

Abstract

A simulator system includes a user tracking device for detecting a position of a user and generating a sensor signal representing the position of the user, a processor for receiving the sensor signal, analyzing the sensor signal, and generating an image signal in response to the analysis of the sensor signal, wherein the analyzing of the sensor signal includes determining a position of a virtual camera corresponding to the position of the user, the virtual camera being directed toward a reference look-at-point; and a image generating device for receiving the image signal and generating an image in response to the image signal, wherein the image is modified in response to the position and an orientation of the virtual camera relative to the reference look-at-point.

1 . A simulator system comprising:
 a user tracking device for detecting a position of a user and generating a sensor signal representing the position of the user;   a processor for receiving the sensor signal, analyzing the sensor signal, and generating an image signal in response to the analysis of the sensor signal, wherein the analyzing of the sensor signal includes determining a position of a virtual camera corresponding to the position of the user, the virtual camera being directed toward a reference look-at-point; and   a image generating device for receiving the image signal and generating an image in response to the image signal, wherein the image is modified in response to the position and an orientation of the virtual camera relative to the reference look-at-point.   
     
     
         2 . The simulator system according to  claim 1 , wherein the user tracking device detects a position of a particular body part of the user and the image is modified in response to a change in the position of the particular body part. 
     
     
         3 . The simulator system according to  claim 1 , wherein the image generating device is a projector. 
     
     
         4 . The simulator system according to  claim 1 , further comprising an object tracking device for tracking a motion of an object interacting with the user. 
     
     
         5 . The simulator system according to  claim 1 , wherein a motion of the user relative to the user tracking device produces a translation of a point of view of the virtual camera relative to the look-at-point and a rotation of the point of view of the virtual camera about the look-at-point. 
     
     
         6 . A simulator system comprising:
 a plurality of user tracking devices arranged to track a position of a user and generate a sensor signal representing the position of the user;   a processor for receiving the sensor signal, analyzing the sensor signal, and generating an image signal in response to the analysis of the sensor signal, wherein the analyzing of the sensor signal includes determining a position of a virtual camera corresponding to the position of the user, the virtual camera being directed toward a reference look-at-point; and   a image generating device for receiving the image signal and generating an image in response to the image signal, wherein the image is modified in response to a change in at least one of the position and an orientation of the virtual camera relative to the reference look-at-point.   
     
     
         7 . The simulator system according to  claim 1 , wherein the user tracking device detects a position of a particular body part of the user and the image is modified in response to a change in the position of the particular body part. 
     
     
         8 . The simulator system according to  claim 1 , wherein the image generating device is a projector. 
     
     
         9 . The simulator system according to  claim 1 , wherein each of the user tracking devices is a camera and each of the user tracking devices captures a time synchronized image of the user, and wherein the images are transmitted to the processor via the sensor signal. 
     
     
         10 . The simulator system according to  claim 9 , wherein the processor performs an image processing of the time synchronized images to produce a blob shape representing at least a portion of a body of the user. 
     
     
         11 . The simulator system according to  claim 10 , wherein the processor compares the blob shape to a pre-defined criterion for a particular body feature to determine at least one of a position and orientation of the at least a portion of the body of the user relative to the user tracking devices. 
     
     
         12 . The simulator system according to  claim 10 , wherein the processor analyzes the blob shape to determine a center of mass thereof, wherein the blob shape and center of mass are compared to a pre-defined criterion for a plurality of body features to match the blob shape to one of the body features. 
     
     
         13 . The simulator system according to  claim 10 , wherein a three dimensional position of the blob shape is determined by a geometrical analysis of an intersecting ray from each of the user tracking devices. 
     
     
         14 . The simulator system according to  claim 6 , wherein a motion of the user relative to the user tracking devices produces a translation of a point of view of the virtual camera relative to the look-at-point and a rotation of the point of view of the virtual camera about the look-at-point. 
     
     
         15 . A method for providing an enhanced depth perception to a user of a simulator, the method comprising the steps of:
 providing a user tracking device to detect a position of a user and generate a sensor signal representing the position of the user;   analyzing the sensor signal to determine a position of a virtual camera corresponding to the position of the user, the virtual camera being directed toward a reference look-at-point; and   generating an image in response to the analysis of the sensor signal, wherein the image is modified in response to a change in at least one of the position and an orientation of the virtual camera relative to the reference look-at-point.   
     
     
         16 . The method according to  claim 15 , wherein the user tracking device detects a position of a particular body part of the user and the image is modified in response to a change in the position of the particular body part. 
     
     
         17 . The method according to  claim 15 , wherein the user tracking device includes a plurality of cameras, each of the cameras capturing a time synchronized image of the user and transmitting the images to the processor via the sensor signal. 
     
     
         18 . The method according to  claim 17 , wherein the step of analyzing the sensor signal includes an image processing of the time synchronized images to produce a blob shape representing at least a portion of a body of the user. 
     
     
         19 . The method according to  claim 18 , wherein the step of analyzing the sensor signal includes determining a three dimensional position of the blob shape by a geometrical analysis of an intersecting ray from each of the cameras of the user tracking device. 
     
     
         20 . The method according to  claim 16 , wherein a motion of the user relative to the user tracking device produces at least one of a translation of a point of view of the virtual camera relative to the look-at-point and a rotation of the point of view of the virtual camera about the look-at-point.