Camera based interaction and instruction

Abstract

Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

1 . A portable device comprising:
 a device housing including a forward facing portion, the forward facing portion including an electro-optical sensor having a field of view and a digital camera separate from the electro-optical sensor; and   a processing unit within the device housing and operatively coupled to electro-optical sensor, wherein the processing unit is adapted to control the digital camera in response to a gesture performed in the electro-optical sensor field of view.   
     
     
         2 . The portable device of  claim 1  wherein the gesture corresponds to an image capture command. 
     
     
         3 . The portable device of  claim 1  wherein the determined gesture includes a hand motion. 
     
     
         4 . The portable device of  claim 1  wherein the determined gesture includes a pose. 
     
     
         5 . The portable device of  claim 1  wherein the electro-optical sensor is fixed in relation to the digital camera. 
     
     
         6 . The portable device of  claim 1  further including a forward facing light source. 
     
     
         7 . The portable device of  claim 1  wherein the electro-optical sensor defines a resolution less than a resolution defined by the digital camera. 
     
     
         8 . The portable device of  claim 1  wherein the electro-optical sensor includes at least one of a CCD detector and a CMOS detector. 
     
     
         9 . A computer implemented method comprising:
 providing a portable device including a digital camera on a forward facing portion thereof, the digital camera defining a field of view;   determining, using a processing unit, a gesture performed in the digital camera field of view; and   capturing an image to the digital camera in response to the determined gesture corresponding to an image capture command.   
     
     
         10 . The method according to  claim 9  wherein the determined gesture includes a hand motion. 
     
     
         11 . The method according to  claim 9  wherein the determined gesture includes a pose. 
     
     
         12 . The method according to  claim 9  further including providing a forward facing electro-optical sensor and detecting, using the electro-optical sensor, the gesture performed in the digital camera field of view. 
     
     
         13 . The method according to  claim 12  wherein the electro-optical sensor includes first and second sensors in fixed relation relative to the digital camera. 
     
     
         14 . The method according to  claim 12  wherein the electro-optical sensor defines a resolution less than a resolution defined by the digital camera. 
     
     
         15 . An image capture device comprising:
 a digital camera adapted to capture an image and having a field of view;   a sensor adapted to detect a gesture in the digital camera field of view; and   a processing unit operatively coupled to the sensor and to the digital camera, wherein the processing unit is adapted to correlate a gesture detected by the sensor with an image capture function and subsequently capture an image using the digital camera.   
     
     
         16 . The image capture device of  claim 15  wherein the determined gesture includes a hand motion. 
     
     
         17 . The image capture device of  claim 15  wherein the determined gesture includes a pose. 
     
     
         18 . The image capture device of  claim 15  further including a forward facing light source. 
     
     
         19 . The image capture device of  claim 15  wherein the sensor defines a resolution less than a resolution defined by the digital camera. 
     
     
         20 . The image capture device of  claim 15  wherein the sensor is fixed in relation to the digital camera.