Camera based sensing in handheld, mobile, gaming or other devices

Abstract

Method and apparatus are disclosed to enable rapid TV camera and computer based sensing in many practical applications, including, but not limited to, handheld devices, cars, and video games. Several unique forms of social video games are disclosed.

1 . A handheld device comprising:
 a housing;   first and second cameras supported by the housing and providing an output; and   a computer within the housing operable to determine position or orientation information concerning an object based on the output of at least one of the first and second cameras.   
     
     
         2 . The device of  claim 1  wherein the first and second cameras are fixed with respect to the housing. 
     
     
         3 . The device of  claim 1  wherein the first and second cameras having overlapping fields of view. 
     
     
         4 . The device of  claim 1  wherein the position or orientation information is determined based on the output of the first and second cameras. 
     
     
         5 . The device of  claim 1  wherein the object is a finger of the user. 
     
     
         6 . The device of  claim 1  wherein the device comprises a mobile phone. 
     
     
         7 . The device of  claim 1  wherein the computer is operable to determine a control input based on the object position. 
     
     
         8 . The device of  claim 1  wherein the computer is operable to determine a control input based on the object orientation. 
     
     
         9 . The device of  claim 1  wherein the housing is adapted to be held in the hand of a user. 
     
     
         10 . A method for providing a control input, the method comprising:
 providing a handheld device including a computer and first and second cameras having overlapping fields of view;   determining, using the computer, information concerning an object viewed by the first and second cameras within the overlapping fields of view; and   controlling the handheld device using the determined information.   
     
     
         11 . The method of  claim 10  wherein determining information concerning an object includes identifying a gesture. 
     
     
         12 . The method of  claim 10  wherein the determining step includes determining the orientation or position of the object in three-dimensions. 
     
     
         13 . The method of  claim 10  wherein the object includes at least a portion of a user of the handheld device. 
     
     
         14 . The method of  claim 10  wherein the first and second cameras are fixed with respect to the housing. 
     
     
         15 . The method of  claim 10  wherein the handheld device comprises a mobile phone. 
     
     
         16 . The method of  claim 10  further including:
 obtaining an image of the object using the first and second cameras; and 
 displaying a three-dimensional image of the object. 
 
     
     
         17 . A handheld device comprising:
 a housing;   first and second cameras supported by the housing; and   a computer operable to determine a control input based on an object imaged by at least one of the first and second cameras.   
     
     
         18 . The device of  claim 17  wherein the first and second cameras having overlapping fields of view. 
     
     
         19 . The device of  claim 17  wherein the housing is adapted to be held in a hand of a user. 
     
     
         20 . The device of  claim 17  wherein the first and second cameras are fixed with respect to the housing. 
     
     
         21 . The device of  claim 17  wherein the object includes a portion of a user of the handheld device. 
     
     
         22 . The device of  claim 17  wherein the object is a writing instrument held in the hand of a user. 
     
     
         23 . The device of  claim 17  wherein the device comprises a mobile phone.