Remote control augmented motion capture

Abstract

A head mounted display system comprises a main body configured to be worn on a human head and to secure therein a mobile computing device having a display and hardware for generating images on the display corresponding to motion data. The system further includes a remote controller, distinct from, but in communication with, the mobile computing device, which when detachably attached to the exterior of the main body provides the motion data to the mobile computing device that is used by the mobile computing device in performing head tracking of the human head, the remote controller incorporating a remote controller processor, at least one motion sensor for providing the motion data

It is claimed: 
     
         1 . A head mounted display system comprising:
 a main body configured to be worn on a human head and to secure therein a mobile computing device having a display and hardware for generating images on the display corresponding to motion data; and   a remote controller, distinct from, but in communication with, the mobile computing device, which when detachably attached to the exterior of the main body provides the motion data to the mobile computing device that is used by the mobile computing device in performing head tracking of the human head, the remote controller incorporating a remote controller processor and at least one motion sensor for providing the motion data.   
     
     
         2 . The head mounted display system of  claim 1  further comprising a sensor for detecting attachment of the remote controller to the main body. 
     
     
         3 . The head mounted display system of  claim 2  wherein the sensor comprises a depressible button such that when the remote controller is detachably attached to the exterior of the main body, the depressible button is depressed by the exterior of the main body thereby indicating that the remote controller is attached to the exterior of the main body. 
     
     
         4 . The head mounted display system of  claim 3  wherein the depressible button is configured so as to be depressed and retained in a depressed state for the duration of the attachment. 
     
     
         5 . The head mounted display system of  claim 1  wherein the at least one motion sensor comprises a gyroscope and the at least one motion sensor provides the motion data to the computing device so that images displayed on the display may be updated to reflect motion of the head mounted display system. 
     
     
         6 . The head mounted display system of  claim 1  wherein the remote controller includes a plurality of unique control buttons on an exterior face thereof, wherein the control buttons face a direction other than toward the main body when the remote controller is secured to the exterior of the main body. 
     
     
         7 . The head mounted display system of  claim 1  wherein the remote controller is a first remote controller and further including a second remote controller detachably secured to the exterior of the main body on a side opposite the first remote controller, the second remote controller, distinct from the first remote controller and the mobile computing device, detachably attached to the exterior of the main body and being in communication with the computing device, the second remote controller incorporating a remote controller processor and at least one second motion sensor and, when detachably secured to the main body, the second remote controller provides additional motion data from the at least one second motion sensor to the computing device to combine with the motion data produced by the first remote controller to assist the computing device in performing head tracking of the head mounted display system. 
     
     
         8 . The head mounted display system of  claim 1 , wherein the remote controller has a forward-facing camera lens when the remote controller is secured to the exterior of the main body, wherein images received by the camera lens are communicated to the mobile computing device to be displayed on the display of the computing device. 
     
     
         9 . The head mounted display system of  claim 1  wherein the remote controller is used to generate control data that is used for purposes other than to perform head tracking. 
     
     
         10 . A method of performing head tracking for a head mounted display system comprising:
 automatically detecting detachable attachment of a remote controller, distinct from the mobile computing device, to the main body;   generating motion data using at least one motion sensor within the remote controller detachably attached to the head-mounted main body of the system;   communicating the motion data from the remote controller to the mobile computing device;   processing the motion data from the remote controller to perform head tracking; and   updating an image shown on the display of the computing device according to the motion data.   
     
     
         11 . The method of  claim 10  wherein the automatically detecting attachment of the remote controller relies upon a sensor for detecting attachment of the remote controller to the main body. 
     
     
         12 . The method of  claim 11  wherein the automatically detecting attachment of the remote controller comprises detecting that a depressible button has been depressed by the exterior of the main body when the remote controller is attached to the exterior of the main body thereby indicating that the remote controller is attached to the exterior of the main body. 
     
     
         13 . The method of  claim 10  further comprising automatically detecting that the remote controller has been detached from the head-mounted main body. 
     
     
         14 . The method of  claim 11  further comprising ceasing head tracking using the motion data in response to detachment of the remote controller from the head mounted display. 
     
     
         15 . The method of  claim 10  further comprising using the remote controller to generate control data that is used for purposes other than to perform head tracking. 
     
     
         16 . The method of  claim 15  wherein the purposes are selected from the group comprising controlling an avatar visible on the display, inputting commands for interaction with the environment shown on the display, and making selections from a menu on the display. 
     
     
         17 . A head mounted display system comprising:
 a main body configured to be worn on a human head and to secure a detachable mobile computing device having a processor and a display, the mobile computing device capable of using motion data that to perform head tracking in order to update an image shown on the display;   the main body further comprising an attachment structure on the exterior of the main body for attaching a remote controller to the exterior of the main body;   a set of two lenses disposed within the main body between the eyes of a wearer and the display of the mobile computing device, the lenses for focusing the vision of the wearer on respective portions of the display so at to generate a stereoscopic three-dimensional image for a wearer; and   a remote controller, distinct from, but in communication with, the mobile computing device, which when detachably attached to the exterior of the main body by mating with the attachment structure, the remote controller for providing motion data to the mobile computing device that is used by the mobile computing device to perform head tracking, the remote controller incorporating a remote controller processor and at least one motion sensor for providing the motion data.   
     
     
         18 . The head mounted display system of  claim 17  wherein the remote controller includes a plurality of unique control buttons on an exterior face thereof none of which are alike, wherein the control buttons face a direction other than toward the main body when the remote controller is secured to the exterior of the main body. 
     
     
         19 . The head mounted display system of  claim 17  wherein the remote controller is a first remote controller and further including a second remote controller detachably secured to a second attachment structure having a second docking feature on the exterior of the main body on a side opposite the first remote controller causing the second docking feature to depress a second integrated switch indicating that the second remote control is detachably connected to the main body, the second remote controller also being in communication with the mobile computing device, the second remote controller incorporating a second remote controller processor and at least one second motion sensor and, when detachably secured to the main body, the second remote controller providing additional motion data used to perform head tracking of the head mounted display system in addition to the motion data. 
     
     
         20 . The head mounted display system of  claim 17  wherein disengagement of the docking feature with the switch causes the remote to cease generating motion data for use in performing head tracking.