Systems and Methods for Haptic Remote Control Gaming

Abstract

Systems and methods for haptic remote control gaming are disclosed. In one embodiment a portable multifunction device receives information from a remotely controllable device. The portable multifunction device can be operable as a remote control for the remotely controllable device. The portable multifunction device may be a smartphone, a tablet computer, or another suitable electronic device. The portable multifunction device can determine a haptic effect based at least in part on the information received from the remotely controllable device. The portable multifunction device may generate a signal configured to cause an actuator to output the determined haptic effect. The portable multifunction device can output the signal.

1 - 20 . (canceled) 
     
     
         21 . A method comprising:
 receiving a first video signal, by a processor of a remote control, the first video signal associated with a remotely controllable (“RC”) device controlled by the remote control at a first position in a real environment;   displaying a first portion of an augmented reality (“AR”) or virtual reality (“VR”) environment by the remote control using the first video signal, the first portion of the AR or VR environment based on a first virtual position of the RC device within the AR or VR environment, the first virtual position associated with the first position in the real environment;   transmitting a control signal, by the remote control, to the RC device, the control signal configured to cause a movement of the RC device in the real environment;   receiving a second video signal, by the processor of the remote control, the second video signal associated with the RC device at a second position in the real environment; and   displaying a second portion of the AR or VR environment by the remote control using the second video signal, the second portion of the AR or VR environment based on a second virtual position of the RC device within the AR or VR environment, the second virtual position associated with the second position in the real environment.   
     
     
         22 . The method of  claim 21 , further comprising:
 receiving an RC device video signal by the processor of the remote control from the RC device, and   wherein displaying the first or second portions of the AR or VR environment comprises displaying a video based on the RC device video signal, and wherein the respective first or second portions of the AR or VR environment comprise a graphical overlay displayed on the video.   
     
     
         23 . The method of  claim 21 , further comprising:
 receiving a position of a second RC device in a second real environment by the processor of the remote control; and   wherein displaying the first or second portions of the AR or VR environment comprises displaying a graphical representation of the second RC device within the AR or VR environment based on the position of the second RC device in the second real environment.   
     
     
         24 . The method of  claim 23 , wherein the real environment and the second real environment are geographically remote from each other. 
     
     
         25 . The method of  claim 24 , further comprising:
 receiving, by the processor of the remote control, an indication of an AR collision between the RC device and the second RC device within the AR or VR environment.   
     
     
         26 . The method of  claim 21 , wherein the RC device comprises a helicopter or a wheeled vehicle. 
     
     
         27 . The method of  claim 21 , further comprising:
 receiving, by the processor of the remote control, an indication of damage to the RC device within the AR or VR environment resulting from a weapon fired by a second RC device within the AR or VR environment or a collision with an object within the AR or VR environment;   generating, by the processor of the remote control, a haptic effect based on the indication of damage; and   outputting, by the remote control, the haptic effect.   
     
     
         28 . A remote control comprising:
 a communications interface;   a display device;   a user input device;   a non-transitory computer-readable medium; and   a processor in communication with the communications interface, the display device, the user input device, and the non-transitory computer-readable medium, the processor configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:   receive a first video signal using the communications interface, the first video signal associated with a remotely controllable (“RC”) device controlled by the remote control at a first position in a real environment;   cause the display device to display a first portion of an augmented reality (“AR”) or virtual reality (“VR”) environment based on the first video signal, the first portion of the AR or VR environment based on a first virtual position of the RC device within the AR or VR environment, the first virtual position associated with the first position in the real environment;   transmit a control signal to the RC device using the communications interface, the control signal configured to cause a movement of the RC device in the real environment;   receive a second video signal using the communications interface, the second video signal associated with the RC device at a second position in the real environment; and   cause the display device to display a second portion of the AR or VR environment by the remote control using the second video signal, the second portion of the AR or VR environment based on a second virtual position of the RC device within the AR or VR environment, the second virtual position associated with the second position in the real environment.   
     
     
         29 . The remote control of  claim 28 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive an RC device video signal by the processor of the remote control from the RC device, and   cause the display device to display a video based on the RC device video signal, and   cause the display device to display the first and second portions of the AR or VR environment overlaid on the video.   
     
     
         30 . The remote control of  claim 28 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive a position of a second RC device in a second real environment by the processor of the remote control; and   cause the display device to display a graphical representation of the second RC device within the AR or VR environment based on the position of the second RC device in the second real environment.   
     
     
         31 . The remote control of  claim 30 , wherein the real environment and the second real environment are geographically remote from each other. 
     
     
         32 . The remote control of  claim 31 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive an indication of an AR collision between the RC device and the second RC device within the AR or VR environment.   
     
     
         33 . The remote control of  claim 28 , wherein the RC device comprises a helicopter or a wheeled vehicle. 
     
     
         34 . The remote control of  claim 28 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive an indication of damage to the RC device within the AR or VR environment resulting from a weapon fired by a second RC device within the AR or VR environment or a collision with an object within the AR or VR environment;   generate a haptic signal based on the indication of damage; and   output the haptic signal.   
     
     
         35 . A non-transitory computer-readable medium comprising processor-executable program code configured to cause a processor to:
 receive a first video signal using a communications interface of a remote control, the first video signal associated with a remotely controllable (“RC”) device controlled by the remote control at a first position in a real environment;   cause a display device to display a first portion of an augmented reality (“AR”) or virtual reality (“VR”) environment based on the first video signal, the first portion of the AR or VR environment based on a first virtual position of the RC device within the AR or VR environment, the first virtual position associated with the first position in the real environment;   transmit a control signal to the RC device using the communications interface, the control signal configured to cause a movement of the RC device in the real environment;   receive a second video signal using the communications interface, the second video signal associated with the RC device at a second position in the real environment; and   cause the display device to display a second portion of the AR or VR environment by the remote control using the second video signal, the second portion of the AR or VR environment based on a second virtual position of the RC device within the AR or VR environment, the second virtual position associated with the second position in the real environment.   
     
     
         36 . The non-transitory computer-readable medium of  claim 35 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive an RC device video signal by the processor of the remote control from the RC device, and   cause the display device to display a video based on the RC device video signal, and   cause the display device to display the first and second portions of the AR or VR environment overlaid on the video.   
     
     
         37 . The non-transitory computer-readable medium of  claim 35 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive a position of a second RC device in a second real environment by the processor of the remote control; and   cause the display device to display a graphical representation of the second RC device within the AR or VR environment based on the position of the second RC device in the second real environment.   
     
     
         38 . The non-transitory computer-readable medium of  claim 37 , wherein the real environment and the second real environment are geographically remote from each other. 
     
     
         39 . The non-transitory computer-readable medium of  claim 38 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive an indication of an AR collision between the RC device and the second RC device within the AR or VR environment.   
     
     
         40 . The non-transitory computer-readable medium of  claim 35 , wherein the RC device comprises a helicopter or a wheeled vehicle. 
     
     
         41 . The non-transitory computer-readable medium of  claim 35 , wherein the processor is configured to execute processor-executable program code stored in the non-transitory computer-readable medium to:
 receive an indication of damage to the RC device within the AR or VR environment resulting from a weapon fired by a second RC device within the AR or VR environment or a collision with an object within the AR or VR environment;   generate a haptic signal based on the indication of damage; and   output the haptic signal.