System and method for augmented reality gaming

Abstract

Disclosed is a method for enabling language translation with respect to subject text presented in association with a device in a first language. The method includes: receiving information to identify the device and the subject text to a user, enabling the user to capture a live camera image of the subject text in the first language via a camera on a mobile device video display, enabling the user to select a second language, accessing a data base providing a translated version of the subject text in the second language, and controlling the video display to overlay the translated version of the subject text in the second language at the video display over the image of the text in the first language, wherein the subject text in the second language provides context sensitive help for maintenance of device.

1 . A method of providing language translation with respect to subject text presented in association with a device in a first language, the method comprising;
 receiving information to identify the device and the subject text to a user;   enabling the user to capture a live camera image of the subject text in the first language via a camera on a mobile device video display;   enabling the user to select a second language;   accessing a data base providing a translated version of the subject text in the second language;   controlling the video display to overlay the translated version of the subject text in the second language at the video display over the image of the text in the first language, wherein the subject text in the second language provides context sensitive help for maintenance of device; and   displaying an augmented virtual component overlaid over a real corresponding component of the device to assistance in maintenance of the device.   
     
     
         2 . The method of  claim 1 , further comprising: using a depth buffer to determine which elements of a 3D rendering are visible with respect to the device. 
     
     
         3 . The method of  claim 2 , further comprising: determining a z-value of each element compared against an existing depth buffer z-value at the same screen coordinate, wherein if the existing depth buffer z-value is greater, the pixel is drawn, and wherein if the existing z-value is less than an existing depth buffer z-value at the same screen coordinate, then the pixel is discarded. 
     
     
         4 . The method of  claim 2 , further comprising: combining the camera video image with the elements of the 3D rendering that are visible. 
     
     
         5 . The method of  claim 2 , wherein the 3D rendering of the elements is a virtual depth-only rendering of the device. 
     
     
         6 . The method of  claim 2 , wherein 3D rendering of the device extracts 2D information from a display of the device to produce a 3D image of the device. 
     
     
         7 . The method of  claim 1 , further comprising: overlaying virtual graphics in a position within 3D space on a display of the mobile device that augments the display of the device to create complex augmented reality. 
     
     
         8 . The method of  claim 1 , wherein an object recognition system of an augmented reality assistance component establishes a communication channel between the augmented reality component and the device enabling additional elements of the device to be augmented on the mobile device. 
     
     
         9 . The method of  claim 1 , wherein the augmented reality translation system of the augmented reality assistance component extracts a first language from the display of the device and translates the first language into a second language associated with the user in place of the first language. 
     
     
         10 . A method of providing language translation with respect to subject text presented in association with a device in a first language, the method comprising;
 receiving information to identify the device and the subject text to a user;   enabling the user to capture a live camera image of the subject text in the first language via a camera on a mobile device video display;   enabling the user to select a second language;   accessing a data base providing a translated version of the subject text in the second language; and   controlling the video display to overlay the translated version of the subject text in the second language at the video display over the image of the text in the first language,   wherein the subject text in the second language provides context sensitive help for maintenance of device.   
     
     
         11 . The method of  claim 10 , wherein the maintenance to be performed on the device includes one or more of reconnecting a loose wire, directing a technician where to insert a key, directing a technician which buttons to select, and directing a technician which connections to check. 
     
     
         12 . The method of  claim 10 , wherein maintenance assistance provided includes one or more of displaying text, displaying a pre-recorded video, and displaying an augmented virtual component overlaid over a real corresponding component. 
     
     
         13 . A method of providing language translation with respect to subject text presented in association with a product in a first language, the method comprising;
 receiving information to identify the product and the subject text to a user;   enabling the user to capture a live camera image of the subject text in the first language via a camera on a mobile device video display;   enabling selection of a second language;   accessing a data base providing a translated version of the subject text in the second language; and   controlling the video display to overlay the translated version of the subject text in the second language at the video display over the image of the text in the first language,   wherein the subject text in the second language provides context sensitive help for maintenance of device.   
     
     
         14 . The method of  claim 13 , wherein the mobile device establishes a wireless connection to the device by connecting to a network socket at an IP address of the device. 
     
     
         15 . The method of  claim 13 , wherein data from the mobile device is used to adjust the display content. 
     
     
         16 . The method of  claim 13 , wherein adjustments to the display content include enabling player-selectable touchscreen buttons on the mobile device that perform a same action as pressing a physical button on the device. 
     
     
         17 . The method of  claim 13 , wherein known individual pixels of the device uniquely identify the device or uniquely identify associated information. 
     
     
         18 . The method of  claim 17 , wherein the uniquely identified associated information is an IP address. 
     
     
         19 . The method of  claim 13 , wherein Bluetooth or NFC transmission is employed as a transport technology or to identify the device. 
     
     
         20 . The method of  claim 13 , wherein multiple viewers of augmented content are enabled to view individualized augmented content from each viewer's independent viewpoint.