Method of processing three-dimensional image in mobile device

Abstract

A processing method of interfacing a 3D image and a camera image is provided. In the processing method, a specific image pattern defined by a user is recognized, the recognized pattern is traced within an image, and a camera image and a 3D image are interfaced based on the tracing result. A 3D object is animated and rendered using a 3D graphic engine. The rendered image of the 3D object and the camera image are integrated and displayed.

1 . A method of processing a 3D image in a mobile device, the mobile device having a camera and a 3D graphic engine, the method comprising: 
 recognizing a specific pattern designated by a user based on images inputted by the camera, and setting the recognized pattern as a defined pattern;    tracing the defined pattern among the images inputted by the camera, and interfacing the pattern and a 3D image; and    performing an animation process followed by a response of a corresponding 3D image in accordance with the tracing result of the pattern interfaced with the 3D image, integrating the processed image and the camera image, and displaying the integrated image.    
     
     
         2 . The method according to  claim 1 , wherein the mobile device includes mobile phone, PDA, PDA phone, smart phone, notebook computer, and PMP, all of which has a camera mounted thereon.  
     
     
         3 . The method according to  claim 1 , wherein the tracing result of the defined pattern within the camera image is used as a user interface.  
     
     
         4 . The method according to  claim 1 , wherein the specific pattern is manually designated by the user or designated by a previously stored image file.  
     
     
         5 . The method according to  claim 1 , wherein the specific pattern is selected in accordance with a color, a region, or an inputted image.  
     
     
         6 . The method according to  claim 1 , wherein the specific pattern is designated from the previously stored image file; regions similar to the image file are detected within the camera image and are set as candidate patterns; and the user approves the desired pattern of the detected candidate patterns.  
     
     
         7 . The method according to  claim 1 , wherein the response of an animation image followed by the tracing of the specific pattern is based on a collision process between the specific pattern within the camera and a 3D object.  
     
     
         8 . The method according to  claim 1 , wherein the interface between the camera image and the 3D image includes: 
 extracting a region where a 3D object is rendered;    extracting a region where the pattern of the camera image exists; and    checking whether or not the two regions are intersected with each other.    
     
     
         9 . The method according to  claim 1 , wherein the recognition and setting of the specific pattern are executed when a system starts, are called and executed for re-designating the pattern when the pattern tracing fails, and are executed when there is a forced call of an application program level, including a designation of a new pattern by the user.  
     
     
         10 . The method according to  claim 1 , wherein the pattern is traced in real time by referring to a position information of the pattern in a previous frame of the camera image and estimating a motion of a pattern of a next frame.  
     
     
         11 . A method of processing an interface between a camera image and a graphic image, comprising: 
 setting a specific pattern of an image as an image-based interface tool;    recognizing the set pattern among images inputted by a camera, and tracing the recognized pattern;    generating a response of a graphic image in accordance with the pattern tracing; and    combining the traced pattern and the responding graphic image, and displaying the combined image.    
     
     
         12 . The method according to  claim 11 , wherein the specific pattern is set among image acquired by the camera.  
     
     
         13 . The method according to  claim 11 , wherein characteristic of the specific pattern is manually designated by a user.  
     
     
         14 . The method according to  claim 11 , wherein characteristic of the specific pattern is designated by setting a color of the pattern, or setting a region of the pattern, or selecting a previously stored image.  
     
     
         15 . The method according to  claim 11 , wherein the setting of the specific pattern includes: 
 designating an image for the setting of the pattern;    detecting a pattern similar to the designated image within images acquired by the camera; and    setting the pattern selected among the detected candidate patterns by the user.    
     
     
         16 . The method according to  claim 11 , wherein a specific operation of the device is carried out from the response of the graphic image according to the pattern tracing.  
     
     
         17 . The method according to  claim 11 , wherein the response of the graphic image in accordance with the pattern tracing is an animation effect.  
     
     
         18 . The method according to  claim 11 , wherein the set pattern is mapped into a specific object within the graphic image, the mapped image is combined with the graphic image in real time, and the combined image is displayed.  
     
     
         19 . The method according to  claim 11 , wherein the generation of the response of the graphic image in accordance with the pattern tracing includes: 
 extracting a region where a specific object is rendered within the graphic image;    extracting a region where the set pattern of the camera image exists; and    generating the response of the graphic image according to whether the two regions are intersected with each other.    
     
     
         20 . The method according to  claim 11 , wherein the interfaced image is a 2D camera image and a 3D graphic image.