Image processing apparatus and method

Abstract

An image processing apparatus that configures a single frame by determining a central image of a certain viewpoint as an original resolution, and frame another single frame by combining a left image of a left viewpoint and a right image of a right viewpoint. The image processing apparatus may generate three-dimensional (3D) image data configured using the frames, and may encode, decode, and render an image based on the 3D image data.

What is claimed is: 
     
         1 . An image processing apparatus, comprising:
 an image input unit to receive an original left image, an original central image, and an original right image;   an image processor to generate a processed left image and a processed right image by processing the original left image and the original right image; and   an image generator to generate three-dimensional (3D) image data including a first frame image and a second frame image, the first frame image configured using the original central image and the second frame image configured using the processed left image and the processed right image.   
     
     
         2 . The image processing apparatus of  claim 1 , wherein the image processor generates the processed left image and the processed right image by reducing, by half, a vertical resolution of the original left image and a vertical resolution of the original right image. 
     
     
         3 . The image processing apparatus of  claim 1 , wherein the image processor generates an odd image including odd lines and an even image including even lines by interlacing the original left image and the original right image, and determines the odd image and the even image as the processed left image and the processed right image. 
     
     
         4 . The image processing apparatus of  claim 1 , wherein the image processor generates a checkerboard left image having half a resolution of the original left image and a checkerboard right image having half a resolution of the original right image by arranging the original left image and the original right image in a checkerboard type, and determines the checkerboard left image and the checkerboard right image as the processed left image and the processed right image. 
     
     
         5 . The image processing apparatus of  claim 1 , wherein the 3D image data further comprises auxiliary data including at least one of depth image data corresponding to each viewpoint image, segmentation information, and transparency information, and metadata including at least one of camera parameter information and depth range information. 
     
     
         6 . The image processing apparatus of  claim 1 , wherein the 3D image data further comprises filter information including history information regarding the original left image and the original right image being processed to the processed left image and the processed right image. 
     
     
         7 . The image processing apparatus of  claim 1 , further comprising:
 an image adder to add two-dimensional (2D) image data to the original central image when a 2D image is added, to add stereo image data to the original left image and the original right image when a stereo image is added, and to add multi-view image data to the original central image, the original left image, and the original right image when a multi-view image is added.   
     
     
         8 . The image processing apparatus of  claim 1 , further comprising:
 an encoder to encode the 3D image data.   
     
     
         9 . An image processing apparatus, comprising:
 a warping unit to three dimensionally warp a first viewpoint image of a first resolution and a second viewpoint image of a second resolution;   an image processor to generate a correction image by processing the warped second viewpoint image; and   an image blender to generate a new viewpoint image by blending the warped first viewpoint image and the correction image.   
     
     
         10 . The image processing apparatus of  claim 9 , wherein the image processor generates the correction image having the first resolution by interpolating the warped second viewpoint image. 
     
     
         11 . The image processing apparatus of  claim 9 , wherein the image interpolator uses filter information containing processing history information of the second viewpoint image to interpolate the second viewpoint image. 
     
     
         12 . An image processing method, comprising:
 receiving an original left image, an original central image, and an original right image;   generating a processed left image and a processed right image by processing the original left image and the original right image; and   generating 3D image data including a first frame image and a second frame image, the first frame image configured using the original central image and the second frame image configured using the processed left image and the processed right image.   
     
     
         13 . The image processing method of  claim 12 , wherein the generating of the processed left image and the processed right image comprises generating the processed left image and the processed right image by reducing, by half, a vertical resolution of the original left image and a vertical resolution of the original right image. 
     
     
         14 . The image processing method of  claim 12 , wherein the generating of the processed left image and the processed right image comprises generating an odd image including odd lines and an even image including even lines by interlacing the original left image and the original right image, and determines the odd image and the even image as the processed left image and the processed right image. 
     
     
         15 . The image processing method of  claim 12 , wherein the generating of the processed left image and the processed right image comprises generating a checkerboard left image having half a resolution of the original left image and a checkerboard right image having half a resolution of the original right image by arranging the original left image and the original right image in a checkerboard type, and determining the checkerboard left image and the checkerboard right image as the processed left image and the processed right image. 
     
     
         16 . The image processing method of  claim 12 , wherein the 3D image data further comprises filter information including history information regarding the original left image and the original right image being processed to the processed left image and the processed right image. 
     
     
         17 . The image processing method of  claim 12 , further comprising encoding the 3D image data. 
     
     
         18 . A non-transitory computer-readable recording medium storing a program to implement the method of  claim 12 . 
     
     
         19 . An image processing apparatus, comprising:
 an image input unit to receive images denoting differing viewpoints with respect to a central one of the images and with respect to each other;   an image processor to generate a processed first image based on a first one of the images having a differing viewpoint than the central one of the images and a processed second image based on a second one of the images having a differing viewpoint with respect to the central one of the images; and   an image generator to generate three-dimensional (3D) image data including a first frame image and a second frame image, the first frame image configured using the central one of the images and the second frame image configured using the processed first image and the processed second image.   
     
     
         20 . The image processing apparatus of  claim 19 , wherein the received images include a left image, the central one of the images, and a right image. 
     
     
         21 . The image processing apparatus of  claim 20 , wherein the left image corresponds to the first one of the images, and the right image corresponds to the second one of the images.