3D photo creation system and method

Abstract

The present application is directed to a 3D photo creation system and method, wherein the 3D photo creation system including: a stereo image input module configurated to input a stereo image; wherein the stereo image comprises a left eye image and a right eye image; a depth estimation module configurated to estimate a depth information of the stereo image and create a depthmap; a multi-view angle image reconstructing module configurated to create a multi-view angle image according to the depthmap and the stereo image; and an image spaced scanning module configurated to adjust the multi-view angle image and form a mixed image. The system and method outstandingly simplified the process of 3D photo creation and enhanced the quality of 3D photo. The system and method can be widely used in various theme parks, tourists attraction spots and photo galleries and bring about pleasure to more consumers with the 3D photos.

What is claimed is: 
     
       1. A 3D photo creation system, comprising:
 (a) a stereo image input module configurated to input a stereo image; wherein the stereo image comprises a left eye image and a right eye image; 
 (b) a depth estimation module configurated to estimate a depth information of the stereo image and create a depthmap; 
 (c) a multi-view angle image reconstructing module configurated to create a set of multi-view angle images comprising a plurality of images having different disparities according to the depthmap and the stereo image; and 
 (d) an image spaced scanning module configurated to adjust the set of multi-view angle images and form a mixed image; 
 wherein the depth estimation module comprising: 
 (b1) a pixel matching module configurated to compare the left eye image and the right eye image of the stereo image and find a matching pixel between the left eye image and the right eye image, and find an optical flow of the pixel according to an optical flow constraint formula; 
 (b2) a depth information confirmation module configurated to find a pixel shifting according to the optical flow of the left eye image and the right eye image to confirm the depth information of the pixel; and 
 (b3) a depthmap creation module configurated to create the depthmap according to the depth information; 
 wherein a scale of the mixed image is adjusted and the scale is calculated by an equation
   Width actual =LPI ideal /LPI actual ×Width ideal  
 
 
 where the LPI ideal  is a line per inch of a lenticular lens at an ideal situation, the LPI actual  is an actual line per inch of the lenticular lens; the Width ideal  is an ideal width of the lenticular lens, and the Width actual  is an actual width of the lenticular lens. 
 
     
     
       2. The 3D photo creation system according to  claim 1 , wherein the multi-view angle image reconstructing module comprising:
 (c1) a base image selection module configurated to select the left eye image, the right eye image or the left eye image and the right eye image of the stereo image as a base image; 
 (c2) an image number confirmation module configurated to confirm a number and disparity of a required image according to demand; 
 (c3) a pixel shifting module configurated to shift pixels of the base image according to the depthmap to form a new image; 
 (c4) a hole filling module configurated to fill holes formed from a loss of pixels in the new image; and 
 (c5) a multi-view angle image creation module configurated to create the set of multi-view angle images. 
 
     
     
       3. The 3D photo creation system according to  claim 2 , wherein the image spaced scanning module comprising:
 (d1) an image adjusting module configurated to adjust a size of the set of multi-view angle images; 
 (d2) a contrast adjusting module configurated to adjust a contrast ratio of the adjusted set of multi-view angle images outputted by the image adjusting module; 
 (d3) an image interlacing module configurated to combine the set of multi-view angle images after the contrast adjustment into a mixed image; and 
 (d4) a mixed image output module configurated to output the mixed image. 
 
     
     
       4. The 3D photo creation system according to  claim 2 , wherein the hole filling module applies the interpolation method to fill the holes formed from the loss of pixels in the new image. 
     
     
       5. The 3D photo creation system according to  claim 2 , wherein the number of the required image is determined by an equation N=DPI/LPI, where the DPI is a dot per inch of a printer, and the LPI is a line per inch of a lenticular lens. 
     
     
       6. The 3D photo creation system according to  claim 1 , wherein the optical flow of the pixel is determined by a coarse-to-fine strategy. 
     
     
       7. The 3D photo creation system according to  claim 1 , wherein a foreground scene and a background scene are separated in the depthmap, the pixel at a depth value ranging within 99 to 255 represents the foreground scene and the pixel at the depth value ranging within 0 to 128 represents the background scene. 
     
     
       8. A 3D photo creation method, wherein comprising the following steps:
 S 1 ) inputting a stereo image; wherein the stereo image comprises a left eye image and a right eye image; 
 S 2 ) estimating a depth information of the stereo image and creating a depthmap; 
 S 3 ) creating a set of multi-view angle images comprising a plurality of images having different disparities according to the depthmap and the stereo image; and 
 S 4 ) adjusting the set of multi-view angle images to form a mixed image; 
 wherein the step S 2  comprising the following steps: 
 S 21 ) comparing the left eye image and the right eye image of the stereo image and finding a matching pixel between the left eye image and the right eye image, and calculating an optical flow of the pixel according to an optical flow constraint formula; 
 S 22 ) finding a shifting of the pixel according to the optical flow of the left eye image and the right eye image to confirm the depth information of the pixel; and 
 S 23 ) creating the depthmap according to the depth information; 
 wherein the step S 3  comprising: 
 S 31 ) selecting the left eye image, the right eye image or the left eye image and the right eye image of the stereo image as a base image; 
 S 32 ) confirming a number and disparity of a required image according to demand; 
 S 33 ) shifting pixels of the base image according to the depthmap to form a new image; 
 S 34 ) filling holes formed from a loss of pixels in the new image; and 
 S 35 ) creating the set of multi-view angle images; 
 wherein a scale of the mixed image is adjusted and the scale is calculated by an equation
   Width actual =LPI ideal /LPI actual ×Width ideal  
 
 
 where the LPI ideal  is a line per inch of a lenticular lens at an ideal situation, the LPI actual  is an actual line per inch of the lenticular lens; the Width ideal  is an ideal width of the lenticular lens, and the Width actual  is an actual width of the lenticular lens. 
 
     
     
       9. The 3D photo creation method according to  claim 8 , wherein the step S 3  comprising:
 S 31 ) selecting the left eye image, the right eye image or the left eye image and the right eye image of the stereo image as a base image; 
 S 32 ) confirming a number and disparity of a required image according to demand; 
 S 33 ) shifting pixels of the base image according to the depthmap to form a new image; 
 S 34 ) filling holes formed from a loss of pixels in the new image; and 
 S 35 ) creating the set of multi-view angle images. 
 
     
     
       10. The 3D photo creation method according to  claim 9 , wherein the step S 4  comprising:
 S 41 ) adjusting a size of the set of multi-view angle images; 
 S 42 ) adjusting a contrast ratio of the set of multi-view angle images adjusted by the step S 41 ; 
 S 43 ) combining the set of multi-view angle images after the contrast adjustment and forming a mixed image; 
 S 44 ) outputting the mixed image. 
 
     
     
       11. The 3D photo creation method according to  claim 9 , wherein the step  34  applies interpolation method to fill the holes formed from the loss of pixel in the new image. 
     
     
       12. The 3D photo creation method according to  claim 9 , wherein the number of the required image is determined by an equation N=DPI/LPI, where the DPI is a dot per inch of a printer, and the LPI is a line per inch of a lenticular lens. 
     
     
       13. The 3D photo creation method according to  claim 8 , wherein the optical flow of the pixel is determined by a coarse-to-fine strategy. 
     
     
       14. The 3D photo creation method according to  claim 8 , wherein a foreground scene and a background scene are separated in the depthmap, the pixel having a depth value ranging within 99 to 255 represents the foreground scene and the pixel having the depth value ranging within 0 to 128 represents the background scene.