Stereoscopic image reproduction device and method, stereoscopic image capturing device, and stereoscopic display device

Abstract

A stereoscopic image is displayed with an appropriate amount of parallax on the basis of auxiliary information recorded in a three-dimensional image file. A 2D image file is read (Step S 31 ), and the size of a display which performs 2D display is acquired (Step S 32 ). The maximum display size capable of appropriately performing 2D display of a viewpoint image is acquired from metadata of the read 2D image file (Step S 33 ). The size acquired in Step S 32 is compared with the maximum display size acquired in Step S 33 (Step S 34 ). When the maximum display size is smaller, parallax displacement or parallax compression is performed, (Step S 35 ), and then 2D display is performed (Step S 36 ). Therefore, display can be appropriately performed on the basis of the maximum display size.

What is claimed is: 
     
         1 . A stereoscopic image reproduction device comprising:
 first acquisition part for reading a three-dimensional image file having recorded therein a plurality of viewpoint images for stereoscopic vision and auxiliary information including the maximum amount of parallax on a distant view side in the plurality of viewpoint images, and acquiring the plurality of viewpoint images and the auxiliary information from the three-dimensional image file;   second acquisition part for acquiring the display size of a stereoscopic display as an output destination;   determination part for determining whether or not binocular fusion is enabled when a plurality of viewpoint images are displayed on the stereoscopic display on the basis of the acquired maximum amount of parallax on the distant view side, the display size of the stereoscopic display, and a predetermined value representing an interocular distance of a person;   image processing part for generating a plurality of viewpoint images with smaller parallax on the distant view side between the a plurality of viewpoint images on the basis of the plurality of viewpoint images acquired by the first acquisition part if the determination part determined that binocular fusion is disabled; and   output part for outputting the viewpoint images generated by the image processing part to the stereoscopic display if the determination part determines that binocular fusion is disabled and outputting the viewpoint images acquired by the first acquisition part to the stereoscopic display if it is determined that binocular fusion is enabled.   
     
     
         2 . The stereoscopic image reproduction device according to  claim 1 ,
 wherein the determination part has image deviation amount calculation part for calculating the amount of image deviation on the stereoscopic display corresponding to the maximum amount of parallax when the plurality of viewpoint images are displayed on the stereoscopic display on the basis of the acquired maximum amount of parallax on the distant view side and the display size of the stereoscopic display, and determines whether or not binocular fusion is enabled depending on whether or not the calculated amount of image deviation exceeds the predetermined value representing the interocular distance of the person.   
     
     
         3 . The stereoscopic image reproduction device according to  claim 1 ,
 wherein the image processing part performs parallax displacement between the plurality of viewpoint images such that the maximum amount of parallax on the distant view side of the plurality of viewpoint images on the stereoscopic display is equal to or smaller than a predetermined value representing an interocular distance of a person, and generating viewpoint shift images subjected to the parallax displacement.   
     
     
         4 . The stereoscopic image reproduction device according to  claim 2 ,
 wherein the image processing part performs parallax displacement between the plurality of viewpoint images such that the maximum amount of parallax on the distant view side of the plurality of viewpoint images on the stereoscopic display is equal to or smaller than a predetermined value representing an interocular distance of a person, and generating viewpoint shift images subjected to the parallax displacement.   
     
     
         5 . The stereoscopic image reproduction device according to  claim 3 ,
 wherein the auxiliary information of the three-dimensional image file includes the maximum amount of parallax on a near view side in the plurality of viewpoint images,   the stereoscopic image reproduction device further includes addition part for adding the maximum amount of parallax on the near view side of the plurality of viewpoint images on the stereoscopic display and the amount of deviations of the viewpoint shift images on the stereoscopic display; and   determination part for determining whether or not the amount of image deviation corresponding to the added maximum amount of parallax on the near view side exceeds a binocular fusion limit when being displayed on the stereoscopic display, and if the determination part determines that the amount of image deviation exceeds the binocular fusion limit, the output part outputs one of the plurality of viewpoint images acquired by the first acquisition part to the stereoscopic display to display a two-dimensional image.   
     
     
         6 . The stereoscopic image reproduction device according to  claim 4 ,
 wherein the auxiliary information of the three-dimensional image file includes the maximum amount of parallax on a near view side in the plurality of viewpoint images,   the stereoscopic image reproduction device further includes addition part for adding the maximum amount of parallax on the near view side of the plurality of viewpoint images on the stereoscopic display and the amount of deviations of the viewpoint shift images on the stereoscopic display; and   determination part for determining whether or not the amount of image deviation corresponding to the added maximum amount of parallax on the near view side exceeds a binocular fusion limit when being displayed on the stereoscopic display, and   if the determination part determines that the amount of image deviation exceeds the binocular fusion limit, the output part outputs one of the plurality of viewpoint images acquired by the first acquisition part to the stereoscopic display to display a two-dimensional image.   
     
     
         7 . The stereoscopic image reproduction device according to  claim 1 ,
 wherein the image processing part has parallax amount calculation part for calculating the amount of parallax representing the amount of deviation between feature points having common features from the plurality of viewpoint images acquired by the first acquisition part, and virtual viewpoint image generation part for generating one or a plurality of virtual viewpoint images corresponding to an arbitrary virtual viewpoint on the basis of at least one viewpoint image from the plurality of viewpoint images acquired by the first acquisition part and the amount of parallax calculated by the parallax amount calculation part.   
     
     
         8 . The stereoscopic image reproduction device according to  claim 7 ,
 wherein the output part outputs one of the plurality of viewpoint images acquired by the first acquisition part to the stereoscopic display to display a two-dimensional image if the determination part determines that the display size of the stereoscopic display is greater than the maximum display size or if the calculated amount of image deviation exceeds a predetermined value representing an interocular distance of a person, and outputs the virtual viewpoint images instead of the two-dimensional image if the virtual viewpoint images are generated by the image processing part.   
     
     
         9 . A stereoscopic image reproduction method using the stereoscopic image reproduction device according to  claim 1  comprising:
 a first acquisition step of reading a three-dimensional image file having recorded therein a plurality of viewpoint images for stereoscopic vision and auxiliary information for the plurality of viewpoint images, the auxiliary information including the maximum amount of parallax on a distant view side in the plurality of viewpoint images, and acquiring the plurality of viewpoint images and the auxiliary information from the three-dimensional image file; 
 a second acquisition step of acquiring the display size of the stereoscopic display as an output destination; 
 a determination step of determining whether or not binocular fusion is enabled when a plurality of viewpoint images are displayed on the stereoscopic display on the basis of the acquired maximum amount of parallax on the distant view side, the display size of the stereoscopic display, and a predetermined value representing an interocular distance of a person; 
 an image processing step of generating a plurality of viewpoint images with smaller parallax on at least the distant view side between the plurality of viewpoint images on the basis of the plurality of viewpoint images acquired in the first acquisition step if it is determined in the determination step that binocular fusion is disabled; and 
 an output step of outputting the viewpoint images generated in the image processing step to the stereoscopic display if it is determined in the determination step that binocular fusion is disabled and outputting the viewpoint images acquired in the first acquisition step to the stereoscopic display if it is determined that binocular fusion is enabled.