Information processing system, information processing method, and storage medium

Abstract

The information processing system obtains a plurality of images based on image capturing by a plurality of imaging devices; obtains viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint; and generates a plurality of virtual viewpoint contents each of which corresponds to one of a plurality of image formats based on the common plurality of obtained images and the obtained viewpoint information, and the plurality of image formats is image formats whose numbers of virtual viewpoints specified by the viewpoint information used for generation of the virtual viewpoint contents are different from one another.

1 . An information processing system comprising:
 one or more memories storing instructions; and   one or more processors executing the instructions to:
 obtain a plurality of images based on image capturing by a plurality of imaging devices; 
 obtain viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint; and 
 generate a plurality of virtual viewpoint contents each of which corresponds to one of a plurality of image formats based on the common plurality of obtained images and the obtained viewpoint information, wherein 
   the plurality of image formats is image formats whose numbers of virtual viewpoints specified by the viewpoint information used for generation of the virtual viewpoint contents are different from one another.   
     
     
         2 . The information processing system according to  claim 1 , wherein
 the plurality of generated virtual viewpoint contents correspond to common time information.   
     
     
         3 . The information processing system according to  claim 1 , wherein
 part of viewpoint information used for generation of each of the plurality of virtual viewpoint contents are common.   
     
     
         4 . The information processing system according to  claim 1 , wherein
 viewpoint information used for generation of each of the plurality of virtual viewpoint contents is different.   
     
     
         5 . The information processing system according to  claim 1 , wherein
 the two or more virtual viewpoint contents are generated in parallel.   
     
     
         6 . The information processing system according to  claim 1 , wherein
 the one or more processors execute the instructions further to:
 output each of the plurality of generated virtual viewpoint contents to different one of output destinations. 
   
     
     
         7 . The information processing system according to  claim 1 , wherein
 in the plurality of image formats, a panorama image format and a non-panorama image format are included.   
     
     
         8 . The information processing system according to  claim 1 , wherein
 in the plurality of image formats, a 3D image format for a stereoscopic view based on both-eye disparity is included.   
     
     
         9 . The information processing system according to  claim 1 , wherein
 in the plurality of image formats, a 3D panorama image format for stereoscopically viewing a panorama image based on a both-eye disparity is included.   
     
     
         10 . The information processing system according to  claim 1 , wherein
 virtual viewpoint contents in accordance with a first image format among the plurality of image formats are generated by compositing a first number of images corresponding to a first number of virtual viewpoints different in at least one of a position and a view direction,   virtual viewpoint contents in accordance with a second image format among the plurality of image formats are generated by compositing a second number of images corresponding to a second number of virtual viewpoints different in at least one of a position and a view direction, and   the first number and the second number are different.   
     
     
         11 . The information processing system according to  claim 1 , wherein
 the one or more processors execute the instructions further to:
 specify two or more image formats among a plurality of predetermined image formats based on a selection operation by a user and 
   two or more virtual viewpoint contents in accordance with the specified two or more image formats are generated.   
     
     
         12 . The information processing system according to  claim 1 , comprising:
 a plurality of image generation apparatuses, wherein   the one or more processors execute the instructions further to:
 provide the plurality of acquired images to each of the plurality of image generation apparatuses and 
   the plurality of virtual viewpoint contents is generated by the plurality of image generation apparatuses.   
     
     
         13 . The information processing system according to  claim 12 , wherein
 the one or more processors execute the instructions further to:
 obtain instruction information for specifying a number of the plurality of virtual viewpoint contents to be generated; and 
 store the plurality of obtained images in each of a plurality of databases in accordance with the number specified by the obtained instruction information and 
   the plurality of images is provided from the plurality of databases to the plurality of image generation apparatuses.   
     
     
         14 . An information processing method comprising:
 obtaining a plurality of images based on image capturing by a plurality of imaging devices;   obtaining viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint; and   generating a plurality of virtual viewpoint contents each of which corresponds to one of a plurality of image formats based on the common plurality of obtained images and the obtained viewpoint information, wherein   the plurality of image formats is image formats whose numbers of virtual viewpoints specified by the viewpoint information used for generation of the virtual viewpoint contents are different from one another.   
     
     
         15 . The information processing method according to  claim 14 , wherein
 virtual viewpoint contents in accordance with a first image format among the plurality of image formats are generated by compositing a first number of images corresponding to a first number of virtual viewpoints different in at least one of a position and a view direction,   virtual viewpoint contents in accordance with a second image format among the plurality of image formats are generated by compositing a second number of images corresponding to a second number of virtual viewpoints different in at least one of a position and a view direction, and   the first number and the second number are different.   
     
     
         16 . The information processing method according to  claim 14 , comprising:
 specifying two or more image formats among a plurality of predetermined image formats based on a selection operation by a user, wherein   two or more virtual viewpoint contents each of which corresponds to one of the two or more specified image formats are generated.   
     
     
         17 . A non-transitory computer readable storage medium storing a program for causing a computer to function as an information processing system comprising:
 one or more memories storing instructions:   one or more processors executing the instructions to:
 obtain a plurality of images based on image capturing by a plurality of imaging devices; 
 obtain viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint; and 
 generate a plurality of virtual viewpoint contents each of which corresponds to one of a plurality of image formats based on the common plurality of obtained images and the obtained viewpoint information, wherein 
   the plurality of image formats is image formats whose numbers of virtual viewpoints specified by the viewpoint information used for generation of the virtual viewpoint contents are different from one another.