Information creation method and information creation device

Abstract

Provided are an information creation method and an information creation device for efficiently creating accessory information on characteristics of each of a plurality of sounds included in sound data. An information creation method according to one embodiment of the present invention includes a first acquisition step of acquiring sound data including a plurality of sounds emitted from a plurality of sound sources, a setting step of setting accuracy for the sound source or the sound, and a creation step of creating information on characteristics of the sound as accessory information on video data corresponding to the sound data, based on the accuracy.

What is claimed is: 
     
         1 . An information creation method comprising:
 a first acquisition step of acquiring sound data including a plurality of sounds emitted from a plurality of sound sources;   a setting step of setting accuracy for the sound source or the sound; and   a creation step of creating information on characteristics of the sound as accessory information on video data corresponding to the sound data, based on the accuracy.   
     
     
         2 . The information creation method according to  claim 1 ,
 wherein, in the setting step, an importance level is set for the sound or the sound source, and the accuracy is set according to the importance level.   
     
     
         3 . The information creation method according to  claim 1 ,
 wherein the sound is a non-verbal sound.   
     
     
         4 . The information creation method according to  claim 1 , further comprising:
 a second acquisition step of acquiring video data including a plurality of image frames,   wherein, in the setting step, the accuracy for the sound source is set according to whether or not the sound source is present within an angle of view of a corresponding image frame among the plurality of image frames.   
     
     
         5 . The information creation method according to  claim 1 , further comprising:
 a determination step of determining whether or not the sound satisfies a predetermined criterion in a case in which the sound source is not present within an angle of view of a corresponding image frame,   wherein, in the setting step, the accuracy for the sound is set to be higher in a case in which the sound satisfies the predetermined criterion than in a case in which the sound does not satisfy the predetermined criterion.   
     
     
         6 . The information creation method according to  claim 5 , further comprising:
 a change step of, in a case in which the sound satisfies the predetermined criterion, changing an orientation of an imaging lens of an imaging apparatus such that the imaging lens approaches a direction of the sound source or reducing zoom magnification of the imaging apparatus such that the sound source is included in the angle of view of the image frame.   
     
     
         7 . The information creation method according to  claim 1 ,
 wherein, in the setting step, the accuracy for the sound source is set based on a result of image recognition on the sound source in a corresponding image frame or apparatus information associated with the image frame for an imaging apparatus that captures the image frame.   
     
     
         8 . The information creation method according to  claim 7 ,
 wherein, in the setting step, the accuracy for the sound source is set based on the apparatus information, and   the apparatus information is information on a focal position of the imaging apparatus in the image frame or a gaze position of a user of the imaging apparatus in the image frame.   
     
     
         9 . The information creation method according to  claim 1 ,
 wherein, in the creation step, information on whether or not the sound source is present within an angle of view of a corresponding image frame is created as the accessory information.   
     
     
         10 . The information creation method according to  claim 2 , further comprising:
 an inspection step of inspecting whether or not the sound satisfies an inspection criterion in a case in which the accuracy according to the importance level satisfies a predetermined condition,   wherein, in the creation step, information on an inspection result obtained in the inspection step is created as the accessory information.   
     
     
         11 . The information creation method according to  claim 10 ,
 wherein, in the creation step, reliability information on reliability of the inspection result is further created as the accessory information.   
     
     
         12 . The information creation method according to  claim 2 ,
 wherein, in the creation step, importance level information on the importance level is created as the accessory information.   
     
     
         13 . The information creation method according to  claim 2 ,
 wherein, in a case in which the accuracy according to the importance level satisfies a first condition, in the creation step, onomatopoeic word information in which the sound is converted into text as an onomatopoeic word is created as the accessory information.   
     
     
         14 . The information creation method according to  claim 13 ,
 wherein, in a case in which the accuracy according to the importance level satisfies a second condition, in the creation step, mimetic word information in which a state of the sound source in a corresponding image frame is converted into text as a mimetic word is further created as the accessory information.   
     
     
         15 . An information creation device comprising:
 a processor,   wherein the processor is configured to:
 acquire sound data including a plurality of sounds emitted from a plurality of sound sources; 
 set accuracy for the sound source or the sound; and 
 create information on characteristics of the sound as accessory information on video data corresponding to the sound data, based on the accuracy. 
   
     
     
         16 . The information creation method according to  claim 2 ,
 wherein the sound is a non-verbal sound.   
     
     
         17 . The information creation method according to  claim 2 , further comprising:
 a second acquisition step of acquiring video data including a plurality of image frames,   wherein, in the setting step, the accuracy for the sound source is set according to whether or not the sound source is present within an angle of view of a corresponding image frame among the plurality of image frames.   
     
     
         18 . The information creation method according to  claim 2 , further comprising:
 a determination step of determining whether or not the sound satisfies a predetermined criterion in a case in which the sound source is not present within an angle of view of a corresponding image frame,   wherein, in the setting step, the accuracy for the sound is set to be higher in a case in which the sound satisfies the predetermined criterion than in a case in which the sound does not satisfy the predetermined criterion.   
     
     
         19 . The information creation method according to  claim 2 ,
 wherein, in the setting step, the accuracy for the sound source is set based on a result of image recognition on the sound source in a corresponding image frame or apparatus information associated with the image frame for an imaging apparatus that captures the image frame.   
     
     
         20 . The information creation method according to  claim 2 ,
 wherein, in the creation step, information on whether or not the sound source is present within an angle of view of a corresponding image frame is created as the accessory information.