Signal processing apparatus, method of controlling signal processing apparatus, and non-transitory computer-readable storage medium

Abstract

A signal processing apparatus that processes a plurality of audio signals obtained by acquiring a sound in a target area by performing sound acquisition by a plurality of sound acquisition units, comprising: a specification unit configured to specify a position of a sound source in the target area and positions and directivities of the plurality of sound acquisition units; and a selection unit configured to select, among the plurality of audio signals based on the sound acquisition by the plurality of sound acquisition units, an audio signal to be played back based on a degree of misalignment of the directivity of each of the plurality of sound acquisition units with respect to the specified position of the sound source.

What is claimed is: 
     
       1. A signal processing apparatus, comprising:
 one or more memories storing instructions; and 
 one or more processors executing the instructions to:
 specify a position of a sound source and positions and directivities of a plurality of sound acquisition units; 
 obtain, for each of the plurality of sound acquisition units, a difference between i) a first direction determined by the specified directivity of each of the plurality of sound acquisition units and ii) a second direction determined by the specified position of the sound source and the specified position of each of the plurality of sound acquisition units; and 
 select, among a plurality of sound signals that are based on sound acquisition by the plurality of sound acquisition units, a sound signal that is based on a sound acquisition unit of which the difference is smaller than that of another sound acquisition unit, 
 
 wherein a gain in the direction determined by the specified directivity of a sound acquisition unit included in the plurality of sound acquisition units is larger than a gain in other direction. 
 
     
     
       2. The apparatus according to  claim 1 , wherein the sound signal is selected further based on a distance between the specified position of each of the plurality of sound acquisition units and the specified position of the sound source. 
     
     
       3. The apparatus according to  claim 1 , wherein the sound signal is selected further based on a frequency characteristic related to acquisition of sound in a position shifted from the direction determined by the specified directivity of each sound acquisition unit. 
     
     
       4. The apparatus according to  claim 1 , wherein the sound signal is selected further based on a frequency characteristic of each of the plurality of sound signals in a time segment in which a target sound generated by the sound source is acquired. 
     
     
       5. The apparatus according to  claim 1 , wherein the one or more processors further execute the instructions to:
 cause a display unit to display contents related to the selection of the sound signal. 
 
     
     
       6. The apparatus according to  claim 1 , wherein the one or more processors further execute the instructions to:
 perform processing to suppress, in the selected sound signal, noise other than a target sound generated by the sound source. 
 
     
     
       7. The apparatus according to  claim 1 , wherein the one or more processors further execute the instructions to generate a playback signal based on the selected sound signal. 
     
     
       8. The apparatus according to  claim 7 , wherein, in a case where two sound signal are selected, the playback signal is generated based on the two sound signal. 
     
     
       9. The apparatus according to  claim 1 , wherein the sound signal is selected further based on sharpness of the specified directivity of each of the plurality of sound acquisition units. 
     
     
       10. The apparatus according to  claim 1 , wherein the position of the sound source is specified based on learned image recognition processing. 
     
     
       11. A method of controlling a signal processing apparatus, the method comprising:
 specifying a position of a sound source and positions and directivities of a plurality of sound acquisition units; 
 obtaining, for each of the plurality of sound acquisition units, a difference between i) a first direction determined by the specified directivity of each of the plurality of sound acquisition units and ii) a second direction determined by the specified position of the sound source and the specified position of each of the plurality of sound acquisition units; and 
 selecting, among a plurality of sound signals that are based on sound acquisition by the plurality of sound acquisition units, a sound signal that is based on a sound acquisition unit of which the difference is smaller than that of another sound acquisition unit, 
 wherein a gain in the direction determined by the specified directivity of a sound acquisition unit included in the plurality of sound acquisition units is larger than a gain in other direction. 
 
     
     
       12. A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute a method of controlling a signal processing apparatus, wherein the method comprises
 specifying a position of a sound source and positions and directivities of a plurality of sound acquisition units; and 
 obtaining, for each of the plurality of sound acquisition units, a differences between i) a first direction determined by the specified directivity of each of the plurality of sound acquisition units and ii) a second direction determined by the specified position of the sound source and the specified position of each of the plurality of sound acquisition units; and 
 selecting, among a plurality of sound signals that are based on sound acquisition by the plurality of sound acquisition units, a sound signal that is based on a sound acquisition unit of which the difference is smaller than that of another sound acquisition unit, 
 wherein a gain in the direction determined by the specified directivity of a sound acquisition unit included in the plurality of sound acquisition units is larger than a gain in other direction.