Systems, devices, and methods of manipulating audio data based on microphone orientation

Abstract

An electronic device includes a microphone array configured to capture audio data, one or more sensors configured to detect an orientation of the microphone array, and digital signal processing (DSP) logic, and an interface. The DSP logic processes, based on the orientation of the microphone array detected by the one or more sensors, the audio data captured by the microphone array to form audio input data. The interface configured to transmit the audio input data over a communications channel to be output by another electronic device.

What is claimed is: 
     
         1 . An electronic device comprising:
 a display device repositionable relative to a base;   a microphone array configured to capture audio data, the microphone array fixedly attached to the display device;   one or more sensors configured to detect an orientation of the display device relative to the base; and   digital signal processing (DSP) logic configured to:
 generate a virtual directional microphone associated with one or more individual microphones of the microphone array based on the orientation of the display device relative to the base; and 
 process the audio data to form audio input data, the audio data including audio signals received from the one or more individual microphones that correspond to the virtual directional microphone. 
   
     
     
         2 . The electronic device of  claim 1 , further comprising:
 one or more audio output devices physically incorporated in the base; and   driver logic configured to drive the audio output devices to output audible sound data based on the audio input data.   
     
     
         3 . The electronic device of  claim 1 , wherein to process the audio data to form the audio input data, the DSP logic is configured to drop signals received from one or more individual microphones of the microphone array based on the orientation of the display device relative to the base. 
     
     
         4 . The electronic device of  claim 1 , wherein to process the audio data to form the audio input data, the DSP logic is configured to constrain a search space to signals received from one or more individual microphones of the microphone array based on the orientation of the display device relative to the base. 
     
     
         5 . The electronic device of  claim 1 , wherein to process the audio data to form the audio input data, the DSP logic is configured to process the audio data using a set of audio capture parameters corresponding to the orientation of the display device relative to the base. 
     
     
         6 . The electronic device of  claim 5 , wherein to determine the set of audio capture parameters corresponding to the orientation of the display device relative to the base, the DSP logic is configured to select the set of audio capture parameters corresponding to the orientation of the display device relative to the base from a plurality of sets of audio capture parameters using a lookup table. 
     
     
         7 . The electronic device of  claim 5 , wherein to determine the set of audio capture parameters corresponding to the orientation of the display device relative to the base, the DSP logic is configured to apply a finite element solution that determines the set of audio capture parameters corresponding to the orientation of the display device relative to the base. 
     
     
         8 . The electronic device of  claim 5 , wherein to determine the set of audio capture parameters corresponding to the orientation of the display device relative to the base, the DSP logic is configured to apply an artificial intelligence model or a machine learning model trained with a mapping of rotation angles of the microphone array to respective sets of audio capture parameter sets to predict the set of audio capture parameters corresponding to the orientation of the display device relative to the base. 
     
     
         9 . The electronic device of  claim 1 , wherein:
 the DSP logic is configured to determine horizontal coordinate angles of the microphone array based on the orientation of the display device relative to the base, and   to process the audio data to form the audio input data, the DSP logic is configured to process the audio data using the horizontal coordinate angles of the microphone array.   
     
     
         10 . The electronic device of  claim 1 , wherein the one or more sensors include one or more of an accelerometer, a position encoder, a gyroscope, or a motion sensor. 
     
     
         11 . A method comprising:
 receiving, by one or more processors, audio data captured by a microphone array attached to a display device, the display device repositionable relative to a base;   generating, by the one or more processors, a virtual directional microphone associated with one or more individual microphones of the microphone array based on an orientation of the display device relative to the base; and   processing, by the one or more processors, the audio data to form audio input data, the audio data including audio signals received from the one or more individual microphones that correspond to the virtual directional microphone.   
     
     
         12 . The method of  claim 11 , further comprising:
 driving one or more audio output devices physically incorporated into the base to output audible sound data based on the audio input data.   
     
     
         13 . The method of  claim 11 , wherein processing the audio data to form the audio input data comprises dropping, by the DSP logic, signals received from one or more individual microphones of the microphone array based on the orientation of the display device relative to the base. 
     
     
         14 . The method of  claim 11 , wherein processing the audio data to form the audio input data comprises constraining, by the DSP logic, a search space to signals received from one or more individual microphones of the microphone array based on the orientation of the display device relative to the base. 
     
     
         15 . The method of  claim 11 , wherein processing the audio data to form the audio input data comprises processing, by the DSP logic, the audio data using a set of audio capture parameters corresponding to the orientation of the display device relative to the base. 
     
     
         16 . The method of  claim 15 , wherein determining the set of audio capture parameters corresponding to the orientation of the display device relative to the base comprises selecting, by the driver logic, the set of audio capture parameters corresponding to the orientation of the display device relative to the base from a plurality of sets of audio capture parameters using a lookup table. 
     
     
         17 . The method of  claim 15 , wherein determining the set of audio capture parameters corresponding to the orientation of the display device relative to the base comprises applying, by the driver logic, a finite element solution that determines the set of audio capture parameters corresponding to the orientation of the display device relative to the base. 
     
     
         18 . The method of  claim 11 , further comprising:
 determining, by the DSP logic, horizontal coordinate angles of the microphone array based on the orientation of the display device relative to the base,   wherein processing the audio data to form the audio input data comprises processing, by the DSP logic, the audio data using the horizontal coordinate angles of the microphone array.   
     
     
         19 . A non-transitory computer-readable storage medium storing one or more programs configured for execution by one or more processors of an electronic device having a microphone array and a speaker array, the microphone array attached to a display device repositionable relative to a base, the one or more programs including instructions that when executed by the one or more processors cause the electronic device to:
 receive audio data captured by the microphone array;   generate a virtual directional microphone associated with one or more individual microphones of the microphone array based on an orientation of the display device relative to the base; and   process the audio data to form audio input data using signals received from the one or more individual microphones that correspond to the virtual directional microphone.   
     
     
         20 . An electronic device comprising:
 a display device repositionable relative to a base;   a microphone array configured to capture audio data, the microphone array fixedly attached to the display device;   one or more sensors configured to detect an orientation of the display device relative to the base; and   digital signal processing (DSP) logic configured to determine horizontal coordinate angles of the microphone array based on the orientation of the display device relative to the base, and process the audio data using the horizontal coordinate angles of the microphone array to form audio input data.