Technologies for localized audio enhancement of a three-dimensional video

Abstract

Technologies for localized audio enhancement of a three-dimensional video include capturing a three-dimensional video including depth data using a three-dimensional camera of a mobile computing device and receiving a three-dimensional audio associated with the three-dimensional video using a microphone array. A user may enhance localized audio by selecting a region of the three-dimensional image from the three-dimensional video. In response, the mobile computing device generates an audio component of the three-dimensional audio corresponding to the selected region based on depth data associated with the selected region. A user may subsequently enhance the audio component by, for example, increasing the volume of the audio component or increasing the clarity of the audio component. In this way, a user may focus the audio playback on a selected portion of the three-dimensional video, which improves the user's ability to listen and understand an individual, group of individuals, or region captured in the three-dimensional video.

1 . A mobile computing device for localized audio enhancement of a three-dimensional image, the mobile computing device comprising:
 a display;   a three-dimensional camera to capture a three-dimensional image, wherein the three-dimensional image includes depth data;   an audio capture module to receive a three-dimensional audio associated with the three-dimensional image from a microphone array;   an image region determination module to determine a selected region of the three-dimensional image displayed on the display based on a user selection;   an audio component generation module to generate an audio component of the three-dimensional audio corresponding to the selected region based on the depth data associated with the selected region; and   an audio enhancement module to enhance the audio component.   
     
     
         2 . The mobile computing device of  claim 1 , wherein the three-dimensional image comprises a three-dimensional image from a three-dimensional video. 
     
     
         3 . The mobile computing device of  claim 1 , wherein the microphone array comprises at least six beamforming microphone sub-arrays. 
     
     
         4 . The mobile computing device of  claim 3 , wherein the microphone array is remote from, and communicatively coupled to, the mobile computing device. 
     
     
         5 . The mobile computing device of  claim 3 , wherein the microphone array comprises:
 a first microphone array located on a rear side of the mobile computing device toward a first sidewall, wherein the first microphone array comprises a first microphone located centrally on the rear side, a second microphone located laterally of the first microphone toward a first end of the mobile computing device, and a third microphone located laterally of the first microphone toward a second end of the mobile computing device opposite the first end, and   a second microphone array located on the rear side of the mobile computing device toward a second sidewall opposite the first sidewall, wherein the second microphone array comprises a fourth microphone located centrally on the rear side, a fifth microphone located laterally of the fourth microphone toward the first end of the mobile computing device, and a sixth microphone located laterally of the fourth microphone toward the second end of the mobile computing device.   
     
     
         6 . The mobile computing device of any of  claims 1 - 5 , wherein the audio capture module is further to generate a mapping of the three-dimensional audio to the three-dimensional image based on an arrangement of the microphone array. 
     
     
         7 . The mobile computing device of  claim 6 , wherein to generate the mapping comprises to:
 determine an orientation of the microphone array while the three-dimensional audio is captured, and   generate a mapping of the three-dimensional audio to the three-dimensional image based on the orientation of the microphone array.   
     
     
         8 . The mobile computing device of any of  claims 1 - 5 , wherein the image region determination module is to determine the selected region based on a user-defined boundary defined the three-dimensional image via the display. 
     
     
         9 . The mobile computing device of any of  claims 1 - 5 , wherein to determine the selected region of the three-dimensional image comprises to determine at least one individual captured in the three-dimensional image based on a user selection. 
     
     
         10 . One or more machine-readable storage media comprising a plurality of instructions stored thereon that, when executed, cause a mobile computing device to:
 receive a three-dimensional audio associated with the three-dimensional image from a microphone array;   determine a selected region of a three-dimensional image based on a selection by a user of the mobile computing device;   generate an audio component of the three-dimensional audio corresponding to the selected region based on depth data of the three-dimensional image associated with the selected region; and   enhance the audio component.   
     
     
         11 . The one or more machine-readable storage media of  claim 10 , wherein to receive the three-dimensional audio comprises to receive a three-dimensional audio associated with a three-dimensional video, wherein the three-dimensional video comprises the three-dimensional image. 
     
     
         12 . The one or more machine-readable storage media of  claim 10 , wherein to receive the three-dimensional audio comprises to receive the three-dimensional audio from a microphone array remote from, and communicatively coupled to, the mobile computing device. 
     
     
         13 . The one or more machine-readable storage media of  claim 10 , wherein the plurality of instructions further cause the computing device to generate a mapping of the three-dimensional audio to the three-dimensional image based on an arrangement of the microphone array. 
     
     
         14 . The one or more machine-readable storage media of  claim 13 , wherein to generate the mapping comprises to:
 determine an orientation of the microphone array while capturing the three-dimensional audio, and   generate a mapping of the three-dimensional audio to the three-dimensional image based on the orientation of the mobile computing device.   
     
     
         15 . The one or more machine-readable storage media of  claim 10 , wherein to determine the selected region of the three-dimensional image comprises to determine the selected region of the three-dimensional image based on a boundary defined by the user on the three-dimensional image. 
     
     
         16 . The one or more machine-readable storage media of  claim 10 , wherein to determine the selected region comprises to determine at least one individual captured in the three-dimensional image based on a selection of the user. 
     
     
         17 . The one or more machine-readable storage media of  claim 10 , wherein to generate the audio component of the three-dimensional audio corresponding to the selected region comprises to generate the audio component based on a mapping of the three-dimensional audio to the three-dimensional image. 
     
     
         18 . A method for localized audio enhancement of a three-dimensional image, the method comprising:
 receiving, by the a mobile computing device, a three-dimensional audio associated with the three-dimensional image from a microphone array;   determining, by the mobile computing device, a selected region of a three-dimensional image based on a selection by a user of the mobile computing device;   generating, by the mobile computing device, an audio component of the three-dimensional audio corresponding to the selected region based on depth data of the three-dimensional image associated with the selected region; and   enhancing, by the mobile computing device, the audio component.   
     
     
         19 . The method of  claim 18 , wherein receiving the three-dimensional audio comprises receiving a three-dimensional audio associated with a three-dimensional video, wherein the three-dimensional video comprises the three-dimensional image. 
     
     
         20 . The method of  claim 18 , wherein receiving the three-dimensional audio comprises receiving, by the mobile computing device, the three-dimensional audio from a microphone array remote from, and communicatively coupled to, the mobile computing device.