The method and apparatus for controlling audio data by recognizing user gesture and position using multiple mobile devices

Abstract

A method or apparatus for multi-channel audio data control using plural mobile devices comprising steps of detecting user presence through assigned frequency, transmitting audio data to the nearest device from the user based on user presence information, and recognize user gesture to control the audio data. A remote controller held by the user may also have a priority to control audio data.

What is claimed is: 
     
         1 . A method for operating a device, the method comprising the steps of:
 generating mechanical signal at least one predetermined frequency, the mechanical signal interacting with objects within an area of effect of the generated mechanical signal;   detecting the interacted mechanical signal;   processing the detected signal to determine presence of objects within the area of effect, the step of processing resulting in a control signal; and   controlling operation of the device based on the control signal.   
     
     
         2 . The method recited in  claim 1  wherein mechanical signal is sound having frequency outside of human audible spectrum. 
     
     
         3 . The method recited in  claim 1  wherein the interaction is at least one of reflection and refraction. 
     
     
         4 . The method recited in  claim 1  wherein operation of the device comprises audio playback. 
     
     
         5 . The method recited in  claim 1  wherein the objects comprise a user, and the method further comprising the step of recognizing gesture of the user. 
     
     
         6 . A device comprising:
 a speaker operable to generate mechanical signal at least one predetermined frequency, the mechanical signal interacting with objects within an area of effect of the generated mechanical signal;   a microphone operable to detect the interacted mechanical signal;   a processor operable to process the detected signal to determine presence of objects within the area of effect to result in a control signal; and   said processor further operable to control operation of the device based on the control signal.   
     
     
         7 . A method for operating a plurality of devices, the method comprising the steps of:
 generating, by any device of the plurality of devices, mechanical signal at least one predetermined frequency, the mechanical signal interacting with objects within an area of effect of the generated signal;   detecting, by a first device, the interacted mechanical signal;   processing, by the first device, the detected signal to determine presence of objects within the area of effect, the process resulting in a control signal; and   communicating the control signal to the other devices of the plurality of devices;   controlling operations of at least one of the devices of the plurality of devices based on the control signal.   
     
     
         8 . The method recited in  claim 1  wherein the objects comprise a user. 
     
     
         9 . The method recited in  claim 2  wherein the first device is proximal to the user. 
     
     
         10 . The method recited in  claim 2  further comprising the step of recognizing gesture of the user. 
     
     
         11 . A system comprising a plurality of devices in communication with each other, the system comprising:
 a speaker of at least one of the devices, the speaker operable to generate mechanical signal at least one predetermined frequency, the mechanical signal interacting with objects within an area of effect of the generated signal;   a microphone of a first device, the microphone operable to detect the interacted mechanical signal;   a processor of the first device operable to process the detected signal to determine presence of objects within the area of effect, the process resulting in a control signal; and   the first device operable to communicate the control signal to the other devices of the system; and   wherein operations of at least one of the devices of the system is controlled based on the control signal.   
     
     
         12 . The system of device of  claim 11  wherein
 the objects include a user; and 
 the system comprises at least one device having at least one of an accelerometer and a gyro sensor operable to acquire user gesture. 
 
     
     
         13 . The system of device of  claim 11  wherein at least one device is a wearable device.