Systems and Methods for Generating Haptic Effects Associated With Transitions in Audio Signals

Abstract

Systems and methods for generating haptic effects associated with transitions in audio signals are disclosed. One disclosed system for outputting haptic effects includes a processor configured to: receive a signal; determine a haptic effect based in part on the signal; output a haptic signal associated with the haptic effect; an audio output device configured to receive the signal and output an audible effect; and a haptic output device in communication with the processor and coupled to the touch surface, the haptic output device configured to receive the haptic signal and output the haptic effect.

What is claimed: 
     
         1 . A system for synchronizing haptic effects comprising:
 a haptic output device;   a processor coupled to the haptic output device and configured to:
 receive a signal; 
 identify one or more transitions in the signal by:
 determining a mean value of a Fast Fourier Transform of the signal at a series of time intervals; 
 normalizing each of the mean values to create a normalized signal; 
 determining a derivative of the normalized signal to create a derivative signal; and 
 determining one or more local maximum values within the derivative signal; 
 
 synchronize one or more haptic effects to the one or more transitions; and 
 transmit a haptic signal associated with the synchronized haptic effects to a data store configured to store a haptic track. 
   
     
     
         2 . The system of  claim 1 , wherein the signal comprises one or more of: an audio signal, a pressure signal, or an acceleration signal. 
     
     
         3 . The system of  claim 1 , further comprising:
 an audio output device configured to receive the signal and output an audible effect; and   a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.   
     
     
         4 . The system of  claim 3 , wherein the audio output device and the haptic output device are remote from each other. 
     
     
         5 . The system of  claim 1 , wherein the transitions comprise one or more of: a change in frequency, a change in amplitude, or a repetition of a frequency and amplitude. 
     
     
         6 . The system of  claim 1 , wherein the haptic effect comprises one or more of: a variation in coefficient of friction, a simulated texture, or a vibration. 
     
     
         7 . The system of  claim 1 , wherein the processor is further configured to filter the normalized signal. 
     
     
         8 . The system of  claim 1 , wherein the one or more local maximum values comprises the one or more transitions. 
     
     
         9 . A method for outputting haptic effects comprising:
 receiving a signal;   identifying one or more transitions in the signal by:
 determining a mean value of a Fast Fourier Transform of the signal at a series of time intervals; 
 normalizing each of the mean values to create a normalized signal; 
 determining a derivative of the normalized signal to create a derivative signal; and 
 determining one or more local maximum values within the derivative signal; 
   synchronizing one or more haptic effects to the one or more transitions; and   transmitting a haptic signal associated with the synchronized haptic effects to a data store configured to store a haptic track.   
     
     
         10 . The method of  claim 9 , wherein the signal comprises one or more of: an audio signal, a pressure signal, or an acceleration signal. 
     
     
         11 . The method of  claim 9 , further comprising transmitting the haptic signal to a haptic output device configured to output the haptic effect and transmitting the signal to an audio output device configured to output an audible effect. 
     
     
         12 . The method of  claim 9 , wherein the haptic effect comprises one or more of: a variation in coefficient of friction, a simulated texture, or a vibration. 
     
     
         13 . The method of  claim 9 , wherein the transitions comprise one or more of: a change in frequency, a change in amplitude, or a repetition of a frequency and amplitude. 
     
     
         14 . The method of  claim 9 , further comprising filtering the normalized signal. 
     
     
         15 . The method of  claim 9 , wherein the one or more local maximum values comprises the one or more transitions. 
     
     
         16 . A non-transitory computer readable medium comprising program code, which when executed by a processor, is configured to cause the processor to:
 receive a signal;   identify one or more transitions in the signal by:
 determining a mean value of a Fast Fourier Transform of the signal at a series of time intervals; 
 normalizing each of the mean values to create a normalized signal; 
 determining a derivative of the normalized signal to create a derivative signal; and 
 determining one or more local maximum values within the derivative signal; 
   synchronize one or more haptic effects to the one or more transitions; and   transmit a haptic signal associated with the synchronized haptic effects to a data store configured to store a haptic track.   
     
     
         17 . The non-transitory computer readable medium of  claim 16 , wherein the signal comprises one or more of: an audio signal, a pressure signal, or an acceleration signal. 
     
     
         18 . The non-transitory computer readable medium of  claim 16 , further comprising program code, which when executed by a processor is configured to cause the processor to transmit the haptic signal to a haptic output device configured to output the haptic effect and transmit the signal to an audio output device configured to output an audible effect. 
     
     
         19 . The non-transitory computer readable medium of  claim 16 , wherein the haptic effect comprises one or more of: a variation in coefficient of friction, a simulated texture, or a vibration. 
     
     
         20 . The non-transitory computer readable medium of  claim 16 , wherein the transitions comprise one or more of: a change in frequency, a change in amplitude, or a repetition of a frequency and amplitude.