Automatic fitting of haptic effects

Abstract

A system is provided that automatically generates one or more haptic effects from source data, such as audio source data. The system fits the one or more haptic effects to the source data by analyzing the source data and identifying one or more haptic effects that are the most similar to the source data. The system matches the identified one or more haptic effects with the source data. The system subsequently outputs the identified one or more haptic effects.

1 - 37 . (canceled) 
     
     
         38 . A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor
 to receive source data;   to extract a feature of the source data;   to compare the source data with each template of a plurality of templates by comparing the feature extracted from the source data with a respective template feature of each template of the plurality of templates, wherein each template of the plurality of templates further identifies a respective haptic effect to be output;   to select a template from the plurality of templates based on the comparison; and   to output the respective haptic effect identified by the template that is selected.   
     
     
         39 . The non-transitory computer-readable medium of  claim 38 , wherein the source data includes metadata that has feature information describing the feature of the source data. 
     
     
         40 . The non-transitory computer-readable medium of  claim 39 , wherein the metadata includes information describing a source from which the source data is captured or how the source data is captured. 
     
     
         41 . The non-transitory computer-readable medium of  claim 40 , wherein the source data is captured by a sensor, and wherein the metadata describes a position of the sensor. 
     
     
         42 . The non-transitory computer-readable medium of  claim 40 , wherein the source data is captured by a sensor, and wherein the metadata describes an orientation of the sensor. 
     
     
         43 . The non-transitory computer-readable medium of  claim 38 , wherein the feature extracted from the source data is a characteristic of the source data, the characteristic being at least one of a duration, frequency, or envelope of the source data. 
     
     
         44 . The non-transitory computer-readable medium of  claim 38 , wherein the feature extracted from the source data is a transition from the source data having a first characteristic value to the source data having a second characteristic value. 
     
     
         45 . The non-transitory computer-readable medium of  claim 44 , wherein the feature is a transition from the source data having a first frequency to the source data having a second frequency. 
     
     
         46 . The non-transitory computer-readable medium of  claim 38 , wherein the instructions, when executed by the processor, cause the processor to perform the selecting of the template by selecting a template with a template feature that is most similar to the feature extracted from the source data. 
     
     
         47 . The non-transitory computer-readable medium of  claim 38 , wherein respective template features of the plurality of templates describe respective data patterns for identifying a plurality of haptic-related events. 
     
     
         48 . The non-transitory computer-readable medium of  claim 47 , wherein the source data comprises audio data, and wherein the plurality of templates comprises sound templates, and wherein respective template features of the sound templates describe respective sound patterns for identifying the plurality of haptic-related events. 
     
     
         49 . The non-transitory computer-readable medium of  claim 48 , wherein each of the sound patterns identifies at least one of a gunshot sound, an explosion sound, and a car crash sound. 
     
     
         50 . The non-transitory computer-readable medium of  claim 38 , wherein the source data comprises video source data, and wherein the plurality of templates comprise video templates. 
     
     
         51 . The non-transitory computer-readable medium of  claim 38 , wherein the source data comprises acceleration source data, and wherein the plurality of templates comprise acceleration templates. 
     
     
         52 . The non-transitory computer-readable medium of  claim 38 , wherein the source data comprises multi-modal source data. 
     
     
         53 . The non-transitory computer-readable medium of  claim 38 , wherein the instructions, when executed by the processor, further cause the processor to optimize the haptic effect by adjusting a haptic parameter value of the haptic effect to be more similar to the feature extracted from the source data than if the haptic parameter value was not adjusted. 
     
     
         54 . A computer-implemented method, comprising:
 receiving source data;   extracting a feature of the source data;   comparing the source data with each template of a plurality of templates by comparing the feature extracted from the source data with a respective template feature of each template of the plurality of templates, wherein each template of the plurality of templates further identifies a respective haptic effect to be output;   selecting a template from the plurality of templates based on the comparison; and   outputting the respective haptic effect identified by the template that is selected.   
     
     
         55 . The method of  claim 54 , wherein the source data includes metadata describing a source from which the source data is captured or how the source data is captured. 
     
     
         56 . The method of  claim 55 , wherein the source data is captured by a sensor, and wherein the metadata describes a position or orientation of the sensor. 
     
     
         57 . A computer-implemented method, comprising:
 receiving source data that includes metadata, wherein the metadata includes source information describing a feature of the source data;   extracting the feature of the source data;   comparing the source data with each template of a plurality of templates by comparing the feature extracted from the source data with a respective template feature of each template of the plurality of templates, wherein each template of the plurality of templates further identifies a respective haptic effect to be output;   selecting a template from the plurality of templates based on the comparison; and   outputting the respective haptic effect identified by the template that is selected.