Haptic effect encoding and rendering system

Abstract

The embodiments of the present invention enable novel methods, non-transitory mediums, and systems for encoding and generating haptic effects. According to the various embodiments, a media object is retrieved. The media object is analyzed to determine one or more time periods for rendering haptic effects. The haptic effects for rendering during the time periods are determined. The haptic effects are encoded as a haptic effect pattern that identifies a start time and duration for each of the haptic effects.

1 . A method for generating haptic effects, the method comprising:
 retrieving a media object;   generating a haptic stream for storing the haptic effects, the haptic stream corresponding to the media object;   analyzing the media object to determine one or more time periods for rendering the haptic effects;   determining the haptic effects for rendering during the time periods;   encoding the haptic effects of the haptic stream as a haptic effect pattern that identifies a start time and a duration of each of the haptic effects;   engaging a processor to render the haptic effects of the haptic stream according to the haptic effect pattern; and   disengaging the processor from processing the haptic stream according to the haptic effect pattern.   
     
     
         2 . The method according to  claim 1 , wherein the haptic effect pattern includes one or more parameters for each of the haptic effects, the parameters including magnitude, frequency, and/or type of haptic effect. 
     
     
         3 . The method according to  claim 1 , wherein the media object includes an audio object or a video object. 
     
     
         4 . The method according to  claim 1 , wherein the haptic effect pattern only includes data relating to haptically-active time periods. 
     
     
         5 . The method according to  claim 1 , wherein the haptic effect pattern includes a plurality of duration times that indicate alternating actuator OFF and actuator ON time periods. 
     
     
         6 . The method according to  claim 1 , wherein the media object and the haptic effect pattern are synchronized. 
     
     
         7 . The method according to  claim 1 , further comprising:
 adjusting an elapsed time variable of the haptic effect pattern in connection with execution of one of the following functions: pause, resume, and seek.   
     
     
         8 . A device comprising:
 a processor; and   a memory storing one or more programs for execution by the processor, the one or more programs including instructions for:   retrieving a media object;   generating a haptic stream for storing haptic effects, the haptic stream corresponding to the media object;   analyzing the media object to determine one or more time periods for rendering the haptic effects;   determining the haptic effects for rendering during the time periods;   encoding the haptic effects of the haptic stream as a haptic effect pattern that identifies a start time and a duration of each of the haptic effects;   engaging the processor to render the haptic effects of the haptic stream according to the haptic effect pattern; and   disengaging the processor from processing the haptic stream according to the haptic effect pattern.   
     
     
         9 . The device according to  claim 8 , wherein the haptic effect pattern includes one or more parameters for each of the haptic effects, the parameters including magnitude, frequency, and/or type of haptic effect. 
     
     
         10 . The device according to  claim 8 , wherein the media object includes an audio object or a video object. 
     
     
         11 . The device according to  claim 8 , wherein the haptic effect pattern only includes data relating to haptically-active time periods. 
     
     
         12 . The device according to  claim 8 , wherein the haptic effect pattern includes a plurality of duration times that indicate alternating actuator OFF and actuator ON time periods. 
     
     
         13 . The device according to  claim 8 , wherein the media object and the haptic effect pattern are synchronized. 
     
     
         14 . The device according to  claim 8 , further comprising instructions for:
 adjusting an elapsed time variable of the haptic effect pattern in connection with execution of one of the following functions: pause, resume, and seek.   
     
     
         15 . A non-transitory computer readable storage medium storing one or more programs configured to be executed by a processor, the one or more programs comprising instructions for:
 retrieving a media object;   generating a haptic stream for storing haptic effects, the haptic stream corresponding to the media object;   analyzing the media object to determine one or more time periods for rendering the haptic effects;   determining the haptic effects for rendering during the time periods;   encoding the haptic effects of the haptic stream as a haptic effect pattern that identifies a start time and a duration of each of the haptic effects;   engaging a processor to render the haptic effects of the haptic stream according to the haptic effect pattern; and   disengaging the processor from processing the haptic stream according to the haptic effect pattern.   
     
     
         16 . The non-transitory computer readable storage medium according to  claim 15 , wherein the haptic effect pattern includes one or more parameters for each of the haptic effects, the parameters including magnitude, frequency, and/or type of haptic effect. 
     
     
         17 . The non-transitory computer readable storage medium according to  claim 15 , wherein the media object includes an audio object or a video object. 
     
     
         18 . The non-transitory computer readable storage medium according to  claim 15 , wherein the haptic effect pattern only includes data relating to haptically-active time periods. 
     
     
         19 . The non-transitory computer readable storage medium according to  claim 15 , wherein the haptic effect pattern includes a plurality of duration times that indicate alternating actuator OFF and actuator ON time periods. 
     
     
         20 . The non-transitory computer readable storage medium according to  claim 15 , wherein the media object and the haptic effect pattern are synchronized.