Systems and methods for optimizing one or more audio tracks to a video stream

Abstract

Disclosed are systems and methods for detecting the movements in an exerciser's repetitive movement pattern that, when pre-recorded audio footfall sound files are played, most closely support the illusion that the user is generating the sounds with their own “virtual” footfalls, thus creating an enhanced virtual exercise experience. The system generates a signal to communicate the virtual footfall timing with a media playback system, and plays back media files that support the virtual exercise experience.

1 . An exercise system comprising:
 a video playing device in communication with a central processing unit and a user input interface connected thereto adapted and configured to receive one or more inputs from a user and transmit the one or more inputs to the central processing unit;   a video frame sequence encoded onto a storage medium in communication with and playable on the video playing device;   a video monitor in communication with the video playing device for displaying the video frame sequence reproduced by the video playing device;   a video frame rate controller configured to vary a rate of display of sequential frames in the video frame sequence reproduced by the video playing device on the video monitor in response to the one or more inputs from the user;   one or more audio rate controllers configured to vary a rate of delivery of two or more audio files on an audio playing device in response to the one or more inputs from the user; and   an exercise device.   
     
     
         2 . The system of  claim 1  wherein the video frame rate controller comprises a computer program stored on a storage medium with the prerecorded video frame sequence, the program being operable with the central processing unit in the video playing device when the video sequence is played to modify the frame display rate in response to the signal from a user interface rate detector. 
     
     
         3 . The system of  claim 2  wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device operation detector. 
     
     
         4 . The system of  claim 3  wherein the user interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user controlling the rate at which the video is displayed on the video monitor. 
     
     
         5 . The system of  claim 1  wherein the audio rate controller comprises a computer program stored on a storage medium with an audio sequence, the program being operable with the central processing unit in the audio playing device when the audio sequence is played to modify the audio delivery rate in response to the signal from the user interface rate detector. 
     
     
         6 . The system of  claim 5  wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device operation detector. 
     
     
         7 . The system of  claim 6  wherein the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display. 
     
     
         8 . The system of  claim 1  wherein the user input is one or more of each of manual input and automatic input. 
     
     
         9 . The system of  claim 8  wherein the manual input is one or more of height, weight, age, difficulty level, target training rate, target heart rate, and target activity level. 
     
     
         10 . The system of  claim 8  wherein the automatic input is a signal from one or more of a biological parameter measurer, and an exercise device operation detector. 
     
     
         11 . The system of  claim 1  wherein the exercise device is selected from the group comprising a bicycle, a stair stepper, and an elliptical trainer. 
     
     
         12 . The system of  claim 1  wherein the rate of delivery of the two or more audio files are delivered asynchronous to each other. 
     
     
         13 . The system of  claim 1  wherein each of the recorded video frame sequences includes a frame time stamp and the video frame rate controller is adapted to generate a variable time adjustment factor in proportion to the one or more inputs from the user and a adjustor adapted to apply a factor to the frame time stamp to determine a modified time at which the next video frame sequence is to be displayed. 
     
     
         13 . An apparatus for engaging a user of an exercise device interactively in viewing a video frame sequence of an activity on a video monitor comprising:
 a video player in communication with the video monitor adapted and configured to play a video frame sequence on the video monitor;   a detector adapted and configured to detect a rate of exercise by the user on the exercise apparatus and transmit a signal proportional to the rate of exercise;   a video controller in communication with the video player adapted and configured to receive the signal proportional to the rate of exercise and transmit a signal generated in response to the signal proportional to the rate of exercise to the video player wherein the video player adjusts the rate at which the video frame sequence is displayed;   two or more audio controllers in communication with an audio player adapted and configured to receive the signal proportional to the rate of exercise and transmit one or more signals generated in response to the signal proportional to the rate of exercise to the audio player wherein the audio player adjusts the rate at which the audio is played.   
     
     
         14 . The apparatus according to  claim 13  wherein the exercise device is selected from the group comprising a bicycle, a stair stepper and an elliptical trainer. 
     
     
         15 . The apparatus according to  claim 13  wherein the signal from the user interface rate detector is one or more of a biological parameter measurer, and an exercise device detector. 
     
     
         16 . The apparatus according to  claim 15  wherein the interface rate detector is a heart rate signal receiver for receiving a signal from a transmitter worn by the user and generating a signal usable by the video player for displaying a user's heart rate on the display. 
     
     
         17 . A method of controlling a video frame sequence display rate of a video playback sequence in a device in response to an external signal comprising the steps of:
 (a) accessing a duration time stamp for a current video frame;   (b) determining from the external signal an adjustment value for changing the display rate (c) obtaining a modified duration time to a next frame by adding the adjustment value to the duration time stamp;   (d) displaying the next frame when the modified duration time has passed;   (e) accessing a duration time stamp for a current audio data packet;   (f) determining from the external signal an adjustment value for changing the rate of delivery of the audio data packet;   (g) obtaining a modified duration time to a next audio frame by adding the adjustment value to the duration time stamp; and   (h) playing the next audio data packet when the modified duration time has passed.   
     
     
         18 . The method of  claim 17  further comprising the step of repeating steps (a) through (d) for each subsequent video frame and steps (e) through (h) for each subsequent audio data packet. 
     
     
         19 . The method of  claim 17  wherein the accessing step (a) further comprises the steps of:
 i) setting a time offset to current clock time;   ii) displaying a current video frame; and   iii) accessing a frame time stamp and a duration time stamp for the current video frame.   
     
     
         20 . The method of  claim 19  wherein the step of determining further comprises the step of comparing the external signal to predetermined criteria to determine the adjustment value. 
     
     
         21 . The method of  claim 20  wherein the external signal is a user variable exercise rate signal. 
     
     
         22 . The method of  claim 20  wherein the step of displaying (d) further comprises the steps of:
 i) adding the modified duration value to the time offset to obtain a next frame time; and   ii) displaying the next frame when clock time exceeds the next frame time.   
     
     
         23 . The method of  claim 17  wherein the accessing step (e) further comprises the steps of:
 i) setting a time offset to current clock time;   ii) playing a current audio data packet; and   iii) accessing a frame time stamp and a duration time stamp for the current audio data packet.   
     
     
         24 . The method of  claim 23  wherein the step of determining (f) further comprises the step of comparing the external signal to predetermined criteria to determine the adjustment value. 
     
     
         25 . The method of  claim 24  wherein the external signal is a user variable exercise rate signal. 
     
     
         26 . The method of  claim 23  wherein the step of playing (h) further comprises the steps of:
 i) adding the modified duration value to the time offset to obtain a next audio data packet time; and   ii) playing the next audio data packet when clock time exceeds the next frame time.