Synchronous multi-media recording and playback with end user control of time, data, and event visualization for playback control over a network

Abstract

A system and system are provided for providing synchronous multimedia recording and playback. Aspects the exemplary embodiment include in response to a training session is being conducted, synchronously recording in real-time simulator data from a simulator captured by a simulator capture tool, and video of the training session captured by a plurality of A/V sources; encoding each of the videos captured by the plurality of A/V sources as respective digital media files formatted as streaming media; and transmitting both the simulator data and the video media files from a server to a client over a network, such that when the client receives the simulator data and the stream, the respective videos are synchronously played back with the simulator data on the client

1 . A method for providing synchronous multimedia recording and playback, comprising:
 in response to a training session is being conducted, synchronously recording in real-time simulator data from a simulator captured by a simulator capture tool, and video of the training session captured by a plurality of A/V sources;   encoding each of the videos captured by the plurality of A/V sources as respective digital media files formatted as streaming media; and   transmitting both the simulator data and the video media files from a server to a client over a network, such that when the client receives the simulator data and the stream, the respective videos are synchronously played back with the simulator data on the client.   
   
   
       2 . The method of  claim 1  wherein the streaming further comprises dynamically generating a single media file that references as sources the respective streaming media files, and streaming the single media file. 
   
   
       3 . The method of  claim 1  further comprising playing back the simulator data as a trend of the telemetry values along a timeline. 
   
   
       4 . The method of  claim 3  further comprising identifying transition points of the telemetry values during playback. 
   
   
       5 . The method of  claim 1  further comprising playing back the videos on the client in a streaming media player, and playing back the simulator data in a flash player. 
   
   
       6 . The method of  claim 1  further comprising allowing an end-user of the client to advance or return to any point in time in the synchronous play back of the videos. 
   
   
       7 . The method of  claim 1  further comprising streaming the synchronous playback in real-time during the training session. 
   
   
       8 . The method of  claim 1  further comprising enabling an end-user to enter annotation and assessment data while the videos and simulation data are synchronously played back. 
   
   
       9 . The method of  claim 8  further comprising during the synchronous playback, displaying a checklist of training tasks to be completed by a trainee during the trading session, and allowing an end-user to indicate through the interface which tasks were completed during the synchronous playback for real-time annotation and assessment of the trainee. 
   
   
       10 . A system for providing synchronous multimedia recording and playback, comprising:
 a plurality of A/V sources for capturing video of a training session, the training session including a use of a simulator;   a simulation capture tool for capturing real-time simulator data from the simulator, wherein the simulator data and the video of the training session are recorded synchronously;   one or more encoders for encoding each of the videos captured by the plurality of A/V sources as respective digital media files formatted as streaming media; and   means for transmitting both the simulator data and the video media files from a server to a client over a network, such that when the client receives the simulator data and the stream, the respective videos are synchronously played back with the simulator data on the client.   
   
   
       11 . The system of  claim 10  wherein the means for transmitting include a skills assessment tool and a video on demand server. 
   
   
       12 . The system of  claim 11  wherein the means skills assessment tool includes:
 an annotation and assessment tool for enabling an end-user to enter annotation and assessment data of a trainee's performance while the videos and simulation data are synchronously played back; and   a debrief tool for allowing the end-user to select which recorded training session to view for enabling automated debrief sessions.   
   
   
       13 . The system of  claim 10  wherein a single media file is dynamically generated that references as sources the respective streaming media files, and streaming the single media file. 
   
   
       14 . The system of  claim 10  wherein the simulator data is played back as a trend of the telemetry values along a timeline. 
   
   
       15 . The system of  claim 14  wherein transition points of the telemetry values are identified during playback. 
   
   
       16 . The system of  claim 10  wherein the videos are played back on the client in a streaming media player, and playing back the simulator data in a flash player. 
   
   
       17 . The system of  claim 10  wherein an end-user of the client is allowed to advance or return to any point in time in the synchronous play back of the videos. 
   
   
       18 . The system of  claim 10  wherein the synchronous playback is streamed in real-time during the training session. 
   
   
       19 . The system of  claim 10  wherein during the synchronous playback, a checklist of training tasks to be completed is displayed by a trainee during the trading session, and an end-user is allowed to indicate through the interface which tasks were completed during the synchronous playback for real-time annotation and assessment of the trainee. 
   
   
       20 . An executable software product stored on a computer-readable medium containing program instructions for providing synchronous multimedia recording and playback, wherein in response to a training session is being conducted, video of the training session is captured by a plurality of A/V sources, the program instructions for:
 synchronously recording with the video, real-time simulator data from a simulator captured by a simulator capture tool;   encoding each of the videos captured by the plurality of A/V sources as respective digital media files formatted as streaming media; and   transmitting both the simulator data and the video media files from a server to a client over a network, such that when the client receives the simulator data and the stream, the respective videos are synchronously played back with the simulator data on the client.