Training motion with observation-based feedback

Abstract

A system and method for training a student to perform bodily movements are disclosed. A model example of a bodily motion is communicated to the student, typically via video display of a model video example of the bodily motion. The student practices the bodily motion, during which an electronic observation system observes the practice. Based on such observation, feedback is provided to the user, which may include affecting: (i) subsequent video displays relating to the bodily motions; (ii) sessions in which sensory stimulus perceivable by the user is suppressed to facilitate training; and (iii) practice sessions in which the student practices the bodily motion.

1 . A method for training a student to perform a bodily motion, comprising:
 communicating a model example of the bodily motion to the student;   subsequent to the communicating, and while the student is practicing the bodily motion in a first practice session, electronically observing the student's practice of the bodily motion with an electronic observation system; and   providing feedback to the student based on the electronic observation.   
     
     
         2 . The method of  claim 1 , where the communicating includes displaying a model video example to the student in a first display session. 
     
     
         3 . The method of  claim 2 , further comprising:
 determining, as a result of the electronically observing, that the student's practice of the bodily motion in the first practice session deviates from a desired performance and where the feedback reflects such deviation.   
     
     
         4 . The method of  claim 3 , where feedback emphasizing the deviation is provided in video content in a second display session. 
     
     
         5 . The method of  claim 3 , where the feedback includes providing audio content to the student that emphasizes the deviation. 
     
     
         6 . The method of  claim 2 , further comprising:
 playing audio content to the student during the first display session; and playing the audio content again during the first practice session, and where the feedback includes dynamically controlling the playing of the audio content during the first practice session so as to maintain an audio-motion synchronization which is the same as that employed in the first display session.   
     
     
         7 . The method of  claim 6 , where providing the feedback includes, during the first practice session, providing an audio indication when the student's performance deviates from a desired performance. 
     
     
         8 . The method of  claim 2 , further comprising:
 subsequent to the first practice session, displaying follow-up video content to the student, such follow-up video content being different in at least one aspect from the model video example and generated in response to and based on electronic observation of the first practice session.   
     
     
         9 . The method of  claim 8 , where the electronically observing includes observing that the student's performance in the first practice session deviates from a desired performance, and where the follow-up video content emphasizes the deviation. 
     
     
         10 . The method of  claim 2 , further comprising, between the first display session and the first practice session, suppressing one or both of audio and visual stimulus perceivable by the student to thereby provide a sensory-reduced session. 
     
     
         11 . The method of  claim 10 , further comprising:
 playing audio content to the student during the first display session; and   playing the audio content to the student during the sensory-reduced session.   
     
     
         12 . The method of  claim 11 , further comprising playing the audio content to the student during the first practice session. 
     
     
         13 . The method of  claim 2 , where the electronic observation system includes an optical motion capture system. 
     
     
         14 . The method of  claim 2 , where the electronic observation system includes wearable sensors affixed to the student. 
     
     
         15 . The method of  claim 2 , where audio content and video content is provided to the student using a head-mounted display which includes an audio output device, and where the head-mounted display is configured to suppress one or both of audio and visual stimulus perceivable by the student to thereby provide a sensory-reduced session. 
     
     
         16 . The method of  claim 2 , where providing the feedback includes playing the model video example in a second display session at a speed different than that used in the first display session. 
     
     
         17 . The method of  claim 2 , further comprising:
 playing audio content associated with the model video example during the first display session;   suppressing one or both of audio and visual stimulus perceivable by the student to thereby provide a first sensory-reduced session; and   playing the audio content during the first sensory-reduced session, where the providing the feedback includes again playing the audio content in one or both of a subsequent display session and a subsequent sensory-reduced session, but at a different speed than used during the first display session.   
     
     
         18 . A system for training a student to perform a bodily motion, comprising:
 an output subsystem, storage subsystem, electronic observation subsystem and feedback subsystem operatively coupled together, the storage subsystem containing executable instructions operative to:   cause the output subsystem to display to the student a model video example of the bodily motion in a first display session;   cause the electronic observation subsystem to, after the first display session, electronically observe the student practicing the bodily motion in a first practice session; and   cause the feedback subsystem to generate and provide feedback to the student based on the electronic observation of the first practice session.   
     
     
         19 . The system of  claim 18 , where the electronic observation subsystem is operative to determine that the student's practice in the first practice session deviates from a desired performance, and where the feedback reflects such deviation. 
     
     
         20 . The system of  claim 19 , where the feedback includes playing video content that emphasizes the deviation. 
     
     
         21 . The system of  claim 19 , where the feedback includes playing audio content to the student that emphasizes the deviation. 
     
     
         22 . The system of  claim 18 , where the output subsystem is operative to:
 play audio content during the first display session; and   play the audio content during the first practice session, where the feedback includes controlling the playing of the audio content during the first practice session so as to maintain an audio-motion synchronization which is the same as that employed in the first display session.   
     
     
         23 . The system of  claim 22 , where providing the feedback includes, during the first practice session, providing an audio indication when the student's performance deviates from a desired performance. 
     
     
         24 . The system of  claim 18 , where the feedback includes display of follow-up video content to the student in a second display session, such follow-up video content being different in at least one aspect from the model video example and generated in response to and based on electronic observation of the first practice session. 
     
     
         25 . The system of  claim 24 , where the electronic observation subsystem is operative to determine that the student's practice of the bodily motion in the first practice session deviates from a desired performance, and where the follow-up video content emphasizes such deviation. 
     
     
         26 . The system of  claim 18 , where the electronic observation subsystem includes an optical motion capture system. 
     
     
         27 . The system of  claim 18 , where the electronic observation subsystem includes wearable sensors affixed to the student's body. 
     
     
         28 . The system of  claim 18 , where the output subsystem includes a head-mounted display with an audio output device, and where video and audio content provided to the student is performed using the head-mounted display, and where the head-mounted display is also configured to suppress one or both of audio and visual stimulus perceivable by the student to thereby provide a sensory-reduced session. 
     
     
         29 . The system of  claim 18 , where providing the feedback includes playing the model video example in a second display session at a speed different than that used in the first display session. 
     
     
         30 . The system of  claim 18 , where the executable instructions are further operative to:
 cause the output subsystem to play audio content associated with the model video example in the first display session;   cause the output subsystem to play the audio content during a first sensory-reduced session, in which one or both of audio and visual stimulus perceivable by the student are suppressed, where the feedback includes again playing the audio content in one or both of a subsequent display session and a subsequent sensory-reduced session, but at a different speed than used during the first display session.   
     
     
         31 . A method for training a student to perform a bodily motion, comprising:
 displaying a model video example of the bodily motion to the student in a first display session;   playing audio content during the first display session;   subsequent to the first display session, suppressing sensory stimulus perceivable by the student to thereby provide a first sensory-reduced session;   playing the audio content during the first sensory-reduced session;   subsequent to the sensory-reduced session, and while the student is practicing the bodily motion in a first practice session, electronically observing the student's practice of the bodily motion with an electronic observation system;   controlling, based on the electronic observation, subsequent display of video content to the student in a second display session; and   controlling, based on the electronic observation, subsequent playing of audio content in one or both of a second display session and a second sensory-reduced session.   
     
     
         32 . The method of  claim 31 , further comprising controlling, while the student is practicing the bodily motion, the playing of audio content during such practice, the audio content being controlled based on electronically observing the practice as it is occurring, so as to maintain an audio-motion synchronization that is the same as that employed while the audio content was being played during a display session preceding the practice. 
     
     
         33 . The method of  claim 31 , further comprising determining, based on the electronic observation of the first practice session, that the student's performance in that session deviated from a desired performance, and where subsequent control of audio or video presented to the student reflects the deviation.