Systems and methods for real-time feedback and athletic training

Abstract

A cloud service comprising one or more servers and one or more storage devices, the cloud service configured to allow a trainer to upload videos of exercises, labels, and instructions via the servers for storage in the one or more storage devices, the servers configured to: analyze the video by performing key point extraction, key feature extraction and key frame extraction, generate exercise features, construct trackable exercise information using the labels and instructions, and store the trackable exercise information in the one or more storage devices, wherein the trackable feedback is generated based on the trackable exercise information.

What is claimed: 
     
         1 . A system for real-time feedback and training, comprising:
 a user device:
 a camera configured to capture video of a user; 
 a display; 
 a processor configured to execute instructions, the instructions configured to cause the processor to perform the steps of:
 present the user with a user interface at least partially via the display, 
 receive a selection of a trainer via the user interface, 
 receive a selection of an exercise associated with the trainer via the user interface, 
 load a video of the selected exercise, the video comprising a training portion, 
 cause the training portion of the video to be displayed on the display while simultaneously activating the camera in order to capture video of the user performing actions depicted in the training portion of the video, 
 analyze the captured video in order to match movements of the user depicted in the video to movements in the training portion of the video, 
 generate trackable feedback, and 
 provide the feedback via the user interface; and 
 
   a cloud service comprising one or more servers and one or more storage devices, the cloud service configured to allow a trainer to upload videos of exercises, labels, and instructions via the servers for storage in the one or more storage devices, the servers configured to:
 analyze the video by performing key point extraction, key feature extraction and key frame extraction, 
 generate exercise features, 
 construct trackable exercise information using the labels and instructions, and 
 store the trackable exercise information in the one or more storage devices, wherein the trackable feedback is generated based on the trackable exercise information. 
   
     
     
         2 . The device of  claim 1 , wherein providing feedback comprises causing an avatar to be displayed on the display, wherein the avatar mimics the movements of the user, and color coding portions of the avatar to indicate whether the user is properly matching the movements in the training portion of the video. 
     
     
         3 . The device of  claim 1 , wherein providing feedback comprises providing audible feedback via the user interface. 
     
     
         4 . The device of  claim 1 , wherein analyzing the captured video comprises performing key point extraction, key feature extraction and key frame extraction. 
     
     
         5 . The device of  claim 1 , wherein the instructions are further configured to cause the processor to compute performance metrics that are communicated to the cloud service vis the communication interface to the cloud service for storage. 
     
     
         6 . The device of  claim 1 , further comprising a communication interface configured to allow the smart exercise device to communicate with a cloud service, wherein the instructions are further configured to cause the processor to communicate the trainer and the exercise selection to the cloud service via the communication interface and to download the video from the cloud service via the communication interface. 
     
     
         7 . A cloud service in a system for real-time feedback and training, comprising:
 one or more servers and one or more storage devices, the cloud service configured to allow a trainer to upload videos of exercises, labels, and instructions via the servers for storage in the one or more storage devices, the servers configured to:
 analyze the video by performing key point extraction, key feature extraction and key frame extraction, 
 generate exercise features, 
 construct trackable exercise information using the labels and instructions, and 
 store the trackable exercise information in the one or more storage devices, wherein the trackable feedback is generated based on the trackable exercise information. 
   
     
     
         8 . The cloud service of  claim 7 , wherein the servers are configured to receive selections of videos from a user device and download the videos. The device of  claim 7 , wherein providing feedback comprises providing audible feedback via the user interface. 
     
     
         9 . The cloud service of  claim 7 , wherein the servers are further configured to receive performance metrics for a plurality of users and store the performance metrics in the one or more storage devices.