Systems and methods for guiding and measuring neck and shoulder protraction and retraction motions in virtual/augmented reality

Abstract

A virtual/augmented reality-based system for guiding patients through rehabilitation exercises and providing real time feedback is disclosed. In various embodiments the system, methods, and computer program products relate to guiding and measuring neck and shoulder motion, specifically protraction and retraction motions. A virtual reality environment includes a fixed object having a guidance feature and a moveable object having a complementary shape to the guidance features. Whether the fixed object is in a complimentary orientation to the movable object is determined. When the fixed object is in a complimentary orientation with the movable shape, an indication is presented to the user to perform a motion. A plurality of sensors determines a plurality of measurements relating to the motion of the user. Whether the fixed object is in a complementary orientation with the movable object is determined based on the plurality of measurements.

1 . A method comprising:
 providing a virtual environment to a user via a virtual or augmented reality system, the virtual environment comprising:
 a first 3D object fixed in space, the first 3D object having a first shape, and 
 a second 3D object fixed to the user, the second 3D object having a second shape that is complementary to the first shape; 
   determining whether the first shape is in a complimentary orientation to the second shape;   when the first shape is in a complimentary orientation with the second shape, indicating to the user to perform a motion via the virtual or augmented reality system;   determining by a plurality of sensors a plurality of measurements relating to the motion of the user, the plurality of measurements comprising a protraction length and/or a retraction length; and   determining whether the second 3D object is in the complementary orientation with the first 3D object based on the plurality of measurements.   
     
     
         2 . (canceled) 
     
     
         3 . The method of  claim 1 , wherein the first 3D object defines a first path, and wherein the plurality of measurements define a second path. 
     
     
         4 . The method of  claim 3 , wherein the first path and the second path each comprises a plurality of three-dimensional points. 
     
     
         5 . The method of  claim 3 , wherein determining whether the second 3D object is in the complementary orientation with the first 3D object comprises determining a difference between the first path and the second path. 
     
     
         6 . The method of  claim 5 , further comprising, when the difference is greater than a predetermined threshold, providing an indication to the user that the second 3D object is not in a complementary relationship with the first 3D object. 
     
     
         7 . The method of  claim 6 , further comprising, when the difference is greater than a predetermined threshold, providing an indication to the user of a direction of motion to position the second 3D object back in the complementary relationship with the first 3D object. 
     
     
         8 . The method of  claim 6 , further comprising, when the difference is greater than or equal to the predetermined threshold, providing an indication to the user that the second 3D object is in a complementary relationship with the first 3D object. 
     
     
         9 - 18 . (canceled) 
     
     
         19 . A system comprising:
 a virtual or augmented reality display adapted to display a virtual environment to a user;   a plurality of sensors coupled to the user;   a computing node comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of the computing node to cause the processor to perform a method comprising:   providing a virtual environment to the user via the virtual or augmented reality system, the virtual environment comprising:
 a first 3D object fixed in space, the first 3D object having a first shape, and 
 a second 3D object fixed to the user, the second 3D object having a second shape that is complementary to the first shape; 
 determining whether the first shape is in a complimentary orientation to the second shape; 
 when the first shape is in a complimentary orientation with the second shape, indicating to the user to perform a motion via the virtual or augmented reality system; 
 determining by a plurality of sensors a plurality of measurements relating to the motion of the user, the plurality of measurements comprising a protraction length and/or a retraction length; and 
 determining whether the second 3D object is in the complementary orientation with the first 3D object based on the plurality of measurements. 
   
     
     
         20 . (canceled) 
     
     
         21 . The system of  claim 19 , wherein the first 3D object defines a first path, and wherein the plurality of measurements define a second path. 
     
     
         22 . (canceled) 
     
     
         23 . The system of  claim 21 , wherein determining whether the second 3D object is in the complementary orientation with the first 3D object comprises determining a difference between the first path and the second path. 
     
     
         24 . The system of  claim 23 , further comprising, when the difference is greater than a predetermined threshold, providing an indication to the user that the second 3D object is not in a complementary relationship with the first 3D object. 
     
     
         25 . The system of  claim 24 , further comprising, when the difference is greater than a predetermined threshold, providing an indication to the user of a direction of motion to position the second 3D object back in the complementary relationship with the first 3D object. 
     
     
         26 . The system of  claim 24 , further comprising, when the difference is greater than or equal to the predetermined threshold, providing an indication to the user that the second 3D object is in a complementary relationship with the first 3D object. 
     
     
         27 - 36 . (canceled) 
     
     
         37 . A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:
 providing a virtual environment to the user via the virtual or augmented reality system, the virtual environment comprising:
 a first 3D object fixed in space, the first 3D object having a first shape, and 
 a second 3D object fixed to the user, the second 3D object having a second shape that is complementary to the first shape; 
   determining whether the first shape is in a complimentary orientation to the second shape;   when the first shape is in a complimentary orientation with the second shape, indicating to the user to perform a motion via the virtual or augmented reality system;   determining by a plurality of sensors a plurality of measurements relating to the motion of the user, the plurality of measurements comprising a protraction length and/or a retraction length; and   determining whether the second 3D object is in the complementary orientation with the first 3D object based on the plurality of measurements.   
     
     
         38 . (canceled) 
     
     
         39 . The computer program product of  claim 37 , wherein the first 3D object defines a first path, and wherein the plurality of measurements define a second path. 
     
     
         40 . The computer program product of  claim 39 , wherein the first path and the second path each comprises a plurality of three-dimensional points. 
     
     
         41 . The computer program product of  claim 40 , wherein determining whether the second 3D object is in the complementary orientation with the first 3D object comprises determining a difference between the first path and the second path. 
     
     
         42 . The computer program product of  claim 41 , further comprising, when the difference is greater than a predetermined threshold, providing an indication to the user that the second 3D object is not in a complementary relationship with the first 3D object. 
     
     
         43 . The computer program product of  claim 42 , further comprising, when the difference is greater than a predetermined threshold, providing an indication to the user of a direction of motion to position the second 3D object back in the complementary relationship with the first 3D object. 
     
     
         44 . The computer program product of  claim 42 , further comprising, when the difference is greater than or equal to the predetermined threshold, providing an indication to the user that the second 3D object is in a complementary relationship with the first 3D object. 
     
     
         45 - 54 . (canceled)