Multi-sensory learning with feedback

Abstract

The disclosed embodiments relate to improved learning methods and systems incorporating multisensory feedback. In some embodiments, virtual puzzle pieces represented by letters, numbers, or words, may animate in conjunction with phonetic sounds (e.g., as to letters or letter combinations) and pronunciation readings (e.g., as to words and numbers) when selected by a user. The animations and audio soundings may be coordinated to better inculcate the correspondence between graphical icons and corresponding vocalizations in the user.

What is claimed is: 
     
         1 . A computer-implemented method for providing a multi-sensory experience during input comprising:
 displaying multiple characters associated with one or more words,
 wherein one or more characters of the multiple characters are translated relative to correct positions, and 
 wherein the correct positions are with respect to positions in at least one word or positions in at least one sentence; 
   receiving a selection of at least one of the multiple characters;   animating the selected at least one of the multiple characters while playing an audio clip associated with the selected at least one of the multiple characters;   receiving an input moving the selected at least one of the multiple characters from a first position to a second position;   determining that the second position corresponds to the correct position; and   displaying a celebration animation following the determination that the second position corresponds to the selected at least one of the multiple characters' correct position in the one or more words.   
     
     
         2 . The computer-implemented method of  claim 1 , wherein the displaying includes displaying a single word comprising the multiple characters, and wherein animating the selected at least one of the multiple characters comprises overlaying at least one of an eye or a mouth upon a selected at least one of the multiple characters. 
     
     
         3 . The computer-implemented method of  claim 1 , wherein the multiple characters comprises multiple alphanumeric characters for multiple words of a sentence, and wherein the displaying includes displaying some fixed words of the sentence and displaying other words comprising the multiple characters translated relative to positions in the sentence. 
     
     
         4 . The computer-implemented method of  claim 1 , wherein the multiple characters comprise characters from an Asian language. 
     
     
         5 . The computer-implemented method of  claim 1 , wherein the audio clip comprises a sounding of the selected at least one of the multiple characters. 
     
     
         6 . The computer-implemented method of  claim 5 , further comprising selecting the audio clip such that the sounding of the selected at least one of the multiple characters corresponds to the word. 
     
     
         7 . The computer-implemented method of  claim 6 , wherein the correspondence comprises a short or long vowel version of the sounding. 
     
     
         8 . An non-transitory computer readable medium comprising instructions configured to cause at least one processor to perform a method comprising:
 displaying multiple component objects associated with a complete object, each component object of the multiple component objects translated relative to the component object's correct position in the complete object;   receiving a selection of at least one of the multiple component objects;   animating the selected at least one of the multiple component objects while playing an audio clip associated with the selected at least one of the multiple component objects;   receiving an input moving the selected at least one of the multiple component objects from a first position to a second position;   determining that the second position corresponds to the selected at least one of the multiple component objects' position in the complete object; and   modifying the animation following the determination that the second position corresponds to the selected at least one of the multiple component objects' correct position in the complete object.   
     
     
         9 . The non-transitory computer readable medium of  claim 8 , wherein modifying the animation comprises stopping the animation. 
     
     
         10 . The non-transitory computer readable medium of  claim 8 , the method further comprising displaying a celebration animation following the determination that the second position corresponds to the selected at least one of the multiple objects' correct position in the complete object. 
     
     
         11 . The non-transitory computer readable medium of  claim 10 , the method further comprising generating a readback audio associated with the complete object. 
     
     
         12 . The non-transitory computer readable medium of  claim 8 , wherein the complete object comprises one of a sentence, an image of a flower, an image of a cell, an equation, a chemical formula, or an image of an animal. 
     
     
         13 . The non-transitory computer readable medium of  claim 8 , wherein animating the selected at least one of the multiple component objects' comprises overlaying at least one of an eye or a mouth upon the selected at least one of the multiple component objects'. 
     
     
         14 . The non-transitory computer readable medium of  claim 8 , wherein the audio clip comprises a sounding of a name associated with the selected at least one of the multiple component objects. 
     
     
         15 . The non-transitory computer readable medium of  claim 14 , the method further comprising selecting the audio clip such that the sounding of the selected at least one of the plurality of characters corresponds to the word. 
     
     
         16 . A computer system comprising:
 at least one processor;   at least one memory comprising instructions configured to cause the at least one processor to perform a method comprising the steps:
 displaying multiple component objects associated with a complete object, each component object of the multiple component objects translated relative to the component object's correct position in the complete object; 
 animating at least one of the multiple component objects while playing an audio clip associated with the at least one of the multiple component objects; and 
 modifying the animation following the determination that a position of the at least one of the multiple component objects corresponds to the at least one of the multiple component objects' correct position in the complete object. 
   
     
     
         17 . The computer system of  claim 16 , wherein modifying the animation comprises stopping the animation. 
     
     
         18 . The computer system of  claim 16 , the method further comprising displaying a celebration animation following a determination that a position of the selected at least one of the multiple objects' corresponds to the selected at least one of the multiple objects' correct position in the complete object. 
     
     
         19 . The computer system of  claim 18 , the method further comprising generating a readback audio associated with the complete object. 
     
     
         20 . The computer system of  claim 16 , wherein the complete object comprises one of a sentence, an image of a flower, an image of a cell, an equation, a chemical formula, or an image of an animal.