Methods, systems and devices for interacting with a computing device

Abstract

Example embodiments relate to processing user interactions with a computing device, comprising receiving a user-initiated action performed on a character button, the character button representing a character; determining whether the user-initiated action is performed in a normal an abnormal operating manner. When a normal operating manner is determined, displaying the character on a graphical display. When an abnormal operating manner is determined: identifying a previously entered character preceding the character, activating a microphone and receiving, by the microphone, a spoken word, searching a subset of a database for a textual form of the received spoken word, the subset based on one or more of the character and the previously entered character, and displaying a correct textual form of the spoken word on a graphical display by amending one or more of the character and the previously entered character when one or more of the character and the previously entered character is inconsistent with the textual form of the spoken word found in the searching.

1 - 94 . (canceled) 
     
     
         95 . A method for processing user interactions with a processor, the method comprising:
 displaying a virtual keyboard on a touchscreen display, the virtual keyboard comprising a character button representing a character;   when the character button representing the character of the virtual keyboard is pressed in a normal operating manner, displaying the character in an editable section displayed on the touchscreen display; and   when the character button representing the character is pressed in an abnormal operating manner:
 activating a microphone to receive a spoken word; 
 receiving the spoken word and converting the spoken word into a form searchable in a database; 
 identifying the character of the pressed character button and all immediately preceding non-null characters displayed in the editable section of the touchscreen display before the receiving of the spoken word; 
 identifying a first subset of the database, the first subset comprising words having all of the identified immediately preceding non-null characters and the identified character of the pressed character button in any order; 
 searching the first subset for a textual form of the received spoken word; 
 when the search of the first subset yields a match:
 performing a first amending of one or more of the identified immediately preceding non-null characters and/or the identified character of the pressed character button displayed in the editable section based on the textual form of the received spoken word found in the search; and 
 displaying the textual form of the received spoken word in the editable section based on the first amending; and 
 
 when the search of the first subset does not yield a match:
 selecting a second subset comprising words having one or more of the identified immediately preceding non-null characters in an order different from the order of the identified immediately preceding non-null characters used in the first subset and not having the identified character of the pressed character button; 
 searching the second subset for the textual form of the received spoken word; 
 performing a second amending of one or more of the identified immediately preceding non-null characters and the identified character of the pressed character button displayed in the editable section based on the textual form of the spoken word found in the said searching of the second subset; and 
 displaying the textual form of the spoken word found in the searching of the second subset in the editable section based on the second amending. 
 
   
     
     
         96 . The method of  claim 95 , wherein the abnormal operating manner comprises a pressing down on the character button for greater than a threshold duration. 
     
     
         97 . The method of  claim 95 , further comprising displaying more than one textual forms of the spoken word on the touchscreen display when the searching of any of the subsets return more than one match, wherein at least one of the displayed textual forms are user-selectable from among the more than one displayed textual forms. 
     
     
         98 . The method of  claim 95 , further comprising deactivating the character button after the character button is pressed in an abnormal operating matter. 
     
     
         99 . The method of  claim 95 , wherein one or more of the first and second subsets comprise words having one or more characters related to one or more of the identified immediately preceding non-null characters. 
     
     
         100 . A method for processing user interactions with a processor, the method comprising:
 receiving a user-initiated action performed on a character button of a keyboard, the character button representing a character;   when the received user-initiated action performed on the character button representing the character is performed in a normal operating manner, displaying the character in an editable section displayed on a graphical display; and   when the received user-initiated action performed on the character button representing the character is performed in an abnormal operating manner:
 activating a microphone and receiving, by the microphone, a spoken word; 
 identifying immediately preceding non-null characters displayed in the editable section; 
 identifying a subset of a database, the subset comprising words having the identified immediately preceding non-null characters in any order; 
 searching the subset for a textual form of the received spoken word; 
 when the search of the subset yields a match:
 performing an amending of one or more of the identified immediately preceding non-null characters displayed in the editable section, the amending based on the textual form of the received spoken word found in the searching of the subset; and 
 displaying the textual form of the received spoken word found in the searching of the subset in the editable section based on the amending; and 
 
 when the search of the subset does not yield a match:
 selecting a second subset of the database, the second subset comprising words not having one or more of the identified immediately preceding non-null characters; 
 searching the second subset for the textual form of the received spoken word; 
 performing a second amending of one or more of the identified immediately preceding non-null characters displayed in the editable section, the second amending based on the textual form of the received spoken word found in the searching of the second subset; and 
 displaying the textual form of the received spoken word found in the searching of the second subset in the editable section based on the second amending. 
 
   
     
     
         101 . The method of  claim 100 , further comprising:
 saving, in a second database, the received spoken word and an association of the received spoken word with the textual form of the spoken word found in the searching of the second subset;   receiving a second user-initiated action performed on a second character button of the keyboard, the second character button representing a second character, the second user-initiated action received after the receiving of the user-initiated action performed on the character button;   when the received second user-initiated action performed on the second character button representing the second character is performed in the normal operating manner, displaying the second character in the editable section displayed on the graphical display; and   when the received second user-initiated action performed on the second character button representing the second character is performed in the abnormal operating manner:
 activating the microphone and receiving, by the microphone, a second spoken word; 
 performing a second identifying of immediately preceding non-null characters displayed in the editable section; 
 searching the second database for a textual form of the received second spoken word, the searching of the second database comprising comparing the received second spoken word to the received spoken word stored, by the saving, in the second database; and 
 when the received second spoken word is determined, by the comparing, to match the received spoken word stored, by the saving, in the second database:
 performing an amending of one or more characters of the second identified immediately preceding non-null characters displayed in the editable section based on the association of the received spoken word with the textual form of the spoken word stored, by the saving, in the second database; and 
 displaying a correct textual form of the second spoken word in the editable section based on the said amending. 
 
   
     
     
         102 . The method of  claim 100 , wherein the abnormal operating manner comprises a pressing down on the character button for greater than a threshold duration. 
     
     
         103 . The method of  claim 100 , further comprising displaying more than one textual forms of the spoken word on the graphical display when the searching of any of the subsets return more than one match, wherein at least one of the displayed textual forms are user-selectable from among the more than one displayed textual forms. 
     
     
         104 . The method of  claim 100 , wherein the keyboard comprises a virtual keyboard displayable, by the processor, on the graphical display. 
     
     
         105 . The method of  claim 100 , further comprising deactivating the character button after the character button is pressed in an abnormal operating matter. 
     
     
         106 . The method of  claim 100 , wherein one or more of the first and second subsets comprise words having one or more characters related to one or more of the identified immediately preceding non-null characters. 
     
     
         107 . A method for processing user interactions with a processor, the method comprising:
 receiving a first user-initiated action performed on a first character button of a keyboard, the first character button representing a first character;   when the received first user-initiated action performed on the first character button representing the first character is performed in a normal operating manner, displaying the first character in an editable section displayed on a graphical display;   when the received first user-initiated action performed on the first character button representing the first character is performed in an abnormal operating manner:
 activating a microphone and receiving, by the microphone, a first spoken word; 
 identifying immediately preceding non-null characters displayed in the editable section; 
 identifying a first subset of a database, the first subset comprising words having the identified immediately preceding non-null characters in any order; 
 searching the first subset for a textual form of the received first spoken word; and 
 when the search of the first subset yields a match to the received first spoken word:
 causing the identified immediately preceding non-null characters displayed in the editable section to display an overall correct textual form of the received spoken word found in the searching of the first subset; and 
 saving, in a second database, the received first spoken word and an association of the received first spoken word with the textual form of the first spoken word found in the searching of the first subset; 
 
   receiving a second user-initiated action performed on a second character button of the keyboard, the second character button representing a second character, the second user-initiated action received after the receiving of the first user-initiated action;   when the received second user-initiated action performed on the second character button representing the second character is performed in the normal operating manner, displaying the second character in the editable section displayed on the graphical display; and   when the received second user-initiated action performed on the second character button representing the second character is performed in the abnormal operating manner:
 activating the microphone and receiving, by the microphone, a second spoken word; 
 performing a second identifying of immediately preceding non-null characters displayed in the editable section; 
 searching the second database for a textual form of the received second spoken word, the searching of the second database comprising comparing the received second spoken word to the received first spoken word stored, by the saving, in the second database; and 
 when the received second spoken word matches the received first spoken word stored, by the saving, in the second database:
 causing the second identified immediately preceding non-null characters displayed in the editable section to display an overall correct textual form of the received first spoken word based on the association of the received first spoken word with the textual form of the first spoken word stored, by the saving, in the second database. 
 
   
     
     
         108 . The method of  claim 107 , further comprising:
 when the received second spoken word does not match the received first spoken word stored, by the saving, in the second database:
 searching a second subset of the database for a textual form of the received second spoken word, the second subset selected to comprise words having the second identified immediately preceding non-null characters in any order; and 
 causing the second identified immediately preceding non-null characters displayed in the editable section to display an overall correct textual form of the received second spoken word found in the searching of the second subset. 
   
     
     
         109 . The method of  claim 107 , further comprising:
 when the search of the first subset does not yield a match to the received first spoken word:
 searching a third subset of the database for the textual form of the received first spoken word, the third subset comprising words not having one or more of the identified immediately preceding non-null characters displayed in the editable section; and 
 causing the identified immediately preceding non-null characters displayed in the editable section to display an overall correct textual form of the received first spoken word found in the searching of the third subset. 
   
     
     
         110 . The method of  claim 107 , wherein the abnormal operating manner comprises a pressing down on the character button for greater than a threshold duration. 
     
     
         111 . The method of  claim 107 , further comprising displaying more than one textual forms of the spoken word on the graphical display when the searching of any of the subsets return more than one match, wherein at least one of the displayed textual forms are user-selectable from among the more than one displayed textual forms. 
     
     
         112 . The method of  claim 107 , wherein the keyboard comprises a virtual keyboard displayable, by the processor, on the graphical display. 
     
     
         113 . The method of  claim 107 , further comprising deactivating the character button after the character button is pressed in an abnormal operating matter. 
     
     
         114 . The method of  claim 107 , wherein one or more of the first subset comprises words having one or more characters related to one or more of the identified immediately preceding non-null characters.