User interface apparatus and operation range presenting method

Abstract

A user interface apparatus for performing input by image processing of an input image includes a unit for switching a mode for performing pointing and other modes on the basis of a result of the image processing of the input image. A user interface apparatus for performing input by image processing of an input image includes a unit for switching at least a cursor move mode, a select mode, and a double click mode on the basis of a result of the image processing of the input image. A user interface apparatus for performing input by image processing includes a unit for checking whether an object of image processing is in a proper range within which the image processing is possible, and a unit for presenting at least one of predetermined visual information and audio information, if it is determined that the object is outside the proper range. For example, the cursor is made smaller and/or lighter in color or made larger if the object is farther or closer, respectively, than the proper range, and the left or the right side of the cursor is deformed if the object falls outside the proper range to the left or the right.

1 . A user interface apparatus comprising: 
 means for cutting out an image to be processed from an input image and performing image processing; and    means for switching a mode for performing pointing and other modes on the basis of a result of the image processing of the input image.    
     
     
         2 . A user interface apparatus comprising: 
 means for cutting out an image to be processed from an input image and performing image processing; and    means for switching at least a cursor move mode, a select mode, and a double click mode on the basis of a result of the image processing of the input image.    
     
     
         3 . An apparatus according to    claim 1   , further comprising means for designating a recognition method of limiting image processing contents for each object selectable in the select mode, 
 wherein the image processing of the input image is performed for a selected object in accordance with a recognition method designated for the object.    
     
     
         4 . An apparatus according to    claim 2   , further comprising means for designating a recognition method of limiting image processing contents for each object selectable in the select mode, 
 wherein the image processing of the input image is performed for a selected object in accordance with a recognition method designated for the object.    
     
     
         5 . An apparatus according to    claim 1   , further comprising: 
 means for designating a recognition method of limiting image processing contents for each object selectable in the select mode; and    means for presenting, near a displayed object indicated by a cursor, information indicating a recognition method designated for the object.    
     
     
         6 . An apparatus according to    claim 2   , further comprising: 
 means for designating a recognition method of limiting image processing contents for each object selectable in the select mode; and    means for presenting, near a displayed object indicated by a cursor, information indicating a recognition method designated for the object.    
     
     
         7 . An apparatus according to    claim 1   , further comprising means for presenting the result of the image processing of the input image in a predetermined shape on a cursor.  
     
     
         8 . An apparatus according to    claim 2   , further comprising means for presenting the result of the image processing of the input image in a predetermined shape on a cursor.  
     
     
         9 . A user interface apparatus comprising: 
 a first device for inputting a reflected image; and    a second device for performing input by image processing of an input image,    wherein said second device comprises means for designating a recognition method of limiting contents of image processing of an input image with respect to said first device, and    said first device comprises means for performing predetermined image processing on the basis of the designated recognition method, and    means for sending back the input image and a result of the image processing to said second device.    
     
     
         10 . An apparatus according to    claim 9   , wherein 
 said first device further comprises means for requesting said second device to transfer information necessary for image processing suited to a necessary recognition method, if said first device does not have image processing means suited to the recognition method, and    said second device further comprises means for transferring the requested information to said first device.    
     
     
         11 . An apparatus according to    claim 9   , wherein each of said first and second devices further comprises means for requesting, when information necessary for image processing suited to a predetermined recognition method in the device is activated first, the other device to deactivate identical information, and 
 means for deactivating information necessary for image processing suited to a predetermined recognition method when requested to deactivate the information by the other device.    
     
     
         12 . An instruction input method comprising the steps of: 
 performing image processing for an input image of an object; and    switching a mode for performing pointing and other modes on the basis of a result of the image processing.    
     
     
         13 . An instruction input method using a user interface apparatus including a first device for inputting a reflected image and a second device for performing input by image processing of an input image, comprising the steps of: 
 allowing said second device to designate a recognition method of limiting contents of image processing of an input image with respect to said first device; and    allowing said first device to perform predetermined image processing on the basis of the designated recognition method and send back the input image and a result of the image processing to said second device.    
     
     
         14 . A user interface apparatus for performing input by image processing, comprising: 
 means for checking whether an object of image processing is in a proper range within which the image processing is possible; and    means for presenting at least one of predetermined visual information and audio information, if it is determined that the object is outside the proper range.    
     
     
         15 . A user interface apparatus for performing input by image processing, comprising: 
 means for checking whether an object of image processing is in a proper range within which the image processing is possible and, if the object is outside the proper range, checking a direction in which the object deviates from the proper range; and    means for informing a user of a direction in which the object deviates from the proper range by changing a display state of a cursor displayed on a display screen into a predetermined state, if it is determined that the object is outside the proper range.    
     
     
         16 . An apparatus according to    claim 15   , wherein the cursor is made smaller and/or lighter in color if it is determined that the object is farther than the proper range.  
     
     
         17 . An apparatus according to    claim 15   , wherein the cursor is made larger if it is determined that the object is closer than the proper range.  
     
     
         18 . An apparatus according to    claim 15   , wherein a left side of the cursor is deformed if it is determined that the object falls outside the proper range to the left.  
     
     
         19 . An apparatus according to    claim 15   , wherein a right side of the cursor is deformed if it is determined that the object falls outside the proper range to the right.  
     
     
         20 . An apparatus according to    claim 15   , further comprising means for informing a user of a direction in which the object deviates from the proper range by using sound, if it is determined that the object is outside the proper range.  
     
     
         21 . An apparatus according to    claim 16   , further comprising means for informing a user of a direction in which the object deviates from the proper range by using sound, if it is determined that the object is outside the proper range.  
     
     
         22 . An apparatus according to    claim 17   , further comprising means for informing a user of a direction in which the object deviates from the proper range by using sound, if it is determined that the object is outside the proper range.  
     
     
         23 . An apparatus according to    claim 18   , further comprising means for informing a user of a direction in which the object deviates from the proper range by using sound, if it is determined that the object is outside the proper range.  
     
     
         24 . An apparatus according to    claim 19   , further comprising means for informing a user of a direction in which the object deviates from the proper range by using sound, if it is determined that the object is outside the proper range.  
     
     
         25 . A user interface apparatus for performing input by image processing, comprising: 
 means for checking whether an object of image processing is in a proper range within which the image processing is possible and, if the object is outside the proper range, checking a direction in which the object deviates from the proper range; and    means for informing a user of a direction in which the object deviates from the proper range by sound, if it is determined that the object is outside the proper range.    
     
     
         26 . An object operation range presenting method in a user interface apparatus for performing input by image processing of an object, comprising the steps of: 
 checking whether an object of image processing is in a proper range within which the image processing is possible; and    presenting at least one of predetermined visual information and audio information when the object is outside the proper range.    
     
     
         27 . An object operation range presenting method in a user interface apparatus for performing input by image processing of an object, comprising the steps of: 
 checking whether an object of image processing is in a proper range within which the image processing is possible and, if the object is outside the proper range, checking a direction in which the object deviates from the proper range; and    informing a user of a direction in which the object deviates from the proper range by changing a display state of a cursor displayed on a display screen into a predetermined state, if it is determined that the object is outside the proper range.    
     
     
         28 . An object operation range presenting method in a user interface apparatus for performing input by image processing of an object, comprising the steps of: 
 checking whether an object of image processing is in a proper range within which the image processing is possible and, if the object is outside the proper range, checking a direction in which the object deviates from the proper range; and    informing a user of a direction in which the object deviates from the proper range by sound, if it is determined that the object is outside the proper range.    
     
     
         29 . An article of manufacture comprising: 
 a computer usable medium having computer readable program code means embodied therein for causing an instruction to be input, the computer readable program code means in said article of manufacture comprising:    computer readable program code means for causing a computer to perform image processing for an input image of an object; and    computer readable program code means for causing a computer to switch a mode for performing pointing and other modes on the basis of a result of the image processing.    
     
     
         30 . An article of manufacture comprising: 
 a computer usable medium having computer readable program code means embodied therein for causing an instruction to be input using a user interface apparatus including a first device for inputting a reflected image and a second device for performing input by image processing of an input image, the computer readable program means in said article of manufacture comprising:    computer readable program code means for causing a computer to allow said second device to designate a recognition method of limiting contents of image processing of an input image with respect to said first device; and    computer readable program code means for causing a computer to allow said first device to perform predetermined image processing on the basis of the designated recognition method and send back the input image and a result of the image processing to said second device.