Control device

Abstract

A control device according to the present invention is a control device configured to control an optical see-through type display apparatus, the control device including one or more processors and/or circuitry configured to execute acquisition processing of acquiring line-of-sight information of a user, a detection processing of detecting a real object that the user is viewing on a basis of the line-of-sight information, and a control processing of performing control to adjust an imaging distance of a virtual object according to a distance between the display apparatus and the detected real object.

1 . A control device configured to control an optical see-through type display apparatus, the control device comprising
 one or more processors and memory configured to:
 execute acquisition processing of acquiring line-of-sight information of a user; 
 a detection processing of detecting a real object that the user is viewing on a basis of the line-of-sight information; and 
 a control processing of performing control to adjust an imaging distance of a virtual object according to a distance between the display apparatus and the detected real object. 
   
     
     
         2 . The control device according to  claim 1 , wherein
 in the control processing, control is performed to adjust the imaging distance to a distance substantially coinciding with a distance from the display apparatus to the detected real object.   
     
     
         3 . The control device according to  claim 1 , wherein
 in the control processing, control is performed to adjust the imaging distance in a case where the detected real object is a specific real object.   
     
     
         4 . The control device according to  claim 3 , wherein
 the specific real object includes a real object having a display or an operation member.   
     
     
         5 . The control device according to  claim 3 , wherein
 the one or more processors and memory further executes second acquisition processing of acquiring information on the specific real object, and   in the control processing, the display apparatus is controlled to display a virtual object based on the information acquired by the second acquisition processing.   
     
     
         6 . The control device according to  claim 5 , wherein
 the specific real object includes a specific external device having a communication function, and   in the second acquisition processing, the information is acquired by performing bidirectional communication with the detected real object in a case where the detected real object is the specific external device.   
     
     
         7 . The control device according to  claim 1 , wherein
 the one or more processors and memory further executes environment detection processing of detecting an environment around the user, wherein   in the control processing, the virtual object is determined according to the environment detected by the environment detection processing.   
     
     
         8 . The control device according to  claim 1 , wherein
 in the control processing, control is performed to adjust an imaging distance such that a blur amount of the virtual object becomes smaller than a predetermined value when the user is viewing the real object.   
     
     
         9 . The control device according to  claim 1 , wherein
 the one or more processors and memory further executes display control processing of performing control to change a display position of the virtual object according to the line-of-sight information.   
     
     
         10 . The control device according to  claim 1 , wherein
 the one or more processors and memory further executes:
 determination processing of determining a degree of relevance between each of a plurality of displayable virtual objects and the real object detected by the detection processing; and 
 display control processing of performing control so as to display a virtual object whose degree of relevance is higher than a threshold. 
   
     
     
         11 . The control device according to  claim 10 , wherein
 in the display control processing, control is performed to display the plurality of virtual objects, and   in the control processing, control is performed to adjust an imaging distance of a virtual object whose degree of relevance is higher than the threshold according to a distance between the display apparatus and the detected real object.   
     
     
         12 . The control device according to  claim 10 , wherein
 a default imaging distance is predetermined for each of the plurality of virtual objects, and   in the determination processing, a higher value as a default imaging distance of the virtual object is closer to a distance from the display apparatus to the detected real object is determined as the degree of relevance of the virtual object.   
     
     
         13 . The control device according to  claim 10 , wherein
 in the control processing, control is performed to adjust an imaging distance of a virtual object such that the virtual object whose degree of relevance is lower than a second threshold equal to or less than the threshold is displayed with reduced saliency.   
     
     
         14 . The control device according to  claim 13 , wherein
 in the display control processing, a virtual object whose degree of relevance is lower than the second threshold is hidden.   
     
     
         15 . The control device according to  claim 10 , wherein
 in the control processing, control is performed to display the plurality of virtual objects,   the one or more processors and memory further executes second detection processing of detecting a virtual object to which the user repeatedly moves the line of sight from the detected real object on a basis of the line-of-sight information, and   in the control processing, control is performed to adjust an imaging distance of a virtual object detected by the second detection processing according to a distance between the display apparatus and the detected real object.   
     
     
         16 . The control device according to  claim 1 , wherein
 the display apparatus includes an adjustment lens for adjusting the imaging distance,   in the control processing, control is performed to change the imaging distance by changing a position of the adjustment lens in the display apparatus, and   a position of the adjustment lens in the display apparatus is different between a case where the user is viewing a first real object and a case where the user is viewing a second real object.   
     
     
         17 . A control method for controlling an optical see-through type display apparatus, the control method comprising:
 acquiring line-of-sight information of a user;   detecting a real object that the user is viewing on a basis of the line-of-sight information; and   performing control to adjust an imaging distance of a virtual object according to a distance between the display apparatus and the detected real object.   
     
     
         18 . A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute a control method for controlling an optical see-through type display apparatus, the control method comprising:
 acquiring line-of-sight information of a user;   detecting a real object that the user is viewing on a basis of the line-of-sight information; and   performing control to adjust an imaging distance of a virtual object according to a distance between the display apparatus and the detected real object.