Input system and input method for setting instruction target area including reference position of instruction device

Abstract

An input system includes an instruction device; a detection device which, in operation, detects an instruction position of the instruction device; a display device provided separately from the detection device, wherein the display device, in operation, displays an image of a virtual reality space; a line-of-sight sensor which, in operation, detects a gaze position of a user within the virtual reality space; and a processor that, in operation: sets an instruction target area within the virtual reality space, based on the gaze position detected by the line-of-sight sensor at a time at which a predetermined operation by the instruction device is received, wherein the instruction target area includes a reference position of the instruction device, and controls the display device to display on the virtual reality space a result of drawing on the detection device by the instruction device relative to the instruction target area.

What is claimed is: 
     
         1 . An input system comprising:
 an instruction device;   a detection device which, in operation, detects an instruction position of the instruction device;   a display device provided separately from the detection device, wherein the display device, in operation, displays an image of a virtual reality space;   a line-of-sight sensor which, in operation, detects a gaze position of a user within the virtual reality space; and   a processor that, in operation:
 sets an instruction target area within the virtual reality space, based on the gaze position detected by the line-of-sight sensor at a time at which a predetermined operation by the instruction device is received, wherein the instruction target area includes a reference position of the instruction device, and 
 controls the display device to display on the virtual reality space a result of drawing on the detection device by the instruction device relative to the instruction target area. 
   
     
     
         2 . The input system according to  claim 1 , wherein:
 the instruction target area is settable for each of a plurality of objects in the virtual reality space or for each of a plurality of object surfaces in the virtual reality space.   
     
     
         3 . The input system according to  claim 1 , wherein,
 in response to determining that a line-of-sight position detected by the line-of-sight sensor at a first time and a line-of-sight position detected by the line-of-sight sensor at a second time are on a same object or on a same object surface, the processor sets the instruction target area based on the line-of-sight position detected by the line-of-sight sensor at the second time that is same as the instruction target area set based on the line-of-sight position detected by the line-of-sight sensor at the first time.   
     
     
         4 . The input system according to  claim 1 , wherein,
 in response to determining that a line-of-sight position detected by the line-of-sight sensor at a first time and a line-of-sight position detected by the line-of-sight sensor at a second time are on different objects or on different object surfaces, the processor sets the instruction target area based on the line-of-sight position detected by the line-of-sight sensor at the second time that is different from the instruction target area set based on the line-of-sight position detected by the line-of-sight sensor at the first time.   
     
     
         5 . The input system according to  claim 1 , wherein,
 when the instruction target area is set, the processor displays an image of the virtual reality space after switching a point of view so that the instruction target area comes to a front of a display area displayed the display device.   
     
     
         6 . The input system according to  claim 1 , wherein:
 the instruction device or the detection device sequentially outputs an amount of movement of the instruction device in response to reception of the predetermined operation, and   the processor, in operation, converts the amount of movement of the instruction device according to a predetermined conversion rule and sequentially adds the amount of movement obtained after conversion to a coordinate value of the reference position to calculate the instruction position in the virtual reality space.   
     
     
         7 . The input system according to  claim 1 , wherein:
 the instruction device and the detection device, in operation, communicate with each other,   the instruction device, in operation, measures a first state quantity indicating a first state of a first apparatus including the instruction device, or time variation of the first state,   the detection device, in operation, measures a second state quantity indicating a second state of a second apparatus including the detection device, or time variation of the second state, and   the instruction device, in operation, receives, from the detection device, second data including the second state quantity and transmits, to the processor, first data in which the first state quantity and the second state quantity are integrated.   
     
     
         8 . The input system according to  claim 7 , wherein:
 the instruction device, in operation, integrates the first state quantity and the second state quantity by calculating a relative state quantity by subtracting the second state quantity from the first state quantity or linkage of the first state quantity and the second state quantity.   
     
     
         9 . The input system according to  claim 8 , wherein:
 the instruction device, in operation, receives the second data without communicating with the processor, and   the instruction device, in operation, receives the second data and transmits the first data using different of communication means.   
     
     
         10 . The input system according to  claim 9 , wherein:
 the instruction device receives the second data by relay communication.   
     
     
         11 . The input system according to  claim 10 , wherein:
 a frequency at which the instruction device receives the second data is lower than a frequency at which the instruction device transmits the first data.