Augmented reality processing system, information display device, and augmented reality processing method

Abstract

An augmented reality processing system transmits information regarding an augmented reality object(ARO) arranged in a virtual space on the basis of a world-coordinate-system from an information display device to an information processing device. The information processing device arranges a provisional ARO on the basis of the received information about the ARO in a work space on the basis of a terminal-coordinate-system with the information processing device as a reference and displays the provisional ARO on a display of the information processing device, and accepts an edit operation for the displayed provisional ARO and transmits the same to the information display device. The information display device reflects the content of the edit operation in the ARO arranged in the virtual space on the basis of the world-coordinate-system and displays the ARO, on the basis of the received information regarding the edit operation for the provisional ARO.

The invention claimed is: 
     
         1 . An augmented reality processing system comprising:
 an information display device which displays an augmented reality object; and   an information processing device which is performed an edit operation of the augmented reality object,   wherein the information display device includes a first display, a first communication device which transmits information to the information processing device and receives information from it, and a first processor,   wherein the information processing device includes a second display, a second communication device which transmits information to the information display device and receives information from it, and a second processor,   wherein the first processor transmits information about the augmented reality object arranged in a virtual space on the basis of a world coordinate system with a real space as a reference to the information processing device through the first communication device,   wherein the second processor:   arranges a provisional augmented reality object on the basis of the information about the augmented reality object in a work space on the basis of a terminal coordinate system with the information processing device as a reference, based on first calculated position information calculated from position information of the information display device in a real space and position information of the augmented reality object in the virtual space on the basis of the world coordinate system,   displays the provisional augmented reality object on the second display,   accepts an edit operation for the displayed provisional augmented reality object, and   transmits information about the edit operation for the provisional augmented reality object to the information display device through the second communication device, and   wherein the first processor reflects the content of the edit operation in the augmented reality object arranged in the virtual space on the basis of the world coordinate system, on the basis of the information about the edit operation for the provisional augmented reality object.   
     
     
         2 . The augmented reality processing system according to  claim 1 , wherein, based on identification information capable of identifying the augmented reality object, the first processor reflects the content of the edit operation in the augmented reality object arranged in the virtual space on the basis of the world coordinate system. 
     
     
         3 . The augmented reality processing system according to  claim 1 , wherein the information display device is a head mounted display. 
     
     
         4 . The augmented reality processing system according to  claim 3 , wherein the information processing device is a tablet terminal. 
     
     
         5 . The augmented reality processing system according to  claim 1 , wherein the provisional augmented reality object is an object in which the augmented reality object is displayed in an editable state and is similar to the augmented reality object before accepting the edit operation. 
     
     
         6 . The augmented reality processing system according to  claim 1 , wherein the edit operation is a change of a shape or a display color of the provisional augmented reality object. 
     
     
         7 . An augmented reality processing system comprising:
 an information display device which displays an augmented reality object; and   an information processing device which is performed an edit operation of the augmented reality object,   wherein the information display device includes a first display, a first communication device which transmits information to the information processing device and receives information from it, and a first processor,   wherein the information processing device includes a second display, a second communication device which transmits information to the information display device and receives information from it, and a second processor,   wherein the first processor transmits information about the augmented reality object arranged in a virtual space on the basis of a world coordinate system with a real space as a reference, to the information processing device through the first communication device,   wherein the second processor:   arranges a provisional augmented reality object on the basis of the information about the augmented reality object received through the second communication device, in a work space on the basis of a terminal coordinate system with the information processing device as a reference, based on first calculated position information calculated from the position information of the information display device in the real space and the position information of the augmented reality object in the virtual space on the basis of the world coordinate system,   displays the provisional augmented reality object on the second display,   accepts an edit operation of adding a provisional added augmented reality object to the displayed provisional augmented reality object, and   transmits information indicating a positional relationship between the provisional augmented reality object and the provisional added augmented reality object in the work space, and information about the provisional added augmented reality object to the information display device through the second communication device, and   wherein the first processor:   arranges, in the virtual space on the basis of the world coordinate system, an added augmented reality object on the basis of the information about the provisional added augmented reality object, on the basis of the information indicating the positional relationship between the provisional augmented reality object and the provisional added augmented reality object in the work space, and the position information of the augmented reality object in the virtual space on the basis of the world coordinate system, and   displays the added augmented reality object on the first display.   
     
     
         8 . The augmented reality processing system according to  claim 7 , wherein the information display device is a head mounted display. 
     
     
         9 . The augmented reality processing system according to  claim 8 , wherein the information processing device is a tablet terminal. 
     
     
         10 . The augmented reality processing system according to  claim 7 , wherein the provisional augmented reality object is an object in which the augmented reality object is displayed in an editable state and is similar to the augmented reality object before accepting the edit operation. 
     
     
         11 . The augmented reality processing system according to  claim 7 , wherein the provisional added augmented reality object is an object comprising of a comment associated with the provisional augmented reality object. 
     
     
         12 . An augmented reality processing system comprising:
 an information display device which displays an augmented reality object; and   an information processing device which is performed an edit operation of the augmented reality object,   wherein the information display device includes a first display, a first communication device which transmits information to the information processing device and receives information from it, a distance measuring sensor which measures a distance from the information display device to a real object existing in a real space, and a first processor,   wherein the information processing device includes a second display, a second communication device which transmits information to the information display device and receives information from it, and a second processor,   wherein the first processor:   calculates position information of a reality object comprised of an image of the real object in the virtual space on the basis of the world coordinate system, based on the distance to the real object measured by the distance measuring sensor and the position information of the information display device in the real space, and   transmits information about the reality object to the information processing device through the first communication device,   wherein the second processor:   arranges a provisional augmented reality object on the basis of the information about the reality object received through the second communication device, in a work space on the basis of a terminal coordinate system with the information processing device as a reference, based on first calculated position information calculated from the position information of the information display device in the real space and the position information of the reality object in the virtual space on the basis of the world coordinate system,   displays the provisional augmented reality object on the second display,   accepts an edit operation of adding a provisional added augmented reality object to the displayed provisional augmented reality object, and   transmits information indicating a positional relationship between the provisional augmented reality object and the provisional added augmented reality object in the work space, and information about the provisional added augmented reality object to the information display device through the second communication device, and   wherein the first processor:   arranges, in the virtual space on the basis of the world coordinate system, an added augmented reality object on the basis of the information about the provisional added augmented reality object, on the basis of the information indicating the positional relationship between the provisional augmented reality object and the provisional added augmented reality object in the work space, and the position information of the reality object in the virtual space on the basis of the world coordinate system, and   displays the added augmented reality object on the first display.   
     
     
         13 . The augmented reality processing system according to  claim 12 , wherein the information display device is a head mounted display. 
     
     
         14 . The augmented reality processing system according to  claim 13 , wherein the information processing device is a tablet terminal. 
     
     
         15 . The augmented reality processing system according to  claim 12 , wherein the provisional augmented reality object is an object in which the augmented reality object is displayed in an editable state and is similar to the augmented reality object before accepting the edit operation. 
     
     
         16 . The augmented reality processing system according to  claim 12 , wherein the provisional added augmented reality object is an object comprising of a comment associated with the provisional augmented reality object.