Information processing method, information processing terminal, and computer-readable non-transitory storage medium storing program

Abstract

In order to allow a user to easily check detailed information on an object put in front of the user, such as information on the inside of the object without remaining in the same place, provided is an information processing method performed by an information processing terminal includes acquiring an image captured by an imaging unit and positional information representing a position of the information processing terminal; transmitting the image and the positional information to an information processing apparatus; receiving, from the information processing apparatus, data of a three-dimensional model of an object specified using the image and the positional information; estimating a sight-line direction of a user who uses the information processing terminal on the basis of sensor information measured by an acceleration sensor and a magnetic sensor; specifying display data of the three-dimensional model using the sight-line direction; and outputting the display data.

What is claimed is: 
     
         1 . An information processing method performed by an information processing terminal, comprising:
 acquiring an image captured by an imaging unit and positional information representing a position of the information processing terminal;   transmuting the image and the positional information to an information processing apparatus;   receiving, from the information processing apparatus, data of a three-dimensional model of an object specified using the image and the positional information;   estimating a sight-line direction of a user who uses the information processing terminal on the basis of sensor information measured by an acceleration sensor and a magnetic sensor;   specifying display data of the three-dimensional model using the sight-line direction; and   outputting the display data.   
     
     
         2 . The information processing method according to  claim 1 , wherein
 the information processing terminal further executes   detecting a first operation set in advance, and   transmitting comprises   transmitting the image and the positional information to the information processing apparatus according to the first operation.   
     
     
         8 . The information processing method according to  claim 1 , wherein
 the information processing terminal further executes   detecting a second operation set in advance and   updating a display magnification of the display data or a view-point position corresponding to the display data according to the second operation.   
     
     
         4 . The information processing method according to claim  3 , wherein
 the information processing terminal further executes   changing the information amount of object information about the object and outputting the object information according to the second operation.   
     
     
         5 . The information processing method according to  claim 4 , wherein
 changing the information amount of the object information and outputting the object information comprise   increasing the information amount of the object information and outputting the object information when display data is output in a direction in which the display data approaches the object.   
     
     
         6 . The information processing method according to claim  3 , wherein
 the information processing terminal further executes:   detecting a third operation set in advance in a state in which the view-point position corresponding to the display data has been updated according to the second operation; and   switching any direction inside the object to display data that can be is outputtable according to the third operation.   
     
     
         7 . The information processing method according to  claim 1 , wherein
 the information processing terminal further executes:   receiving control information transmitted from an external system which manages the control information corresponding to each position of the inside of the object through the information processing apparatus; and   outputting the control information in association with each position of the inside of the object.   
     
     
         8 . The information processing method according to  claim 1 , wherein,
 when the object is a store, the three-dimensional model includes products arranged on product shelves.   
     
     
         9 . The information processing method according to  claim 1 , wherein
 outputting the display data comprises specifying a position of an object in an image captured by the imaging unit and outputting the display data at the specified position.   
     
     
         10 . The information processing method according to  claim 1 , wherein
 the information processing terminal further executes acquiring removal object information representing an object that is a removal target, and   wherein specifying comprises   specifying display data of the three-dimensional model positioned in a background of the object that is the removal target on the basis of the removal object information.   
     
     
         11 . The information processing method according to  claim 10 , wherein
 outputting comprises   replacing the display data with predetermined data and outputting the predetermined data when the removal object information is predetermined object information,   
     
     
         12 . A computer-readable non-transitory storage medium storing a program causing an information processing terminal to execute:
 acquiring an image captured by an imaging unit and positional information representing a position of the information processing terminal;   transmitting the image and the positional information to an information processing apparatus;   receiving, from the information processing apparatus, data of a three-dimensional model of an object specified using the image and the positional information;   estimating a sight-line direction of a user who uses the information processing terminal on the basis of sensor information measured by an acceleration sensor and a magnetic sensor;   specifying display data of the three-dimensional model using the sight-line direction; and   outputting the display data.   
     
     
         13 . An information processing terminal, comprising:
 an imaging unit;   an acquisition unit which acquires an image captured by the imaging unit and positional information representing a position of the information processing terminal;   a transmission unit which transmits the image and the positional information to an information processing apparatus;   a reception unit which receives, from the information processing apparatus, data of a three-dimensional model of an object specified using the image and the positional information;   an estimation unit which estimates a sight-line direction of a user who uses the information processing terminal on the basis of sensor information measured by an acceleration sensor and a magnetic sensor;   a specifying unit which specifies display data of the three-dimensional model using the sight-line direction; and   an output unit which outputs the display data.