Image experiencing system and information processing method

Abstract

The invention intends to increase the feeling of reality in a board game in addition to the interestingness of the game itself and to facilitate understanding of the proceeding situation of the game. The invention provides an image experiencing system for a game which proceeds by placing items on a game board, comprising player position/attitude determining unit for determining the position/direction information of the view of the player, a generation unit for generating computer graphics based on the items on the game board, according to the position/attitude information of the view of the player, and a head-mounted display for displaying the generated computer graphics in superposition with the image of the real field.

What is claimed is:  
     
         1 . An image experiencing system for a game which proceeds by placing an item on a game board, the system comprising: 
 player position and attitude determining means for determining the position and attitude information of a view point of a player;    generation means for generating computer graphics corresponding to the item on the game board, based on the position and attitude information of the view point of said player; and    a head mounted display for displaying said generated computer graphics in superposition with an image of the real world.    
     
     
         2 . A system according to  claim 1 , wherein the position and attitude information of said player is information indicating a relative position of the view point of said player relative to said game board.  
     
     
         3 . A system according to  claim 1 , further comprising: 
 measurement means for measuring attitude information of said player;    wherein said player position and attitude determining means determines the position and attitude information of the view point of said player from the attitude information and pre-calibrated position information of said player.    
     
     
         4 . A system according to  claim 1 , further comprising: 
 a camera fixed to said head mounted display;    wherein said player position and attitude determining means analyzes the image of said camera and executes image recognition thereon, thereby obtaining the position and attitude information of the view point of said player.    
     
     
         5 . A system according to  claim 1 , further comprising: 
 a position and attitude sensor for measuring the position and attitude of the player; and    a camera fixed to said head mounted display;    wherein said player position and attitude determining means includes a first position and attitude determining unit for determining the position and attitude information of the view point of the player from the output of said position and attitude sensor, and a second position and attitude determining unit for determining the position and attitude information of the view point of the player from an image taken by said camera, and the position and attitude information of the view point of said player is determined according to the reliability of the respective output values of said first and second position and attitude determining units.    
     
     
         6 . A system according to  claim 1 , further comprising: 
 an attitude sensor for measuring the attitude of the player; and    a camera fixed to said head mounted display;    wherein said player position and attitude determining means includes a first position and attitude determining unit for determining the position and attitude information of the view point of the player from the output of said attitude sensor, and a second position and attitude determining unit for determining the position and attitude information of the view point of the player from an image taken by said camera, and the position and attitude information of the view point of said player is determined according to the reliability of the respective output values of said first and second position and attitude determining units.    
     
     
         7 . A system according to  claim 5  or  6 , wherein a correction value is determined from the output value of said first or second position and attitude determining unit, and said correction value is used for correcting the output value of said first or second position and attitude determining unit.  
     
     
         8 . A system according to  claim 1 , further comprising item operation recognition means for recognizing a change in the item on said game board.  
     
     
         9 . A system according to  claim 8 , wherein said item operation recognition means recognizes a special mark identifier attached to the item.  
     
     
         10 . A system according to  claim 9 , wherein a visible or invisible bar code is used as the special mark identifier.  
     
     
         11 . A system according to  claim 9 , wherein a RFID transponder is used as the special mark identifier.  
     
     
         12 . A system according to  claim 8 , wherein said item operation recognition means recognizes a shape of the item and/or a pattern on the item by image recognition.  
     
     
         13 . A system according to  claim 12 , wherein an image taken by a camera fixed to said head mounted display is used.  
     
     
         14 . A system according to  claim 12 , wherein said item operation recognition means recognizes a placement of an item in a specified position of a specified camera, thereby recognizing an item to be changed.  
     
     
         15 . A system according to  claim 14 , wherein, in placing an item at said specified position of said specified camera, a guide facilitating the placement of the item is prepared by computer graphics and is displayed in the head mounted display of said player.  
     
     
         16 . A system according to  claim 1 , wherein plural players play on a single game board, and the result of complex operations by the plural players is displayed in each head mounted display in the view point of each player.  
     
     
         17 . An information processing method for a game which proceeds by placing an item on a game board, the method comprising steps of: 
 entering position and attitude information of a view point of a player;    generating computer graphics corresponding to the item on the game board, based on the position and attitude information of the view point of said player; and    displaying said generated computer graphics in superposition with an image of the real world in a head mounted display worn by the player.    
     
     
         18 . A method according to  claim 17 , wherein the position and attitude information of said player is information indicating a relative position of the view point of said player relative to said game board.  
     
     
         19 . A program for controlling an information processing apparatus thereby executing the information processing according to  claim 17 .  
     
     
         20 . A recording medium storing the program according to  claim 19 .  
     
     
         21 . An image experiencing system for a game which proceeds by placing an item on a game board bearing plural marks, the system comprising: 
 a position and attitude grasp unit for recognizing the kind of plural items placed on said game board and the position of said items;    game management means for managing the proceeding of the game, based on the kinds of said plural items and the positions thereof; and    generation means for generating computer graphics of a game scene corresponding to the kinds of the items of said plural items and the positions thereof.    
     
     
         22 . A system according to  claim 21 , wherein: 
 said game is a battle type game;    said system further comprises determination means for determining the characteristics of a character of an own side based on the combination of the own side; and    said generation means generates said computer graphics based said determined characteristics of the character of the own side.    
     
     
         23 . A system according to  claim 21 , wherein said game management means manages the proceeding of the game by a combination of the characteristics of the characters of the own side and the opponent side.  
     
     
         24 . A system according to  claim 21 , wherein said game board has a three-dimensional structure, and said computer graphics are displayed in the head mounted display worn by the player, based on a model of the three-dimensional structure of said game board.  
     
     
         25 . An information processing method for a game which proceeds by placing an item on a game board bearing plural marks, the method comprising steps of: 
 entering an image from an image pickup unit in a head mounted display worn by a player;    detecting a mark in said image thereby determining the position and attitude of a view point of said player on said game board;    identifying the item on said game board and generating computer graphics indicating a game scene based on the result of said identification; and    displaying said computer graphics, based on the position and attitude of said view point in said head mounted display.    
     
     
         26 . A method according to  claim 25 , further comprising a step of: 
 entering position and attitude information of the player from a three-dimensional position and attitude measuring unit for measuring the position and attitude of said player;    wherein the position and attitude of said view point is obtained from said position and attitude information and from said detected mark.    
     
     
         27 . A method according to  claim 25 , wherein the item on said game board is identified from an image from an image pickup unit for taking the image on said game board.  
     
     
         28 . A method according to  claim 25 , further comprising a step of recognizing an instruction from the player for advancing the game.  
     
     
         29 . A program for realizing an information processing method for a game which proceeds by placing an item on a game board bearing plural marks, the method comprising steps of: 
 entering an image from an image pickup unit in a head mounted display worn by a player;    detecting a mark in said image thereby determining the position and attitude of a view point of said player on said game board;    identifying the item on said game board and generating computer graphics indicating a game scene based on the result of said identification; and    displaying said computer graphics, based on the position and attitude of said view point in said head mounted display.