Information processing apparatus for controlling image display, information processing system, storage medium storing information processing program, and information processing method

Abstract

An information processing apparatus, includes a processor, and a memory storing a program which, when executed by the processor, causes the information processing apparatus to perform image acquisition processing for acquiring a captured image, and perform display control processing for displaying, on a display, a composite image obtained by the captured image and a virtual screen being composited, wherein, in the display control processing, control is performed so that in a case where a mobile terminal is in a portrait state when viewed from a user, the virtual screen is displayed in the portrait state on the display, and that in a case where the mobile terminal is in a landscape state when viewed from the user, the virtual screen is displayed in the landscape state on the display.

What is claimed is: 
     
         1 . An information processing apparatus, comprising:
 a processor; and   a memory storing a program which, when executed by the processor, causes the information processing apparatus to:   perform image acquisition processing for acquiring a captured image; and   perform display control processing for displaying, on a display, a composite image obtained by the captured image and a virtual screen being composited,   wherein, in the display control processing, control is performed so that in a case where a mobile terminal is in a portrait state when viewed from a user, the virtual screen is displayed in the portrait state on the display, and that in a case where the mobile terminal is in a landscape state when viewed from the user, the virtual screen is displayed in the landscape state on the display.   
     
     
         2 . The information processing apparatus according to  claim 1 ,
 wherein the program, when executed by the processor, further causes the information processing apparatus to execute information acquisition processing for acquiring information about the virtual screen from the mobile terminal, and   wherein, in the display control processing, control is performed so that the captured image is composited with the virtual screen based on the information and the composite image is displayed on the display.   
     
     
         3 . The information processing apparatus according to  claim 2 ,
 wherein, in the display control processing, in a case where content to be displayed on the virtual screen is content of a portrait screen, the virtual screen is displayed in the portrait state, and in a case where the content to be displayed on the virtual screen is content of a landscape screen, the virtual screen is displayed in the landscape state.   
     
     
         4 . The information processing apparatus according to  claim 3 ,
 wherein, in the display control processing, in a case where the content to be displayed on the virtual screen is content of the portrait screen, the virtual screen is displayed in the portrait state even if the mobile terminal is in the landscape state when viewed from the user, and in a case where the content to be displayed on the virtual screen is content of the landscape screen, the virtual screen is displayed in the landscape state even if the mobile terminal is in the portrait state when viewed from the user.   
     
     
         5 . The information processing apparatus according to  claim 3 ,
 wherein, in the information acquisition processing, in a case where the content is content of the portrait screen, information about the portrait screen is acquired from the mobile terminal, and in a case where the content is content of the landscape screen, information about the landscape screen is acquired from the mobile terminal.   
     
     
         6 . The information processing apparatus according to  claim 2 , wherein, in the display control processing, in a case where an orientation of a screen of the mobile terminal is fixed, the virtual screen is displayed in the fixed orientation even if an orientation of the mobile terminal is changed. 
     
     
         7 . The information processing apparatus according to  claim 1 , wherein, in the display control processing, control is performed to display, on the display, the virtual screen in the portrait or landscape state based on an orientation of the mobile terminal and an orientation of the display. 
     
     
         8 . The information processing apparatus according to  claim 7 ,
 wherein, in the display control processing, control is performed so that in a case where the mobile terminal is horizontally placed in the portrait state when viewed from the user, the virtual screen is displayed in the portrait state on the display, and that in a case where the mobile terminal is horizontally placed in the landscape state when viewed from the user, the virtual screen is displayed in the landscape state on the display.   
     
     
         9 . The information processing apparatus according to  claim 1 , wherein the program, when executed by the processor, further causes the information processing apparatus to execute determination processing for determining a front direction of the display based on an orientation of the display at a predetermined point in time,
 wherein, in the display control processing, control is performed so that in a case where the mobile terminal is in the portrait state with respect to the front direction of the display at the predetermined point in time, the virtual screen is displayed in the portrait state on the display even with a change in the orientation of the display after the predetermined point in time, and that in a case where the mobile terminal is in the landscape state with respect to the front direction of the display at the predetermined point in time, the virtual screen is displayed in the landscape state on the display.   
     
     
         10 . The information processing apparatus according to  claim 9 , wherein, in the determination processing, in a case where the orientation of the display is changed to an extend that exceeds a threshold value from the orientation at the predetermined point in time, control is performed to update the front direction of the display. 
     
     
         11 . The information processing apparatus according to  claim 1 , wherein, in the display control processing, in a case where a distance between the mobile terminal and the user is shorter than a predetermined distance, the virtual screen is displayed. 
     
     
         12 . The information processing apparatus according to  claim 1 , wherein, in the display control processing, in a case where a distance between the mobile terminal and the user exceeds a predetermined distance, display of the virtual screen is terminated. 
     
     
         13 . The information processing apparatus according to  claim 1 , wherein, in the display control processing, the virtual screen is displayed so that the virtual screen follows the display according to an orientation of the display. 
     
     
         14 . The information processing apparatus according to  claim 1 , wherein, in the display control processing, the virtual screen is displayed so that the virtual screen stands still in a mixed reality space even if an orientation of the display is changed. 
     
     
         15 . A control method of an information processing apparatus, comprising:
 acquiring a captured image; and   performing control to display, on a display, a composite image obtained by the captured image and a virtual screen being composited,   wherein the control is performed so that in a case where a mobile terminal is in a portrait state when viewed from a user, the virtual screen is displayed in the portrait state on the display, and that in a case where the mobile terminal is in a landscape state when viewed from the user, the virtual screen is displayed in the landscape state on the display.   
     
     
         16 . A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute a control method according to  claim 15 . 
     
     
         17 . An information processing system, comprising:
 a mobile terminal;   a display apparatus;   an image acquisition apparatus configured to acquire a captured image; and   a display control apparatus configured to perform control to display, on the display apparatus, a composite image obtained by the captured image and a virtual screen being composited,   wherein the display control apparatus performs the control so that in a case where the mobile terminal is in a portrait state when viewed from a user, the virtual screen is displayed in the portrait state on the display apparatus, and that in a case where the mobile terminal is in a landscape state when viewed from the user, the virtual screen is displayed in the landscape state on the display apparatus.