Systems and methods for generating spectator images of an artificial reality environment

Abstract

A method includes a computing system receiving a first-person image that captures an artificial-reality environment from a first-person perspective of a user of a head-mounted device, wherein the first-person image is rendered based on a pose of the head-mounted device. In response to a determination that a measured rotational movement of the pose exceeds a predetermined threshold, a dampened rotational movement is determined that is less than the measured rotational movement. A spectator perspective is determined wherein the spectator perspective and the first-person perspective are co-located in a three-dimensional space and a rotational orientation of the spectator perspective is determined based on the dampened rotational movement. The computing system generates a spectator image that captures the first-person image from the spectator perspective, and causes the first-person image to be displayed by the head-mounted device and the spectator image to be displayed on a device separate from the head-mounted device.

1 . A method comprising, by a computing system:
 receiving a first-person image that captures an artificial-reality environment from a first-person perspective of a user of a head-mounted device, wherein the first-person image is rendered based on a pose of the head-mounted device;   in response to a determination that a measured rotational movement of the pose about a view axis exceeds a predetermined threshold, determining a dampened rotational movement that is less than the measured rotational movement;   determining a spectator perspective based on the pose of the head-mounted device, wherein (1) the spectator perspective and the first-person perspective are co-located in a three-dimensional space and (2) a rotational orientation of the spectator perspective about the view axis is determined based on the dampened rotational movement;   generating a spectator image that captures the first-person image from the spectator perspective;   causing the first-person image to be displayed by the head-mounted device; and   causing the spectator image to be displayed on a device separate from the head-mounted device.   
     
     
         2 . The method of  claim 1 , wherein the predetermined threshold is based on a second rotational movement of a second pose of the head-mounted device about the view axis, wherein the second pose corresponds to a time previous to when the image was captured. 
     
     
         3 . The method of  claim 1 , wherein the pose of the head-mounted device is used to determine, for the first-person perspective, first rotational orientations about the view axis, a pitch axis, and a yaw axis. 
     
     
         4 . The method of  claim 3 , wherein the spectator perspective comprises second rotational orientations about the pitch axis and the yaw axis that are respectively determined based on the first rotational orientations of the first-person perspective about the pitch axis and the yaw axis. 
     
     
         5 . The method of  claim 1 , wherein the predetermined threshold is zero. 
     
     
         6 . The method of  claim 1 , further comprising adjusting a field of view of the spectator perspective, wherein the adjusted field-of-view of the spectator perspective is less than a field-of-view of the first-person perspective. 
     
     
         7 . The method of  claim 1 , wherein determining the spectator perspective is performed by a mirror application associated with the computing system. 
     
     
         8 . The method of  claim 1 , wherein generating the spectator image is performed by a runtime engine associated with the computing system. 
     
     
         9 . One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
 receive a first-person image that captures an artificial-reality environment from a first-person perspective of a user of a head-mounted device, wherein the first-person image is rendered based on a pose of the head-mounted device;   in response to a determination that a measured rotational movement of the pose about a view axis exceeds a predetermined threshold, determine a dampened rotational movement that is less than the measured rotational movement;   determine a spectator perspective based on the pose of the head-mounted device, wherein (1) the spectator perspective and the first-person perspective are co-located in a three-dimensional space and (2) a rotational orientation of the spectator perspective about the view axis is determined based on the dampened rotational movement;   generate a spectator image that captures the first-person image from the spectator perspective;   cause the first-person image to be displayed by the head-mounted device; and   cause the spectator image to be displayed on a device separate from the head-mounted device.   
     
     
         10 . The media of  claim 9 , wherein the predetermined threshold is based on a second rotational movement of a second pose of the head-mounted device about the view axis, wherein the second pose corresponds to a time previous to when the image was captured. 
     
     
         11 . The media of  claim 9 , wherein the pose of the head-mounted device is used to determine, for the first-person perspective, first rotational orientations about the view axis, a pitch axis, and a yaw axis. 
     
     
         12 . The media of  claim 11 , wherein the spectator perspective comprises second rotational orientations about the pitch axis and the yaw axis that are respectively determined based on the first rotational orientations of the first-person perspective about the pitch axis and the yaw axis. 
     
     
         13 . The media of  claim 9 , wherein the predetermined threshold is zero. 
     
     
         14 . The media of  claim 9 , wherein the software is further operable when executed to adjust a field of view of the spectator perspective, wherein the adjusted field-of-view of the spectator perspective is less than a field-of-view of the first-person perspective. 
     
     
         15 . A system comprising:
 one or more processors; and   one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:   receive a first-person image that captures an artificial-reality environment from a first-person perspective of a user of a head-mounted device, wherein the first-person image is rendered based on a pose of the head-mounted device;   in response to a determination that a measured rotational movement of the pose about a view axis exceeds a predetermined threshold, determine a dampened rotational movement that is less than the measured rotational movement;   determine a spectator perspective based on the pose of the head-mounted device, wherein (1) the spectator perspective and the first-person perspective are co-located in a three-dimensional space and (2) a rotational orientation of the spectator perspective about the view axis is determined based on the dampened rotational movement;   generate a spectator image that captures the first-person image from the spectator perspective;   cause the first-person image to be displayed by the head-mounted device; and   cause the spectator image to be displayed on a device separate from the head-mounted device.   
     
     
         16 . The system of  claim 15 , wherein the predetermined threshold is based on a second rotational movement of a second pose of the head-mounted device about the view axis, wherein the second pose corresponds to a time previous to when the image was captured. 
     
     
         17 . The system of  claim 15 , wherein the pose of the head-mounted device is used to determine, for the first-person perspective, first rotational orientations about the view axis, a pitch axis, and a yaw axis. 
     
     
         18 . The system of  claim 17 , wherein the spectator perspective comprises second rotational orientations about the pitch axis and the yaw axis that are respectively determined based on the first rotational orientations of the first-person perspective about the pitch axis and the yaw axis. 
     
     
         19 . The system of  claim 15 , wherein the predetermined threshold is zero. 
     
     
         20 . The system of  claim 15 , wherein the processors are further operable when executing the instructions to adjust a field of view of the spectator perspective, wherein the adjusted field-of-view of the spectator perspective is less than a field-of-view of the first-person perspective.