System and method for implementing computer-simulated reality interactions between users and publications

Abstract

Methods, systems, and media for enhancing one or more publications by receiving live video captured by a user, the live video comprising video of a publication, the publication comprising copyrighted content; identifying at least one first trigger in the live video, identifying one or more first three-dimensional, interactive media associated with the at least one first trigger and pertaining to the copyrighted content, and presenting to the user the first three-dimensional, interactive media; and identifying at least one second trigger in the first three-dimensional, interactive media, identifying one or more second three-dimensional, interactive media associated with the at least one second trigger and pertaining to the copyrighted content, and presenting to the user the second three-dimensional, interactive media to progressively deepen and enrich the engagement with the copyrighted content of the publication.

1 . A method performed by a computer that is part of an extended reality system, the method comprising:
 implementing one or more source stories, each source story including one or more pieces of content and display media;   detecting a selection of a first source story of the one or more source stories;   identifying at least one trigger that provides one or more display media related to the source story;   causing output of the one or more display media;   identifying one or more extended reality environments pertaining to the source story in a portion of the one or more display media, the one or more extended reality environments including a piece from the source story;   terminating presentation of the one or more display media; and   causing output of the one or more extended reality environments.   
     
     
         2 . The method of  claim 1 , wherein the source story is at least one of a television-based story, a video streaming service based story, or movie based story. 
     
     
         3 . The method of  claim 1 , further comprising:
 dynamically shifting between the one or more display media and the one or more extended reality environments to provide an immersive interactive experience that allows a user to inhabit a role of the character in the source story.   
     
     
         4 . The method of  claim 1 , further comprising:
 dynamically shifting between the one or more display media and the one or more extended reality environments to immerse a user inside the piece from the source story.   
     
     
         5 . The method of  claim 1 , further comprising:
 creating a set of expanded pieces related to the source story, the set of expanded pieces associated with at least one trigger in the one or more extended reality environments;   identifying the at least one trigger in the one or more extended reality environments;   adapting at least one piece included in the set of expanded pieces into a three dimensional (3D) immersive piece; and   presenting, via the visual output device, the 3D immersive piece within the one or more extended reality environments.   
     
     
         6 . The method of  claim 5 , wherein the set of expanded pieces includes a backstory or sidestory associated with a particular character included in the source story. 
     
     
         7 . The method of  claim 5 , further comprising:
 dynamically shifting between the one or more extended reality environments including the piece from the source story and the one or more extended reality environments including the 3D immersive piece to immerse a user in a universe of characters included in the source story.   
     
     
         8 . The method of  claim 1 , wherein the image data is obtained from one or more live camera feeds, and wherein the image data is of a portion of a mirror; and
 the one or more display media includes a morphed representation of a user that shows the user as a particular character in the source story; and   the method further comprising presenting the one or more display media by displaying a simulated reflection of the morphed representation of the user in the portion of the mirror to provide the user with a first-person point of view of the particular character in the source story.   
     
     
         9 . The method of  claim 8 , further comprising transitioning from the one or more live camera feeds to the one or more augmented reality display media including the simulated reflection of the morphed representation of the user to immerse the user in the source story; and
 simulating one or more pieces in the story within the one or more display media with the user playing a role of the particular character in the source story.   
     
     
         10 . The method of  claim 1 , wherein the image data is of a portion of a mirror; and
 the one or more extended reality environments include the portion of the mirror reproduced as a simulated mirror, wherein the simulated mirror displays a morphed representation of a user that shows the user as a particular character in the source story; and   the method further comprising presenting the one or more extended reality environments by displaying a simulated reflection of the simulated mirror including the morphed representation of the user to provide the user with a first-person point of view of the particular character in the source story.   
     
     
         11 . The method of  claim 10 , further comprising:
 transitioning from the one or more live camera feeds to the one or more extended reality environments including the simulated mirror that displays the morphed representation of the user to immerse the user in the source story; and   simulating one or more pieces in the story within the one or more extended reality environments with the user playing a role of the particular character in the source story.   
     
     
         12 . The method of  claim 1 , further comprising:
 aggregating user experience settings that track a user response to stimuli included in the one or more display media and the one or more extended reality environments; and   modifying a presentation of the one or more display media or the one or more extended reality environments based on the user experience settings to fit a psychological condition of a user.   
     
     
         13 . An extended reality system comprising:
 an imaging device;   an output device configured to output augmented reality display media and/or extended reality environments; and   a computer comprising one or more processors and at least one memory including instructions, the instructions configured to cause the one or more processors to perform operations comprising:
 implementing one or more source stories, each source story including one or more pieces of content and display media; 
 detecting a selection of a first source story of the one or more source stories; 
 identifying, at least one trigger that provides one or more virtual display media related to the source story; 
 causing output, at the output device, of the one or more virtual display media; 
 identifying one or more extended reality environments pertaining to the source story in a portion of the one or more virtual display media, the one or more extended reality environments including a piece from the source story; 
 terminating presentation of the one or more virtual display media; and 
 causing output, at the output device, of the one or more extended reality environments. 
   
     
     
         14 . The extended reality system of  claim 13 , wherein the image device is a camera configured to capture a live camera feed including at least a portion of the image data. 
     
     
         15 . The extended reality system of  claim 13 , wherein the source story is at least one of a television based story, a video streaming service based story, or movie based story. 
     
     
         16 . The extended reality system of  claim 13 , wherein the aspect of the source story includes at least one of a character associated with the source story, a piece described in the source story, a location associated with the source story, or an object described in the source story. 
     
     
         17 . The extended reality system of  claim 13 , further comprising identifying, in the image data of the eyes of the user, a user response to the virtual overlay included in the one or more virtual display media; and
 dynamically shifting between the one or more virtual display media and the one or more extended reality environments based on the user response.   
     
     
         18 . A non-transitory computer readable medium including one or more sequences of instructions that, when executed by one or more processors, causes the one or more processors to:
 implement one or more source stories, each source story including one or more pieces of content and display media;   detect a selection of a first source story of the one or more source stories;   identify at least one trigger that provides one or more display media related to the source story;   cause output of the one or more display media;   identify one or more extended reality environments pertaining to the source story in a portion of the one or more display media, the one or more virtual reality environments including a piece from the source story;   terminate presentation of the one or more display media; and   cause output of the one or more virtual reality environments.   
     
     
         19 . The non-transitory computer readable medium of  claim 18 , wherein the source story is at least one of a television-based story, a video streaming service based story, or movie based story. 
     
     
         20 . The non-transitory computer readable medium of  claim 18 , further comprising:
 dynamically shift between the one or more display media and the one or more extended reality environments to provide an immersive interactive experience that allows a user to inhabit a role of the character in the source story.