Remote reproduction method, system, and apparatus, device, medium, and program product

Abstract

This application provides a remote reproduction method, applied to a remote reproduction system, where the system includes a first terminal worn by a first user and a second terminal worn by a second user, and the first user and the second user are located in different geographical locations. According to the method the second terminal obtains an action image of the first user, where the action image of the first user includes a sequence of at least one action formed by a pre-constructed human body model of the first user, and then the second terminal reproduces, for the second user, the action image of the first user at a geographical location in which the second user is located.

What is claimed is: 
     
         1 . A remote reproduction method applied to a remote reproduction system comprising a server, a first terminal worn by a first user, and a second terminal worn by a second user, the first and second users being located in different geographical locations, the method comprising:
 obtaining a multi-angle image of the first user;   performing a reconstruction based on the multi-angle image to obtain a human body model of the user;   obtaining, by the second terminal, an action image of the first user, wherein the action image of the first user comprises a sequence of at least two actions formed by the human body model of the first user; and   reproducing, for the second user by the second terminal, the action image of the first user.   
     
     
         2 . The method according to  claim 1 , wherein the method further comprises:
 obtaining, by the server, location information of a key point of the first user; determining, by the server, a movement track of the key point based on the location information of the key point; obtaining, by the server, the action image based on the movement track and the human body model of the first user that is stored in the server; and sending, by the server, the action image to the second terminal.   
     
     
         3 . The method according to  claim 2 , wherein obtaining the location information of the key point comprises:
 obtaining, by the server, an image of a key part of the first user, and obtaining location information of the key point based on the image of the key part.   
     
     
         4 . The method according to  claim 2 , wherein obtaining the location information of the key point of the first user comprises:
 obtaining, by the server from a pose sensor deployed at a key part of the first user, the location information of the key point corresponding to the key part.   
     
     
         5 . The method according to  claim 1 , further comprising:
 obtaining, by the first terminal, an image of the geographical location in which the second user is located; and   reproducing, by the first terminal, the image of the geographical location in which the second user is located.   
     
     
         6 . The method according to  claim 1 , wherein the first terminal is a virtual reality terminal, and the second terminal is an augmented reality terminal. 
     
     
         7 . The method according to  claim 1 , further comprising:
 obtaining, by the first terminal, an action image of the second user, wherein the action image of the second user comprises a sequence of at least two actions formed by a human body model of the second user, and the human body model of the second user is a pre-constructed model; and   reproducing, for the first user by the first terminal, the action image of the second user.   
     
     
         8 . The method according to  claim 1 , wherein the first terminal and the second terminal are virtual reality terminals. 
     
     
         9 . The method according to  claim 1 , further comprising:
 obtaining, by the first terminal, location information of a key point of the first user;   determining, by the first terminal, a movement track of the key point based on the location information of the key point; and   obtaining, by the first terminal, the action image based on the movement track and the human body model that is stored in the first terminal.   
     
     
         10 . The method according to  claim 1 , wherein the human body model is a three-dimensional human body model, and the action image is a three-dimensional action image. 
     
     
         11 . A remote reproduction system comprising:
 a first terminal worn by a first user, and a second terminal worn by a second user, the first and second users being located in different geographical locations; and   a server configured to obtain a multi-angle image of the first user, and perform a reconstruction based on the multi-angle image to obtain a human body model of the user; wherein   the second terminal is configured to obtain an action image of the first user, and reproduce, for the second user, the action image of the first user, wherein the action image of the first user comprises a sequence of at least two actions formed by the human body model of the first user.   
     
     
         12 . The system according to  claim 11 , wherein the server
 is further configured to obtain location information of a key point of the first user, determine a movement track of the key point based on the location information of the key point, obtain the action image based on the movement track and the human body model of the first user that is stored in the server, and send the action image to the second terminal.   
     
     
         13 . The system according to  claim 12 , wherein the server is additionally configured to:
 obtain an image of a key part of the first user, and obtain location information of the key point based on the image of the key part.   
     
     
         14 . The system according to  claim 12 , wherein the server is additionally configured to:
 obtain, from a pose sensor deployed at a key part of the first user, the location information of the key point corresponding to the key part.   
     
     
         15 . The system according to  claim 11 , wherein the first terminal is further configured to:
 obtain an image of the geographical location in which the second user is located; and   reproduce, for the first user, the image of the geographical location in which the second user is located.   
     
     
         16 . The system according to  claim 11 , wherein the first terminal is a virtual reality terminal, and the second terminal is an augmented reality terminal. 
     
     
         17 . The system according to  claim 11 , wherein the first terminal is further configured to:
 obtain an action image of the second user, wherein the action image of the second user comprises a sequence of at least two actions formed by a human body model of the second user, and the human body model of the second user is a pre-constructed model; and   reproduce, for the first user, the action image of the second user.   
     
     
         18 . The system according to  claim 11 , wherein the first terminal and the second terminal are virtual reality terminals. 
     
     
         19 . The system according to  claim 11 , wherein the first terminal is further configured to:
 obtain location information of a key point of the first user;   determine a movement track of the key point based on the location information of the key point; and   obtain the action image based on the movement track and the human body model of the first user that is stored in the first terminal.   
     
     
         20 . The system according to  claim 11 , wherein the human body model is a three-dimensional human body model, and the action image is a three-dimensional action image. 
     
     
         21 . A server comprising:
 a processor and a memory, the processor being configured to execute instructions stored in the memory to:   obtain a multi-angle image of the first user;   perform a reconstruction based on the multi-angle image to obtain a human body model of the user;   obtain location information of a key point of the first user;   a movement track of the key point of the first user based on the location information of the key point of the first user;   obtaining an action image of the first user based on the movement track and a human body model of the first user, wherein the action image of the first user comprises a sequence of at least two actions formed by the human body model, and the human body model is a pre-constructed model; and   sending the action image to a second terminal, so that the second terminal reproduces, for a second user, the action image at a geographical location in which the second user is located, wherein the first user and the second user are located in different geographical locations.