Locking and showing moving objects in virtual reality

Abstract

According to one embodiment, a method, computer system, and computer program product for physical object tracking in virtual reality is provided. The present invention may include receiving input from a user identifying a specific physical object during a virtual reality session in a virtual reality environment; identifying the specific physical object in the physical proximity of the user; tracking the location of the specific physical object relative to the user; and responsive to receiving a command from the user, displaying the specific physical object to the user through a portal in the virtual reality environment.

What is claimed is: 
     
         1 . A processor-implemented method for physical object tracking in virtual reality, the method comprising:
 receiving input from a user identifying a specific physical object during a virtual reality session in a virtual reality environment;   identifying the specific physical object in a physical proximity of the user;   tracking the location of the specific physical object relative to the user; and   responsive to receiving a command from the user, displaying the specific physical object to the user through a portal in the virtual reality environment.   
     
     
         2 . The method of  claim 1 , wherein the identifying further comprises:
 identifying one or more physical objects of a same type as the specific physical object in the physical proximity to the user using a generic object recognition model; and   identifying the specific physical object from among the located physical objects using a specific object recognition model.   
     
     
         3 . The method of  claim 2 , wherein the specific object recognition model is trained using a few-shot image classification process. 
     
     
         4 . The method of  claim 2 , wherein the specific object recognition model is trained using a method comprising:
 responsive to prompting the user to record a plurality of images of the specific physical object and a background, receiving the plurality of images;   processing the received images into training images;   training the specific object recognition model on the training images.   
     
     
         5 . The method of  claim 4 , wherein the processing further comprises:
 dividing the received images of the background into a plurality of regions to create a plurality of negative examples; and   compositing images of the specific physical object onto the plurality of regions to create a plurality of positive examples, wherein the training images comprise the plurality of negative examples and the plurality of positive examples.   
     
     
         6 . The method of  claim 1 , wherein the tracking further comprises;
 Responsive to determining that the specific physical object has moved, utilizing a moving path prediction algorithm to select the most likely location of the specified physical object based on a movement history of the specific physical object.   
     
     
         7 . The method of  claim 1 , wherein the tracking is persistent across multiple virtual reality experiences. 
     
     
         8 . A computer system for physical object tracking in virtual reality, the computer system comprising:
 one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:
 receiving input from a user identifying a specific physical object during a virtual reality session in a virtual reality environment; 
 identifying the specific physical object in a physical proximity of the user; 
 tracking a location of the specific physical object relative to the user; and 
 responsive to receiving a command from the user, displaying the specific physical object to the user through a portal in the virtual reality environment. 
   
     
     
         9 . The computer system of  claim 8 , wherein the identifying further comprises:
 identifying one or more physical objects of a same type as the specific physical object in the physical proximity to the user using a generic object recognition model; and   identifying the specific physical object from among the located physical objects using a specific object recognition model.   
     
     
         10 . The computer system of  claim 9 , wherein the specific object recognition model is trained using a few-shot image classification process. 
     
     
         11 . The computer system of  claim 9 , wherein the specific object recognition model is trained using a method comprising:
 responsive to prompting the user to record a plurality of images of the specific physical object and a background, receiving the plurality of images;   processing the received images into training images;   training the specific object recognition model on the training images.   
     
     
         12 . The computer system of  claim 11 , wherein the processing further comprises:
 dividing the received images of the background into a plurality of regions to create a plurality of negative examples; and   compositing images of the specific physical object onto the plurality of regions to create a plurality of positive examples, wherein the training images comprise the plurality of negative examples and the plurality of positive examples.   
     
     
         13 . The computer system of  claim 8 , wherein the tracking further comprises;
 Responsive to determining that the specific physical object has moved, utilizing a moving path prediction algorithm to select the most likely location of the specified physical object based on a movement history of the specific physical object.   
     
     
         14 . The computer system of  claim 8 , wherein the tracking is persistent across multiple virtual reality experiences. 
     
     
         15 . A computer program product for physical object tracking in virtual reality, the computer program product comprising:
 one or more computer-readable tangible storage medium and program instructions stored on at least one of the one or more tangible storage medium, the program instructions executable by a processor to cause the processor to perform a method comprising:
 receiving input from a user identifying a specific physical object during a virtual reality session in a virtual reality environment; 
 identifying a specific physical object in a physical proximity of the user; 
 tracking a location of the specific physical object relative to the user; and 
 responsive to receiving a command from the user, displaying the specific physical object to the user through a portal in the virtual reality environment. 
   
     
     
         16 . The computer program product of  claim 15 , wherein the identifying further comprises:
 identifying one or more physical objects of a same type as the specific physical object in the physical proximity to the user using a generic object recognition model; and   identifying the specific physical object from among the located physical objects using a specific object recognition model.   
     
     
         17 . The computer program product of  claim 16 , wherein the specific object recognition model is trained using a few-shot image classification process. 
     
     
         18 . The computer program product of  claim 16 , wherein the specific object recognition model is trained using a method comprising:
 responsive to prompting the user to record a plurality of images of the specific physical object and a background, receiving the plurality of images;   processing the received images into training images;   training the specific object recognition model on the training images.   
     
     
         19 . The computer program product of  claim 18 , wherein the processing further comprises:
 dividing the received images of the background into a plurality of regions to create a plurality of negative examples; and   compositing images of the specific physical object onto the plurality of regions to create a plurality of positive examples, wherein the training images comprise the plurality of negative examples and the plurality of positive examples.   
     
     
         20 . The computer program product of  claim 15 , wherein the tracking further comprises;
 Responsive to determining that the specific physical object has moved, utilizing a moving path prediction algorithm to select the most likely location of the specified physical object based on a movement history of the specific physical object.