Augmented Reality System, Method, and Apparatus for Displaying an Item Image in a Contextual Environment

Abstract

Method, apparatus, and system for providing an item image to a client for display in a contextual environment are described. In some embodiments, the user may select an item for display in the contextual environment, and the user may position a camera coupled to a processing system to capture the contextual environment. A placeholder may be generated and associated with an item selected by a user. In an embodiment, the generated placeholder may be placed in a location within the contextual environment, and the user's processing system may send a visual data stream of the camera-captured environment to a server. In an embodiment, the user's processing device may receive a modified data stream including an image of the item, and the user's processing device may display the item image in the same location as the placeholder.

What is claimed is: 
     
         1 . A method comprising:
 visually capturing, by a computing device, an environment including a placeholder, the placeholder including a first portion and a second portion, the first portion being visually distinct from the second portion;   determining, by the computing device, a placement of the placeholder in the environment, the placement describing an orientation of the placeholder and a distance of the placeholder relative to the computing device;   identifying, by the computing device, an item corresponding to the placeholder;   retrieving, by the computing device, an image of the item corresponding to the placeholder; and   generating, by the computing device, a visual display of the environment that includes the retrieved image of the item, the retrieved image of the item being positioned and oriented in the visual display based on the determined placement information of the placeholder in the environment.   
     
     
         2 . The method of  claim 1 , further comprising receiving user input selecting the item corresponding to the placeholder and requesting the placeholder in response to receiving the user input. 
     
     
         3 . The method of  claim 1 , wherein the visually capturing the environment including the placeholder is performed using a camera of the computing device. 
     
     
         4 . The method of  claim 1 , wherein the first portion of the placeholder includes at least two shaded objects of dissimilar color. 
     
     
         5 . The method of  claim 1 , wherein identifying the item corresponding to the placeholder is performed using visual information included in the second portion of the placeholder. 
     
     
         6 . The method of  claim 1 , wherein the retrieved image of the item is scaled in the visual display of the environment based on the determined placement information of the placeholder in the environment. 
     
     
         7 . The method of  claim 1 , further comprising determining one or more physical dimensions of the item, wherein retrieving the image of the item corresponding to the placeholder is performed in response to determining the one or more physical dimensions of the item. 
     
     
         8 . A system comprising:
 at least one processor; and   a computer-readable storage media having instructions stored thereon that are executable by the at least one processor to perform operations comprising:
 visually capturing an environment including a placeholder, the placeholder including a first portion and a second portion, the first portion being visually distinct from the second portion; 
 determining a placement of the placeholder in the environment, the placement describing an orientation of the placeholder and a distance of the placeholder relative to the computing device; 
 identifying an item corresponding to the placeholder; 
 retrieving an image of the item corresponding to the placeholder; and 
 generating a visual display of the environment that includes the retrieved image of the item, the retrieved image of the item being positioned and oriented in the visual display based on the determined placement information of the placeholder in the environment. 
   
     
     
         9 . The system of  claim 8 , the operations further comprising receiving user input selecting the item corresponding to the placeholder and requesting the placeholder in response to receiving the user input. 
     
     
         10 . The system of  claim 8 , wherein the first portion of the placeholder includes at least two shaded objects of dissimilar color. 
     
     
         11 . The system of  claim 8 , wherein identifying the item corresponding to the placeholder is performed using visual information included in the second portion of the placeholder. 
     
     
         12 . The system of  claim 8 , wherein the retrieved image of the item is scaled in the visual display of the environment based on the determined placement information of the placeholder in the environment. 
     
     
         13 . The system of  claim 8 , the operations further comprising determining one or more physical dimensions of the item, wherein retrieving the image of the item corresponding to the placeholder is performed in response to determining the one or more physical dimensions of the item. 
     
     
         14 . A computer-readable storage medium having instructions stored thereon that are executable by a computing device to perform operations comprising:
 visually capturing an environment including a placeholder, the placeholder including a first portion and a second portion, the first portion being visually distinct from the second portion;   determining a placement of the placeholder in the environment, the placement describing an orientation of the placeholder and a distance of the placeholder relative to the computing device;   identifying an item corresponding to the placeholder;   retrieving an image of the item corresponding to the placeholder; and   generating a visual display of the environment that includes the retrieved image of the item, the retrieved image of the item being positioned and oriented in the visual display based on the determined placement information of the placeholder in the environment.   
     
     
         15 . The computer-readable storage medium of  claim 14 , the operations further comprising receiving user input selecting the item corresponding to the placeholder and requesting the placeholder in response to receiving the user input. 
     
     
         16 . The computer-readable storage medium of  claim 14 , wherein the visually capturing the environment including the placeholder is performed using a camera of the computing device. 
     
     
         17 . The computer-readable storage medium of  claim 14 , wherein the first portion of the placeholder includes at least two shaded objects of dissimilar color. 
     
     
         18 . The computer-readable storage medium of  claim 14 , wherein identifying the item corresponding to the placeholder is performed using visual information included in the second portion of the placeholder. 
     
     
         19 . The computer-readable storage medium of  claim 14 , wherein the retrieved image of the item is scaled in the visual display of the environment based on the determined placement information of the placeholder in the environment. 
     
     
         20 . The computer-readable storage medium of  claim 14 , the operations further comprising determining one or more physical dimensions of the item, wherein retrieving the image of the item corresponding to the placeholder is performed in response to determining the one or more physical dimensions of the item.