Computerized system and method for providing a mobile augmented reality item display and selection experience

Abstract

Disclosed are systems and methods for detecting the specific positioning, orientation, plane(s) and scale of a real-world object, and providing an augmented reality (AR) experience of the object based therefrom. The disclosed systems and method provide a novel, efficient and accurate mechanism for launching an AR application that provides an AR view of a captured or currently being viewed image. The instant disclosure's AR positioning and tracking systems and methods provide a streamlined system that maximizes the device's computational resources in order to accurately determine and track the viewed object's and the capturing device's positioning and orientation, as well as the object's physical dimensions, thereby ensuring an efficiently produced AR experience.

1 - 20 . (canceled) 
     
     
         21 . A method comprising:
 capturing, by a device, an image of a user, the image comprising a digital representation of the user;   displaying, by the device, the image within a user interface (UI) associated with an augmented reality (AR) application executing on the device;   analyzing, by the device, the image, and determining a set of features of the user represented within the displayed image;   determining, by the device, visual characteristics of each feature in the set of features, the visual characteristics, for each feature, comprising information indicating a location of a feature and color information of each feature;   receiving, by the device, information related to an item, the item information indicating a specific type of item which corresponds to a particular feature of a person, the item information further indicating a color of the item;   identifying, by the device, a feature from the set of features based on the particular feature associated with the item;   displaying, by the device, the item as an overlay of the identified feature of the user displayed within the UI, the display of the item is based on the color information of the identified feature and the color of the item.   
     
     
         22 . The method of  claim 21 , further comprising:
 determining a contrast of the color information of the identified feature and the color of the item, wherein the display of the item is based on the determined contrast such that accuracy of item's display is improved.   
     
     
         23 . The method of  claim 21 , further comprising:
 analyzing the visual characteristics, and determining a predetermined set of locations on the user within the image;   determining the color information for each location based on features and visual characteristics associated with location.   
     
     
         24 . The method of  claim 23 , wherein the color information corresponds to a skin tone of the user associated with a particular feature. 
     
     
         25 . The method of  claim 23 , wherein the determination of the color information is based on execution of a computer vision algorithm. 
     
     
         26 . The method of  claim 21 , further comprising:
 determining a pose and rotation of the user based on the determined features of the user.   
     
     
         27 . The method of  claim 26 , further comprising:
 determining a three dimensional ( 3 D) spatial orientation and alignment of the user, wherein the pose of the user is based on the  3 D spatial orientation and alignment.   
     
     
         28 . The method of  claim 26 , further comprising:
 analyzing the visual characteristics, and determining a predetermined set of locations on the user within the image; and   determining the rotation of the user based on the predetermined set of locations.   
     
     
         29 . The method of  claim 26 , wherein the item information further indicates a shape of the item. 
     
     
         30 . The method of  claim 29 , further comprising:
 displaying the item based on the shape of the item and the pose and rotation of the user, in addition to the color information of the identified feature and the color of the item.   
     
     
         31 . The method of  claim 21 , further comprising:
 causing communication, over the network, of information related to the item to a third party platform to obtain a digital content item comprising third party provided digital content associated with the item information;   receiving, over the network, the digital content item; and   communicating the digital content item to the user for display in association with the UI.   
     
     
         32 . A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions, that when executed by a device, perform a method comprising:
 capturing, by the device, an image of a user, the image comprising a digital representation of the user;   displaying, by the device, the image within a user interface (UI) associated with an augmented reality (AR) application executing on the device;   analyzing, by the device, the image, and determining a set of features of the user represented within the displayed image;   determining, by the device, visual characteristics of each feature in the set of features, the visual characteristics, for each feature, comprising information indicating a location of a feature and color information of each feature;   receiving, by the device, information related to an item, the item information indicating a specific type of item which corresponds to a particular feature of a person, the item information further indicating a color of the item;   identifying, by the device, a feature from the set of features based on the particular feature associated with the item;   displaying, by the device, the item as an overlay of the identified feature of the user displayed within the UI, the display of the item is based on the color information of the identified feature and the color of the item.   
     
     
         33 . The non-transitory computer-readable storage medium of  claim 32 , further comprising:
 determining a contrast of the color information of the identified feature and the color of the item, wherein the display of the item is based on the determined contrast such that accuracy of item's display is improved.   
     
     
         34 . The non-transitory computer-readable storage medium of  claim 32 , further comprising:
 analyzing the visual characteristics, and determining a predetermined set of locations on the user within the image;   determining the color information for each location based on features and visual characteristics associated with location.   
     
     
         35 . The non-transitory computer-readable storage medium of  claim 34 , wherein the color information corresponds to a skin tone of the user associated with a particular feature. 
     
     
         36 . The non-transitory computer-readable storage medium of  claim 32 , further comprising:
 determining a pose and rotation of the user based on the determined features of the user.   
     
     
         37 . The non-transitory computer-readable storage medium of  claim 36 , further comprising:
 determining a three dimensional ( 3 D) spatial orientation and alignment of the user, wherein the pose of the user is based on the  3 D spatial orientation and alignment.   
     
     
         38 . The non-transitory computer-readable storage medium of  claim 36 , further comprising:
 analyzing the visual characteristics, and determining a predetermined set of locations on the user within the image; and   determining the rotation of the user based on the predetermined set of locations.   
     
     
         39 . The non-transitory computer-readable storage medium of  claim 36 , further comprising:
 displaying the item based on a shape of the item and the pose and rotation of the user, in addition to the color information of the identified feature and the color of the item, wherein the item information further indicates the shape of the item.   
     
     
         40 . A device comprising:
 a processor configured to:   capture an image of a user, the image comprising a digital representation of the user;   display the image within a user interface (UI) associated with an augmented reality (AR) application;   analyze, the image, and determine a set of features of the user represented within the displayed image;   determine visual characteristics of each feature in the set of features, the visual characteristics, for each feature, comprising information indicating a location of a feature and color information of each feature;   receive information related to an item, the item information indicating a specific type of item which corresponds to a particular feature of a person, the item information further indicating a color of the item;   identify a feature from the set of features based on the particular feature associated with the item;   display the item as an overlay of the identified feature of the user displayed within the UI, the display of the item is based on the color information of the identified feature and the color of the item.