Computerized system and method for providing a mobile augmented reality item display and selection experience

Abstract

Disclosed are systems and methods for detecting the specific positioning, orientation, plane(s) and scale of a real-world object, and providing an augmented reality (AR) experience of the object based therefrom. The disclosed systems and method provide a novel, efficient and accurate mechanism for launching an AR application that provides an AR view of a captured or currently being viewed image. The instant disclosure's AR positioning and tracking systems and methods provide a streamlined system that maximizes the device's computational resources in order to accurately determine and track the viewed object's and the capturing device's positioning and orientation, as well as the object's physical dimensions, thereby ensuring an efficiently produced AR experience.

1 - 20 . (canceled) 
     
     
         21 . A method comprising:
 acquiring, by a hand held device, an image of a user, the image comprising a digital representation of the user;   representing, by the hand held device, the image within a user interface (UI) associated with an augmented reality (AR) application executing on the hand held device;   evaluating, by the hand held device, the image, and determining a set of physical characteristics of the user represented within the represented image;   determining, by the hand held device, visual characteristics of each characteristic in the set of physical characteristics, the visual characteristics, for each characteristic, comprising information indicating a location of a characteristic and color information of each characteristic, the color information being based on an average color value;   obtaining, by the hand held device, information related to an item, the item information indicating a specific type of item which corresponds to a particular characteristic of a person, the item information further indicating a color of the item, the color being computed based on an average color value;   identifying, by the hand held device, a characteristic from the set of physical characteristics based on the particular characteristic associated with the item;   representing, by the hand held device, the item as an overlay of the identified characteristic of the user represented within the UI, the represent of the item is based the color information of the identified characteristic and the color of the item.   
     
     
         22 . The method of  claim 21 , further comprising:
 determining a contrast of the color information of the identified characteristic and the color of the item, wherein the represent of the item is based on the determined contrast such that accuracy of item's represent is improved.   
     
     
         23 . The method of  claim 21 , further comprising:
 evaluating the visual characteristics, and determining a predetermined set of locations on the user within the image;   determining the color information for each location based on physical characteristics and visual characteristics associated with location.   
     
     
         24 . The method of  claim 23 , wherein the color information corresponds to a skin tone of the user associated with a particular characteristic. 
     
     
         25 . The method of  claim 23 , wherein the determination of the color information is based on execution of a computer vision algorithm. 
     
     
         26 . The method of  claim 21 , further comprising:
 determining a pose and rotation of the user based on the determined physical characteristics of the user.   
     
     
         27 . The method of  claim 26 , further comprising:
 determining a three dimensional (3D) spatial orientation and alignment of the user, wherein the pose of the user is based on the 3D spatial orientation and alignment.   
     
     
         28 . The method of  claim 26 , further comprising:
 evaluating the visual characteristics, and determining a predetermined set of locations on the user within the image; and   determining the rotation of the user based on the predetermined set of locations.   
     
     
         29 . The method of  claim 26 , wherein the item information further indicates a shape of the item. 
     
     
         30 . The method of  claim 29 , further comprising:
 representing the item based on the shape of the item and the pose and rotation of the user, in addition to the color information of the identified characteristic and the color of the item.   
     
     
         31 . The method of  claim 21 , further comprising:
 causing communication, over the network, of information related to the item to a third party platform to obtain a digital content item comprising third party provided digital content associated with the item information;   obtaining, over the network, the digital content item; and   communicating the digital content item to the user for represent in association with the UI.   
     
     
         32 . A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions, that when executed by a hand held device, perform a method comprising:
 acquiring, by the hand held device, an image of a user, the image comprising a digital representation of the user;   representing, by the hand held device, the image within a user interface (UI) associated with an augmented reality (AR) application executing on the hand held device;   evaluating, by the hand held device, the image, and determining a set of physical characteristics of the user represented within the represented image;   determining, by the hand held device, visual characteristics of each characteristic in the set of physical characteristics, the visual characteristics, for each characteristic, comprising information indicating a location of a characteristic and color information of each characteristic, the color information being based on an average value;   obtaining, by the hand held device, information related to an item, the item information indicating a specific type of item which corresponds to a particular characteristic of a person, the item information further indicating a color of the item, the color being based on an average value;   identifying, by the hand held device, a characteristic from the set of physical characteristics based on the particular characteristic associated with the item;   representing, by the hand held device, the item as an overlay of the identified characteristic of the user represented within the UI, the represent of the item is based on the color information of the identified characteristic and the color of the item.   
     
     
         33 . The non-transitory computer-readable storage medium of  claim 32 , further comprising:
 determining a contrast of the color information of the identified characteristic and the color of the item, wherein the represent of the item is based on the determined contrast such that accuracy of item's represent is improved.   
     
     
         34 . The non-transitory computer-readable storage medium of  claim 32 , further comprising:
 evaluating the visual characteristics, and determining a predetermined set of locations on the user within the image;   determining the color information for each location based on physical characteristics and visual characteristics associated with location.   
     
     
         35 . The non-transitory computer-readable storage medium of  claim 34 , wherein the color information corresponds to a skin tone of the user associated with a particular characteristic. 
     
     
         36 . The non-transitory computer-readable storage medium of  claim 32 , further comprising:
 determining a pose and rotation of the user based on the determined physical characteristics of the user.   
     
     
         37 . The non-transitory computer-readable storage medium of  claim 36 , further comprising:
 determining a three dimensional (3D) spatial orientation and alignment of the user, wherein the pose of the user is based on the 3D spatial orientation and alignment.   
     
     
         38 . The non-transitory computer-readable storage medium of  claim 36 , further comprising:
 evaluating the visual characteristics, and determining a predetermined set of locations on the user within the image; and   determining the rotation of the user based on the predetermined set of locations.   
     
     
         39 . The non-transitory computer-readable storage medium of  claim 36 , further comprising:
 representing the item based on a shape of the item and the pose and rotation of the user, in addition to the color information of the identified characteristic and the color of the item, wherein the item information further indicates the shape of the item.   
     
     
         40 . A hand held device comprising:
 a processor configured to:   acquire an image of a user, the image comprising a digital representation of the user;   represent the image within a user interface (UI) associated with an augmented reality (AR) application;   evaluate, the image, and determine a set of physical characteristics of the user represented within the represented image;   determine visual characteristics of each characteristic in the set of physical characteristics, the visual characteristics, for each characteristic, comprising information indicating a location of a characteristic and color information of each characteristic, the color information being based on the average value;   obtain information related to an item, the item information indicating a specific type of item which corresponds to a particular characteristic of a person, the item information further indicating a color of the item, the color being based on an average value;   identify a characteristic from the set of physical characteristics based on the particular characteristic associated with the item;   represent the item as an overlay of the identified characteristic of the user represented within the UI, the represent of the item is based on the color information of the identified characteristic and the color of the item.