US2022044492A1PendingUtilityA1

Systems and methods for spatial remodeling in extended reality

Assignee: AT & T IP I LPPriority: Apr 27, 2020Filed: Oct 25, 2021Published: Feb 10, 2022
Est. expiryApr 27, 2040(~13.7 yrs left)· nominal 20-yr term from priority
G06Q 30/0275G06V 10/7625G06V 10/945G06V 10/82G06T 19/20G06N 3/045G06F 18/231G06N 3/094G06N 3/0475G06N 3/09G06N 20/00G06F 30/13G06Q 30/0643G06F 2111/16G06F 2111/18G06V 20/20G06T 7/75G06K 9/00671
63
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Aspects of the subject disclosure may include, for example, storing, in a database, a decorating style preference of a user; receiving, from user equipment of the user, one or more images (and/or one or more 2D environment models and/or one or more 3D environment models) depicting an environment in which remodeling is desired; generating, via a machine learning process, a first model to present by the user equipment, the generating the first model being based upon the decorating style preference and the one or more images (and/or the one or more 2D environment models and/or the one or more 3D environment models), the first model comprising a first remodeling proposal for the environment; sending, to the user equipment, the first model, the sending of the first model facilitating display by the user equipment of a first depiction of the environment as proposed by the first remodeling proposal; receiving, from the user equipment, feedback information regarding the first remodeling proposal; generating, via the machine learning process, a second model to present by the user equipment, the generating the second model being based upon the decorating style preference, the one or more images (and/or the one or more 2D environment models and/or the one or more 3D environment models), and the feedback information, the second model comprising a second remodeling proposal for the environment; and sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal. Other embodiments are disclosed.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A device, comprising:
 a processing system including a processor; and   a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
 generating a first model to present by user equipment of a user, the generating the first model being based upon a decorating style preference of the user and one or more images that are received from the user equipment, the decorating style preference comprising a textual label from a taxonomy of visual descriptors, the one or more images depicting an environment in which remodeling is desired, and the first model comprising a first remodeling proposal for the environment; 
 sending, to the user equipment, the first model, the sending of the first model facilitating display by the user equipment of a first depiction of the environment as proposed by the first remodeling proposal; and 
 generating a second model to present by the user equipment, the generating the second model being based upon the decorating style preference, the one or more images, and feedback information that is received from the user equipment, the feedback information regarding the first remodeling proposal, and the second model comprising a second remodeling proposal for the environment. 
   
     
     
         2 . The device of  claim 1 , wherein:
 the operations further comprise sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal;   the generating the first model and the generating the second model are via a machine learning process; and   the machine learning process comprises a generative adversarial network (GAN).   
     
     
         3 . The device of  claim 2 , wherein the generating the second model comprises utilization of a randomly seeded model. 
     
     
         4 . The device of  claim 3 , wherein the feedback information comprises a single input from the user which causes utilization of the randomly seeded model. 
     
     
         5 . The device of  claim 1 , wherein the one or more images comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof. 
     
     
         6 . The device of  claim 1 , wherein the user equipment comprises a camera, a webcam, an augmented reality application, a virtual reality application, a head-mounted device, an eyeglasses device, or any combination thereof. 
     
     
         7 . The device of  claim 1 , wherein:
 the decorating style preference comprises a plurality of decorating style preferences;   the operations further comprise receiving from the user the plurality of decorating style preferences;   the generating the first model is based upon the plurality of decorating style preferences; and   the generating the second model is based upon the plurality of decorating style preferences.   
     
     
         8 . The device of  claim 1 , wherein the environment comprises a room in a building, an exterior of a building, or any combination thereof. 
     
     
         9 . The device of  claim 8 , wherein the building comprises a single-family home, a multi-family home, an apartment unit, an apartment building, an office building or any combination thereof. 
     
     
         10 . The device of  claim 1 , wherein:
 the first model that is sent to the user equipment comprises first data that facilitates presenting to the user, by the user equipment, the first depiction of the environment as proposed by the first remodeling proposal;   the operations further comprise sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal;   the second model that is sent to the user equipment comprises second data that facilitates presenting to the user, by the user equipment, the second depiction of the environment as proposed by the second remodeling proposal; and   the user equipment comprises a smartphone, goggles, a holographic display, a volumetric display, or any combination thereof.   
     
     
         11 . The device of  claim 1 , wherein:
 the first model that is sent to the user equipment comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof;   the operations further comprise sending, to the user equipment, the second model; and   the second model that is sent to the user equipment comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more CAD models, or any combination thereof.   
     
     
         12 . The device of  claim 1 , wherein the operations further comprise:
 sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal;   sending, to the user equipment, vendor information depicting a suggested feature for inclusion in the second depiction of the environment; and   billing a vendor of the suggested feature responsive to the sending of the vendor information.   
     
     
         13 . The device of  claim 12 , wherein the operations further comprise receiving, from the user equipment, a request for the vendor information, the sending the vendor information to the user equipment being responsive to receipt of the request. 
     
     
         14 . A non-transitory machine-readable medium comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
 producing a first model to present at user equipment of a user, the producing the first model being based upon a decorating style preference of the user, the decorating style preference comprising a textual label from a taxonomy of visual descriptors, the producing the first model further being based upon one or more images depicting an environment in which remodeling is desired, and the first model comprising a first remodeling proposal for the environment;   transmitting, to the user equipment, the first model, the transmitting of the first model enabling presentation by the user equipment of a first depiction of the environment as proposed by the first remodeling proposal; and   producing a second model to present at the user equipment, the producing the second model being based upon the decorating style preference, the producing the second model being further based upon the one or more images, and the producing the second model being further based upon feedback information, the feedback information being information from the user regarding the first remodeling proposal, and the second model comprising a second remodeling proposal for the environment.   
     
     
         15 . The non-transitory machine-readable medium of  claim 14 , wherein:
 the producing the first model and the producing the second model are via a machine learning process; and   the operations further comprise:
 receiving, from the user, the decorating style preference; 
 storing, in a database, the decorating style preference that is received; 
 receiving, from the user equipment, the one or more images depicting the environment in which remodeling is desired; 
 receiving, from the user equipment, the feedback information regarding the first remodeling proposal; and 
 transmitting, to the user equipment, the second model, the transmitting of the second model enabling presentation by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal. 
   
     
     
         16 . The non-transitory machine-readable medium of  claim 14 , wherein the one or more images comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof. 
     
     
         17 . The non-transitory machine-readable medium of  claim 14 , wherein the user equipment comprises a camera, a webcam, an augmented reality application, a virtual reality application, a head-mounted device, an eyeglasses device, or any combination thereof. 
     
     
         18 . A method, comprising:
 generating, by a processing system including a processor, a model comprising a remodeling proposal for a first environment, the generating the model being based upon a decorating style preference of a first user and the generating the model being based upon one or more images that are received from an augmented reality device used by the first user in the first environment, the decorating style preference of the first user comprising a textual label from a taxonomy of visual descriptors, and the one or more images depicting the first environment; and   sending by the processing system, to a virtual reality device used by a second user in a second environment, the model, the second environment being physically remote from the first environment, the sending of the model facilitating display to the second user via the virtual reality device of a depiction of the first environment as proposed by the remodeling proposal.   
     
     
         19 . The method of  claim 18 , wherein:
 the generating is via a machine learning process; and   the model that is sent to the virtual reality device comprises data that facilitates presenting to the second user, by the virtual reality device, the depiction of the first environment as proposed by the remodeling proposal.   
     
     
         20 . The method of  claim 18 , wherein:
 the model that is sent to the virtual reality device comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof.

Join the waitlist — get patent alerts

Track US2022044492A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.