AR/VR interface for client/contractor communication platform

Abstract

User interfaces, systems, methods, devices, media, and instructions are described for a client/contractor management and communication system with augmented reality (AR) and/or virtual reality (VR) interface elements. In one embodiment, a device receives finish and inspiration information associated with a home improvement project from a client and structures this information into finish pin data with associated project context information and 3D model data. The device uses this information to automatically generate and update a project chart for the project, along with 3D models for various subproject positions within a project chart. This information is then presented to the client and associated contractors as part of a user interface for a client/contractor system. A project chart interface enables access to 3D models in an AR or VR interface to display models of the project and various project data associated with different positions in a project chart.

The invention claimed is: 
     
       1. A device comprising:
 a display; 
 a memory coupled to the display; and 
 one or more processors coupled to the memory and the display, the one or more processors configured to: 
 receive a plurality of finish pin data sets, each finish pin data set associated with a corresponding finish element of a construction project, wherein each finish pin data set comprises three-dimensional (3D) modeling data for the corresponding finish element; 
 analyze each finish pin data set to identify associated project context information; 
 based on the project context information, generate task elements of a task list and associated subproject indicators for a project chart of the construction project; 
 automatically generate the project chart with the subproject indicators for at least a first finish element based on the task elements and the project context information and one or more associated relationships with related subproject indicators within the project chart, the project chart including a plurality of project positions corresponding to different stages of completion of the construction project; 
 automatically generate a plurality of 3D models for the construction project, each 3D model of the plurality of 3D models associated with a corresponding project position in the project chart; 
 output one or more images for a first 3D model of the plurality of 3D models on the display after selection of a corresponding first intermediate project position in the project chart; 
 receive selection of a particular finish element displayed in the first 3D model; 
 receive input indicating a finalization of the particular finish element; 
 receive selection of a product purchase option for individual purchase of the particular finish element; 
 receive input for individual purchase of the particular finish element; 
 receive one or more updates to the placement of the first finished element throughout the duration of the execution of the project chart; 
 automatically generate a change request communication in response to each of the confirmed updates received to the placement; 
 store data for each iteration of the project chart, including each of the confirmed updates to the placement, the data including an update to the plurality of 3D models based on each of the confirmed updates to the placement of the first finish element; and 
 generate a final project report comprising the data for each iteration of the project chart. 
 
     
     
       2. The device of  claim 1 , wherein the one or more images for a first 3D model of the plurality of 3D models are output on the display using an augmented reality/virtual reality (AR/VR) interface, and wherein the images of the first 3D model include finish elements that are modifications of and are displayed on top of what is actually present at the location of the construction project. 
     
     
       3. The device of  claim 1 , wherein the one or more processors are further configured to:
 receive an input selecting a corresponding second project position in the project chart associated with a second 3D model of the plurality of 3D models; and 
 outputting one or more images of the second 3D model. 
 
     
     
       4. The device of  claim 3 , wherein the second 3D model comprises a final 3D model of the construction project, and wherein the first 3D model comprises an intermediate 3D model of the construction project with one or more missing finishes. 
     
     
       5. The device of  claim 1 , wherein the one or more processors are further configured to:
 receive a change to a first finish pin data set of the plurality of finish pin data sets; and 
 automatically update one or more models of the plurality of 3D models in response to the change to the first finish pin data set. 
 
     
     
       6. The device of  claim 1 , wherein one or more finish pin data sets of the plurality of finish pin data sets comprise data for a pre-designed building and wherein the one or more finish pin data sets comprise a first pre-designed building module data set, a second pre-designed building module data set, and interface data for connecting the first and second pre-designed building module data sets within the plurality of 3D models. 
     
     
       7. The device of  claim 1 , wherein the plurality of finish pin data sets comprise one or more placeholder data sets associated with missing information and a prompt to select a finish. 
     
     
       8. The device of  claim 1  wherein the one or more processors are further configured to generate one or more automated messages associated with timing elements of the related subproject indicators of the project chart matching a current clock time of the device. 
     
     
       9. The device of  claim 1  wherein the one or more processors are further configured to:
 process a user input associated with a change in one or more finish elements associated with the construction project; and 
 in response to the user input, automatically generate a change request, the change request comprising an updated project chart based on the change in the one or more finish elements, and automatically update the one or more 3D models. 
 
     
     
       10. The device of  claim 1  wherein the one or more processors are further configured to:
 process a completion message associated with a first subproject indicator of the project chart; 
 in response to the completion message, automatically generate one or more communications for at least a second subproject associated with a second subproject indicator dependent on completion of a first subproject associated with the first subproject indicator; and 
 update a corresponding 3D model associated with the first subproject indicator to indicate that work associated with the corresponding 3D model is fixed and completed. 
 
     
     
       11. The device of  claim 1  wherein a first finish pin data set associated with the first finish element comprises first associated project context information comprising modeling data associated with placement of the first finish element within a project model. 
     
     
       12. The device of  claim 11  wherein the change request communication comprises a request for a change request quote associated with a cost and at least one timing change to the project chart; and
 automatically update the plurality of 3D models based on a difference from the original placement of the first finished element to the updated placement of the first finished element within the project model. 
 
     
     
       13. The device of  claim 12  wherein the data stored for each iteration of the project chart further includes associated bid response, bid acceptance confirmation, change request, change request quote, and change request approval, an associated set of 3D models that is associated with the activity for the corresponding iteration of the project chart; and
 a final project report is generated in response to a completion notification for a final completion indicator of the project chart. 
 
     
     
       14. A non-transitory computer readable medium comprising instructions that, when executed by one or more processors of a computing device, cause the computing device to perform operations comprising:
 receiving a plurality of finish pin data sets, each finish pin data set associated with a corresponding finish element of a construction project, wherein each finish pin data set comprises three-dimensional (3D) modeling data for the corresponding finish element; 
 analyzing each finish pin data set to identify associated project context information; 
 based on the project context information, generating task elements of a task list and associated subproject indicators for a project chart of the construction project; 
 automatically generating the project chart with the subproject indicator for at least a first finish element based on the task elements and the project context information and one or more associated relationships with related subproject indicators within the project chart, the project chart including a plurality of project positions corresponding to different stages of corresponding to different stages of completion of the construction project; 
 automatically generating a plurality of 3D models for the construction project, each 3D model of the plurality of 3D models associated with a corresponding project position in the project chart; 
 automatically generate a plurality of 3D models for the construction project, each 3D model of the plurality of 3D models associated with a corresponding project position in the project chart; 
 outputting one or more images for a first 3D model of the plurality of 3D models on a display after selection of a corresponding first intermediate project position in the project chart; 
 receiving selection of a particular finish element displayed in the first 3D model; 
 receiving input indicating a finalization of the particular finish element; 
 receiving selection of a product purchase option for individual purchase of the particular finish element; 
 receiving input for individual purchase of the particular finish element; 
 receiving one or more updates to the placement of the first finished element throughout the duration of the execution of the project chart; 
 automatically generating a change request communication in response to each of the confirmed updates received to the placement; 
 storing data for each iteration of the project chart, including each of the confirmed updates to the placement, the data including an update to the plurality of 3D models based on each of the confirmed updates to the placement of the first finish element; and 
 generating a final project report comprising the data for each iteration of the project chart. 
 
     
     
       15. The non-transitory computer readable medium of  claim 14 , wherein the one or more images for a first 3D model of the plurality of 3D models are output on the display using an augmented reality/virtual reality (AR/VR) interface, and wherein the images of the first 3D model include finish elements that are modifications of and are displayed on top of what is actually present at the location of the construction project. 
     
     
       16. The non-transitory computer readable medium of  claim 14 , wherein the operations further comprise:
 receiving an input selecting a corresponding second project position in the project chart associated with a second 3D model of the plurality of 3D models; and 
 outputting one or more images of the second 3D model. 
 
     
     
       17. The non-transitory computer readable medium of  claim 16 , wherein the operations further comprise:
 receiving a change to a first finish pin data set of the plurality of finish pin data sets; and 
 automatically updating one or more models of the plurality of 3D models in response to the change to the first finish pin data set. 
 
     
     
       18. The non-transitory computer readable medium of  claim 14 , wherein the plurality of finish pin data sets comprise one or more placeholder data sets associated with missing information and a prompt to select a finish. 
     
     
       19. The non-transitory computer readable medium of  claim 14 , wherein the operations further comprise:
 processing a user input associated with a change in one or more finish elements associated with the construction project; and 
 in response to the user input, automatically generating a change request, the change request comprising an updated project chart based on the change in the one or more finish elements, and automatically update the one or more 3D models. 
 
     
     
       20. The non-transitory computer readable medium of  claim 14 , wherein a first finish pin data set associated with the first finish element comprises first associated project context information comprising modeling data associated with placement of the first finish element within a project model, and wherein the operations further comprise:
 receiving a confirmed update to the placement of the first finish element within the project model; 
 automatically generating a change request communication in response to the confirmed update to the placement, the change request communication comprising a request for a change request quote associated with a cost and at least one timing change to the project chart; and 
 automatically updating the plurality of 3D models based on the confirmed update to the placement of the first finish element.