Generation of object annotations on 2d images

Abstract

A method includes receiving data characterizing a two-dimensional target site image including an image of a first asset acquired by a camera. The camera has a first location during the acquisition of the two-dimensional target site image. The method also includes receiving data characterizing a three-dimensional model of a target site that includes a plurality of assets including the first asset. The three-dimensional model is annotated to at least identify the first asset. The method further includes generating a projected annotation of the first asset on the two-dimensional target site image by at least projecting the three-dimensional model based on the first location and orientation of the camera relative to the first asset during the acquisition of the target site image.

1 . A method comprising:
 receiving data characterizing a two-dimensional target site image including an image of a first asset acquired by a camera, wherein the camera has a first location during the acquisition of the two-dimensional target site image;   receiving data characterizing a three-dimensional model of a target site that includes a plurality of assets including the first asset, wherein the three-dimensional model is annotated to at least identify the first asset; and   generating a projected annotation of the first asset on the two-dimensional target site image by at least projecting the three-dimensional model based on the first location and orientation of the camera relative to the first asset during the acquisition of the target site image.   
     
     
         2 . The method of  claim 1 , further comprising:
 receiving data characterizing a plurality of two-dimensional images of the target site acquired at a plurality of locations, wherein each image of the plurality of two-dimensional images is acquired at a unique location of the plurality of locations and with a unique camera orientation of the plurality of orientations;   generating the three-dimensional model of the target site based on the plurality of two-dimensional images;   receiving data characterizing the identity of one or more of the plurality of assets in the target site; and   annotating the three-dimensional model of the industrial asset to identify at least the first asset of the plurality assets.   
     
     
         3 . The method of  claim 2 , further comprising:
 providing, via a graphical user interface, the three-dimensional model of the target site to a user;   receiving user input indicative of data characterizing identity of a first asset of the plurality of assets in the target site; and   annotating at least a first portion of the three-dimensional model indicative of the first asset based on the received user input.   
     
     
         4 . The method of  claim 2 , further comprising receiving data characterizing the plurality locations associated with the acquisition of the plurality of two-dimensional images. 
     
     
         5 . The method of  claim 4 , wherein the plurality of locations are detected by one of a position sensor and a global positional system tag coupled to the camera or to a drone to which the camera is attached. 
     
     
         6 . The method of  claim 1 , wherein the camera is coupled to one of a drone and a satellite configured to inspect the target site. 
     
     
         7 . The method of  claim 1 , wherein the annotation of the first asset includes determining a first contour associated with the first asset. 
     
     
         8 . The method of  claim 7 , wherein determining the first contour includes:
 determining that a first distance between the first asset and the camera is greater than a second distance between a second asset and the camera, where in the first asset and the second asset are located adjacent to each other;   identifying a first portion of the first contour that overlaps with the second asset; and   annotating the first asset to preclude portions of the first asset located between the first portion of the first contour and a second contour of the second asset.   
     
     
         9 . The method of  claim 1 , further comprising:
 determining that a first distance between a first portion of the first asset and the camera is greater than a second distance between a second portion of a second asset and the camera;   identifying that the first portion of the first asset overlaps with the second portion of the second asset from the perspective of the camera during the acquisition of the two-dimensional target site image; and   annotating the first asset to preclude the first portion of the first asset.   
     
     
         10 . A system comprising:
 at least one data processor;   memory coupled to the at least one data processor, the memory storing instructions to cause the at least one data processor to perform operations comprising:
 receiving data characterizing a two-dimensional target site image including an image of a first asset acquired by a camera, wherein the camera has a first location during the acquisition of the two-dimensional target site image; 
 receiving data characterizing a three-dimensional model of a target site that includes a plurality of assets including the first asset, wherein the three-dimensional model is annotated to at least identify the first asset; and 
 generating a projected annotation of the first asset on the two-dimensional target site image by at least projecting the three-dimensional model based on the first location and orientation of the camera relative to the first asset during the acquisition of the target site image. 
   
     
     
         11 . The system of  claim 10 , wherein the operations further comprising:
 receiving data characterizing a plurality of two-dimensional images of the target site acquired at a plurality of locations, wherein each image of the plurality of two-dimensional images is acquired at a unique location of the plurality of locations and with a unique camera orientation of the plurality of orientations;   generating the three-dimensional model of the target site based on the plurality of two-dimensional images;   receiving data characterizing the identity of one or more of the plurality of assets in the target site; and   annotating the three-dimensional model of the industrial asset to identify at least the first asset of the plurality assets.   
     
     
         12 . The system of  claim 11 , wherein the operations further comprising:
 providing, via a graphical user interface, the three-dimensional model of the target site to a user;   receiving user input indicative of data characterizing identity of a first asset of the plurality of assets in the target site; and   annotating at least a first portion of the three-dimensional model indicative of the first asset based on the received user input.   
     
     
         13 . The system of  claim 11 , wherein the operations further comprising receiving data characterizing the plurality locations associated with the acquisition of the plurality of two-dimensional images. 
     
     
         14 . The system of  claim 13 , wherein the plurality of locations are detected by one of a position sensor and a global positional system tag coupled to the camera or to a drone to which the camera is attached. 
     
     
         15 . The system of  claim 10 , wherein the camera is coupled to one of a drone and a satellite configured to inspect the target site. 
     
     
         16 . The system of  claim 10 , wherein the annotation of the first asset includes determining a first contour associated with the first asset. 
     
     
         17 . The system of  claim 16 , wherein the operations further comprising:
 determining that a first distance between the first asset and the camera is greater than a second distance between a second asset and the camera, where in the first asset and the second asset are located adjacent to each other;   identifying a first portion of the first contour that overlaps with the second asset; and   annotating the first asset to preclude portions of the first asset located between the first portion of the first contour and a second contour of the second asset.   
     
     
         18 . The system of  claim 10 , wherein the operations further comprising
 determining that a first distance between a first portion of the first asset and the camera is greater than a second distance between a second portion of a second asset and the camera;   identifying that the first portion of the first asset overlaps with the second portion of the second asset from the perspective of the camera during the acquisition of the two-dimensional target site image; and   annotating the first asset to preclude the first portion of the first asset.   
     
     
         19 . A computer program product comprising a non-transitory machine-readable medium storing instructions that, when executed by at least one programmable processor that comprises at least one physical core and a plurality of logical cores, cause the at least one programmable processor to perform operations comprising:
 receiving data characterizing a two-dimensional target site image including an image of a first asset acquired by a camera, wherein the camera has a first location during the acquisition of the two-dimensional target site image;   receiving data characterizing a three-dimensional model of a target site that includes a plurality of assets including the first asset, wherein the three-dimensional model is annotated to at least identify the first asset; and   generating a projected annotation of the first asset on the two-dimensional target site image by at least projecting the three-dimensional model based on the first location and orientation of the camera relative to the first asset during the acquisition of the target site image.