US11417077B2ActiveUtilityA1

Systems and methods for rapid alignment of digital imagery datasets to models of structures

Assignee: INSURANCE SERVICES OFFICE INCPriority: Jan 25, 2018Filed: Aug 4, 2020Granted: Aug 16, 2022
Est. expiryJan 25, 2038(~11.5 yrs left)· nominal 20-yr term from priority
G06V 20/64G06V 20/176G06T 2207/10032G06T 7/30G06T 7/38G06T 2207/10016G06T 2207/30181G06T 3/4038G06T 7/33G01C 11/10G06T 2207/20101G06T 3/0068G06V 10/245G06V 20/13G06T 3/14
60
PatentIndex Score
0
Cited by
23
References
12
Claims

Abstract

Systems and methods for aligning digital image datasets to a computer model of a structure. The system receives a plurality of reference images from an input image dataset and identifies common ground control points (“GCPs”) in the reference images. The system then calculates virtual three-dimensional (“3D”) coordinates of the measured GCPs. Next, the system calculates and projects two-dimensional (“2D”) image coordinates of the virtual 3D coordinates into all of the images. Finally, using the projected 2D image coordinates, the system performs spatial resection of all of the images in order to rapidly align all of the images.

Claims

exact text as granted — not AI-modified
The invention claimed is: 
     
       1. A method for automatically aligning each image in a dataset to produce an aligned image dataset, comprising:
 identifying common ground control points (“GCPs”) in a plurality of reference images in a digital imagery dataset; 
 calculating virtual three-dimensional coordinates of the GCPs identified in the plurality of reference images; 
 calculating and projecting two-dimensional image coordinates of the virtual three-dimensional coordinates into each image of the dataset; and 
 performing spatial resection on each image in the digital imagery dataset to align each image using the projected two-dimensional image coordinates. 
 
     
     
       2. The method of  claim 1 , wherein the digital imagery dataset comprises an aerial imagery dataset. 
     
     
       3. The method of  claim 1 , wherein step of identify the common GCPs comprises manually identifying the GCPs using a graphical user interface tool and marking the GCPs on a user interface. 
     
     
       4. The method of  claim 1 , wherein step of identify the common GCPs comprises a computer system automatically identifying the GCPs using computer vision techniques. 
     
     
       5. The method of  claim 1 , wherein step of perform spatial resection on each image comprises calculating external orientation parameters using collinearity equations. 
     
     
       6. The method of  claim 5 , wherein the collinearity equations comprise: 
       
         
           
             
               
                 x 
                 - 
                 
                   x 
                   0 
                 
               
               = 
               
                 
                   - 
                   f 
                 
                 ⁢ 
                 
                   
                     
                       
                         a 
                         1 
                       
                       ⁡ 
                       
                         ( 
                         
                           X 
                           - 
                           
                             X 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         b 
                         1 
                       
                       ⁡ 
                       
                         ( 
                         
                           Y 
                           - 
                           
                             Y 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         c 
                         1 
                       
                       ⁡ 
                       
                         ( 
                         
                           Z 
                           - 
                           
                             Z 
                             s 
                           
                         
                         ) 
                       
                     
                   
                   
                     
                       
                         a 
                         3 
                       
                       ⁡ 
                       
                         ( 
                         
                           X 
                           - 
                           
                             X 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         b 
                         3 
                       
                       ⁡ 
                       
                         ( 
                         
                           Y 
                           - 
                           
                             Y 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         c 
                         3 
                       
                       ⁡ 
                       
                         ( 
                         
                           Z 
                           - 
                           
                             Z 
                             s 
                           
                         
                         ) 
                       
                     
                   
                 
               
             
           
         
         
           
             
               
                 y 
                 - 
                 
                   y 
                   0 
                 
               
               = 
               
                 
                   - 
                   f 
                 
                 ⁢ 
                 
                   
                     
                       
                         
                           a 
                           2 
                         
                         ⁡ 
                         
                           ( 
                           
                             X 
                             - 
                             
                               X 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           b 
                           2 
                         
                         ⁡ 
                         
                           ( 
                           
                             Y 
                             - 
                             
                               Y 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           c 
                           2 
                         
                         ⁡ 
                         
                           ( 
                           
                             Z 
                             - 
                             
                               Z 
                               s 
                             
                           
                           ) 
                         
                       
                     
                     
                       
                         
                           a 
                           3 
                         
                         ⁡ 
                         
                           ( 
                           
                             X 
                             - 
                             
                               X 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           b 
                           3 
                         
                         ⁡ 
                         
                           ( 
                           
                             Y 
                             - 
                             
                               Y 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           c 
                           3 
                         
                         ⁡ 
                         
                           ( 
                           
                             Z 
                             - 
                             
                               Z 
                               s 
                             
                           
                           ) 
                         
                       
                     
                   
                   . 
                 
               
             
           
         
       
     
     
       7. A system for automatically aligning each image in a dataset to produce an aligned image dataset, comprising:
 a processor in communication with a digital imagery dataset; and 
 computer system code executed by the processor, the computer system code causing the processor to:
 identify common ground control points (“GCPs”) in a plurality of reference images; 
 calculate virtual three-dimensional coordinates of the GCPs identified in the plurality of reference images; 
 calculate and project two-dimensional image coordinates of the virtual three-dimensional coordinates into each image of the dataset; and 
 perform spatial resection on each image in the digital imagery dataset to align each image using the projected two-dimensional image coordinates. 
 
 
     
     
       8. The system of  claim 7 , wherein the digital imagery dataset comprises an aerial imagery dataset. 
     
     
       9. The system of  claim 7 , wherein step of identify the common GCPs comprises the user manually identifying the GCPs using a graphical user interface tool and marking the GCPs on the user interface. 
     
     
       10. The system of  claim 7 , wherein step of identify the common GCPs comprises the system automatically identifying the GCPs using computer vision techniques. 
     
     
       11. The system of  claim 7 , wherein step of perform spatial resection on each image comprises calculating external orientation parameters using collinearity equations. 
     
     
       12. The system of  claim 11 , wherein the collinearity equations comprise: 
       
         
           
             
               
                 x 
                 - 
                 
                   x 
                   0 
                 
               
               = 
               
                 
                   - 
                   f 
                 
                 ⁢ 
                 
                   
                     
                       
                         a 
                         1 
                       
                       ⁡ 
                       
                         ( 
                         
                           X 
                           - 
                           
                             X 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         b 
                         1 
                       
                       ⁡ 
                       
                         ( 
                         
                           Y 
                           - 
                           
                             Y 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         c 
                         1 
                       
                       ⁡ 
                       
                         ( 
                         
                           Z 
                           - 
                           
                             Z 
                             s 
                           
                         
                         ) 
                       
                     
                   
                   
                     
                       
                         a 
                         3 
                       
                       ⁡ 
                       
                         ( 
                         
                           X 
                           - 
                           
                             X 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         b 
                         3 
                       
                       ⁡ 
                       
                         ( 
                         
                           Y 
                           - 
                           
                             Y 
                             s 
                           
                         
                         ) 
                       
                     
                     + 
                     
                       
                         c 
                         3 
                       
                       ⁡ 
                       
                         ( 
                         
                           Z 
                           - 
                           
                             Z 
                             s 
                           
                         
                         ) 
                       
                     
                   
                 
               
             
           
         
         
           
             
               
                 y 
                 - 
                 
                   y 
                   0 
                 
               
               = 
               
                 
                   - 
                   f 
                 
                 ⁢ 
                 
                   
                     
                       
                         
                           a 
                           2 
                         
                         ⁡ 
                         
                           ( 
                           
                             X 
                             - 
                             
                               X 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           b 
                           2 
                         
                         ⁡ 
                         
                           ( 
                           
                             Y 
                             - 
                             
                               Y 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           c 
                           2 
                         
                         ⁡ 
                         
                           ( 
                           
                             Z 
                             - 
                             
                               Z 
                               s 
                             
                           
                           ) 
                         
                       
                     
                     
                       
                         
                           a 
                           3 
                         
                         ⁡ 
                         
                           ( 
                           
                             X 
                             - 
                             
                               X 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           b 
                           3 
                         
                         ⁡ 
                         
                           ( 
                           
                             Y 
                             - 
                             
                               Y 
                               s 
                             
                           
                           ) 
                         
                       
                       + 
                       
                         
                           c 
                           3 
                         
                         ⁡ 
                         
                           ( 
                           
                             Z 
                             - 
                             
                               Z 
                               s 
                             
                           
                           ) 
                         
                       
                     
                   
                   .

Join the waitlist — get patent alerts

Track US11417077B2 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.