US2021326376A1PendingUtilityA1

Navigating through a set of images

Assignee: FACEBOOK INCPriority: Jan 4, 2016Filed: May 6, 2021Published: Oct 21, 2021
Est. expiryJan 4, 2036(~9.4 yrs left)· nominal 20-yr term from priority
G06F 16/5838G01C 21/3647G06F 16/5866G06F 16/29G06F 16/24578G06F 16/9537G06F 16/51G06F 16/54G06F 16/587
57
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Information relating to a subset of images within a set of images is received. The information includes metadata of each image. The subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image. Weight information is received. The weight information controls weights to be given to a plurality of different measures of similarities. A plurality of combined measures of similarity for pairs of images in the subset of images are calculated.

Claims

exact text as granted — not AI-modified
1 - 14 . (canceled) 
     
     
         15 . A method, comprising:
 receiving information relating to a subset of images within a set of images, the information comprising corresponding metadata of each image within the subset of images, the corresponding metadata including a corresponding geographical position, a corresponding orientation angle of an image capturing device when acquiring the corresponding image, and image property information, wherein the subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image;   receiving weight information for determining similarities between images within the subset of images, the weight information controlling weights to be provided for determining a plurality of different measures of similarities between the images within the subset of images based on the corresponding metadata of the images within the subset of images; and   calculating a plurality of combined measures of similarity based on pairwise comparisons of pairs of images in the subset of images, wherein a first subset of the plurality of combined measures of similarity represents a similarity between the current image and a different image within the subset of images and a second subset of the plurality of combined measures of similarity represents a similarity between pairs of images in the subset of images not including the current image, the plurality of combined measures being calculated using the corresponding metadata and the weight information.   
     
     
         16 . The method of  claim 15 , further comprising:
 selecting a transition image among the images within the subset of images based on the plurality of combined measures of similarity based on the pairwise comparisons including by classifying a transition between the current image and the selected transition image within the set of images into a selected class among transition class options, wherein each transition class option defines a type of transition between a corresponding image pair according to a difference in the corresponding geographical position and a difference in the corresponding orientation angle of the corresponding image pair.   
     
     
         17 . The method of  16 , further comprising determining a transition class of a transition from the current image to the at least one best ranked transition image, and wherein the method further comprises outputting an indication of one or more transition classes associated with the at least one best ranked transition image. 
     
     
         18 . The method of  claim 15 , further comprising determining at least one best ranked transition image among the images within the subset of images based on the plurality of combined measures of similarity. 
     
     
         19 . The method of  claim 15 , further comprising generating a graph representation of the images within the subset of images, the graph representation comprising nodes and edges. 
     
     
         20 . The method of  claim 15 , wherein the corresponding metadata includes a three-dimensional reconstruction index indicating that the corresponding image is part of a particular sub-model of three-dimensional structure of objects having the three-dimensional reconstruction index. 
     
     
         21 . The method of  claim 15 , wherein the bounding area is updated based on navigation through the set of images. 
     
     
         22 . The method of  claim 15 , wherein the bounding area is determined based at least in part on a viewing angle associated with of the current image. 
     
     
         23 . The method of  claim 15 , further comprising sending a request for information relating to the subset of images, wherein the request comprises an indication of the current image. 
     
     
         24 . A system, comprising:
 one or more processors configured to:
 receive information relating to a subset of images within a set of images, the information comprising corresponding metadata of each image within the subset of images, the corresponding metadata including a corresponding geographical position, a corresponding orientation angle of an image capturing device when acquiring the corresponding image, and image property information, wherein the subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image; 
 receive weight information for determining similarities between images within the subset of images, the weight information controlling weights to be provided for determining a plurality of different measures of similarities between the images within the subset of images based on the corresponding metadata of the images within the subset of images; and 
 calculate a plurality of combined measures of similarity based on pairwise comparisons of pairs of images in the subset of images, wherein a first subset of the plurality of combined measures of similarity represents a similarity between the current image and a different image within the subset of images and a second subset of the plurality of combined measures of similarity represents a similarity between pairs of images in the subset of images not including the current image, the plurality of combined measures being calculated using the corresponding metadata and the weight information; and 
    a memory coupled to at least a portion of the one or more processors and configured to provide instructions.   
     
     
         25 . The system of  claim 24 , wherein the one or more processors are further configured to select a transition image among the images within the subset of images based on the plurality of combined measures of similarity based on the pairwise comparisons including by classifying a transition between the current image and the selected transition image within the set of images into a selected class among transition class options, wherein each transition class option defines a type of transition between a corresponding image pair according to a difference in the corresponding geographical position and a difference in the corresponding orientation angle of the corresponding image pair. 
     
     
         26 . The system of  claim 25 , wherein the one or more processors are further configured to determine a transition class of a transition from the current image to the at least one best ranked transition image, and wherein the method further comprises outputting an indication of one or more transition classes associated with the at least one best ranked transition image. 
     
     
         27 . The system of  claim 24 , wherein the one or more processors are further configured to determine at least one best ranked transition image among the images within the subset of images based on the plurality of combined measures of similarity. 
     
     
         28 . The system of  claim 24 , wherein the one or more processors are further configured to generate a graph representation of the images within the subset of images, the graph representation comprising nodes and edges. 
     
     
         29 . The system of  claim 24 , wherein the corresponding metadata includes a three-dimensional reconstruction index indicating that the corresponding image is part of a particular sub-model of three-dimensional structure of objects having the three-dimensional reconstruction index. 
     
     
         30 . The system of  claim 24 , wherein the bounding area is updated based on navigation through the set of images. 
     
     
         31 . The system of  claim 24 , wherein the bounding area is determined based at least in part on a viewing angle associated with of the current image. 
     
     
         32 . The system of  claim 24 , wherein the one or more processors are further configured to send a request for information relating to the subset of images, wherein the request comprises an indication of the current image. 
     
     
         33 . A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
 receiving information relating to a subset of images within a set of images, the information comprising corresponding metadata of each image within the subset of images, the corresponding metadata including a corresponding geographical position, a corresponding orientation angle of an image capturing device when acquiring the corresponding image, and image property information, wherein the subset of images are selected from the set of images based upon each image in the subset of images being acquired within a bounding area surrounding a geographical position of a current image;   receiving weight information for determining similarities between images within the subset of images, the weight information controlling weights to be provided for determining a plurality of different measures of similarities between the images within the subset of images based on the corresponding metadata of the images within the subset of images; and   calculating a plurality of combined measures of similarity based on pairwise comparisons of pairs of images in the subset of images, wherein a first subset of the plurality of combined measures of similarity represents a similarity between the current image and a different image within the subset of images and a second subset of the plurality of combined measures of similarity represents a similarity between pairs of images in the subset of images not including the current image, the plurality of combined measures being calculated using the corresponding metadata and the weight information.   
     
     
         34 . The computer program product of  claim 33 , further comprising computer instructions for:
 selecting a transition image among the images within the subset of images based on the plurality of combined measures of similarity based on the pairwise comparisons including by classifying a transition between the current image and the selected transition image within the set of images into a selected class among transition class options, wherein each transition class option defines a type of transition between a corresponding image pair according to a difference in the corresponding geographical position and a difference in the corresponding orientation angle of the corresponding image pair.

Join the waitlist — get patent alerts

Track US2021326376A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.