Method and device for heading estimation

Abstract

In one implementation, a method of estimating the heading of a device is performed by the device including a processor, non-transitory memory, and an image sensor. The method includes determining a geographic location of the device. The method includes capturing, using the image sensor, an image at the geographic location. The method includes detecting one or more lines within the image. The method includes determining a heading of the device based on the one or more lines and the geographic location.

What is claimed is: 
     
         1 . A method comprising:
 at a device including one or more processors, non-transitory memory, and an image sensor:   determining a geographic location of the device;   capturing, using the image sensor, an image at the geographic location;   detecting one or more lines within the image; and   determining a heading of the device based on the one or more lines and the geographic location.   
     
     
         2 . The method of  claim 1 , wherein detecting the one or more lines within the image includes categorizing, using a gravity vector, the one or more lines as one or more vertical lines and one or more non-vertical lines and wherein determining the heading of the device is based on the one or more non-vertical lines and the geographic location. 
     
     
         3 . The method of  claim 1 , wherein detecting the one or more lines includes categorizing, using a voting scheme, the one or more lines as one or more vanishing lines and one or more non-vanishing lines and wherein determining the heading of the device is based on the one or more vanishing lines and the geographic location. 
     
     
         4 . The method of  claim 1 , wherein detecting the one or more lines within the image includes categorizing, using semantic segmentation, the one or more lines as one or more aligned lines and one or more non-aligned lines and wherein determining the heading of the device is based on the one or more aligned lines and the geographic location. 
     
     
         5 . The method of  claim 1 , wherein detecting the one or more lines within the image includes categorizing the one or more lines as one or more shadow lines and one or more non-shadow lines and wherein determining the heading of the device is based on the one or more shadow lines and the geographic location. 
     
     
         6 . The method of  claim 1 , wherein determining the heading of the device based on the one or more lines and the geographic location includes:
 determining one or more dominant road directions at the geographic location; and   determining the heading of the device based on the one or more lines and the one or more dominant road directions.   
     
     
         7 . The method of  claim 6 , wherein determining the one or more dominant road directions includes obtaining map data indicating the location of roads in an area around the geographic location. 
     
     
         8 . The method of  claim 6 , wherein determining the heading of the device is based on a cost function at a plurality of candidate headings, wherein the cost function includes a term based on the difference between the angle of a particular line of the one or more lines and the angle of a line passing through the midpoint of the particular line and a vanishing point based on a particular dominant road direction of the one or more dominant road directions. 
     
     
         9 . The method of  claim 8 , wherein determining the heading of the device is further based on a heading given by a magnetometer-based compass of the device. 
     
     
         10 . The method of  claim 9 , wherein determining the heading of the device includes determining one or more potential selections for the heading of the device corresponding to one or more peaks of the cost function and selecting, as the heading of the device, one of the one or more potential selections for the heading of the device based on the heading given by the magnetometer-based compass of the device. 
     
     
         11 . The method of  claim 6 , wherein determining the heading of the device includes:
 determining one or more vanishing points based on the one or more lines; and   determining the heading of the device based on the one or more vanishing points based on the one or more lines and the one or more dominant road directions.   
     
     
         12 . The method of  claim 11 , wherein determining the one or more vanishing points based on the one or more lines is based on one or more non-vertical lines of the one or more lines. 
     
     
         13 . A device comprising:
 an image sensor;   a non-transitory memory; and   one or more processors to:
 determine a geographic location of the device; 
 capture, using the image sensor, an image at the geographic location; 
 detect one or more lines within the image; and 
 determine a heading of the device based on the one or more lines and the geographic location. 
   
     
     
         14 . The device of  claim 13 , wherein the one or more processors are to detect the one or more lines within the image by categorizing, using a gravity vector, the one or more lines as one or more vertical lines and one or more non-vertical lines and the one or more processors are to determine the heading of the device based on the one or more non-vertical lines and the geographic location. 
     
     
         15 . The device of  claim 13 , wherein the one or more processors are to detect the one or more lines by categorizing, using a voting scheme, the one or more lines as one or more vanishing lines and one or more non-vanishing lines and the one or more processors are to determine the heading of the device based on the one or more vanishing lines and the geographic location. 
     
     
         16 . The device of  claim 13 , wherein the one or more processors are to determine the heading of the device further based on a heading given by a magnetometer-based compass of the device. 
     
     
         17 . The device of  claim 13 , wherein the one or more processors are to determine the heading of the device based on the one or more lines and the geographic location by:
 determining one or more dominant road directions at the geographic location; and   determining the heading of the device based on the one or more lines and the one or more dominant road directions.   
     
     
         18 . The device of  claim 17 , wherein the one or more processors are to determine the heading of the device by:
 determining one or more vanishing points based on the one or more lines; and   determining the heading of the device based on the one or more vanishing points based on the one or more lines and the one or more dominant road directions.   
     
     
         19 . The device of  claim 18 , wherein the one or more processors are to determine the one or more vanishing points based on the one or more lines based on one or more non-vertical lines of the one or more lines. 
     
     
         20 . A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with an image sensor, cause the device to:
 determine a geographic location of the device;   capture, using the image sensor, an image at the geographic location;   detect one or more lines within the image; and   determine a heading of the device based on the one or more lines and the geographic location.