Orientation Determination for Mobile Computing Devices

Abstract

Methods, systems, devices, and tangible non-transitory computer readable media for determining orientation are provided. The disclosed technology can include capturing images of an environment visible in a field of view of the mobile computing device. Location data associated with a location of the mobile computing device can be received. Image data including information associated with the images can be generated. Based on the image data and one or more machine-learned models, features of one or more objects in the environment can be determined. Based on the location data and the features of the objects, respective orientations of the objects relative to the location of the mobile computing device can be determined. Furthermore, orientation data that includes a geographic orientation of the mobile computing device can be generated based on the respective (geographic) orientations of the objects.

1 . A computer-implemented method of determining orientation, the computer-implemented method comprising:
 capturing, by a mobile computing device comprising one or more processors, one or more images of an environment visible in a field of view of the mobile computing device;   receiving, by the mobile computing device, location data associated with a location of the mobile computing device;   generating, by the mobile computing device, image data comprising information associated with the one or more images;   determining, by the mobile computing device, based at least in part on the image data and one or more machine-learned models, one or more object classifications of one or more objects in the environment;   determining, by the mobile computing device, based at least in part on the location data and the one or more object classifications of the one or more objects, one or more respective orientations of the one or more objects relative to the location of the mobile computing device; and   generating, by the mobile computing device, orientation data comprising a geographic orientation of the mobile computing device based at least in part on the one or more respective orientations of the one or more objects.   
     
     
         2 .- 20 . (canceled)