US2023417567A1PendingUtilityA1

Augmented reality maps

Assignee: APPLE INCPriority: Feb 12, 2010Filed: Jun 30, 2023Published: Dec 28, 2023
Est. expiryFeb 12, 2030(~3.5 yrs left)· nominal 20-yr term from priority
Inventors:Jaron Waldman
G01C 21/3647G01C 21/3602G01C 21/3679H04N 23/633G01C 21/3682G06T 11/60H04N 7/185
79
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

A handheld communication device can capture and display a real-time video stream. The handheld communication device detects a geographic position and camera direction of the handheld communication device. A route is identified from the geographic position of the handheld communication device to a point of interest. The captured video stream is visually augmented with an indicator indicating a direction to travel to the point of interest. The indicator is overlaid on the captured real-time video stream.

Claims

exact text as granted — not AI-modified
1 . (canceled) 
     
     
         2 . A method implemented on handheld communication device including a processor, an image capture component, and a display, the method comprising:
 determining a current angle of the handheld communication device;   determining whether the current angle meets one or more criteria for displaying an augmented reality map that displays captured images augmented with additional information;   responsive to determining that the current angle meets the one or more criteria, displaying the augmented reality map at least by:
 capturing, by the handheld communication device, a video stream using the image capture component; 
 displaying, on the display, the video stream in real-time as the video stream is being captured; 
 augmenting the video stream, being displayed on the display in real-time, with information identifying a point of interest or a street that is within a field of view of the handheld communication device; 
   responsive to determining that the current angle does not meet the one or more criteria for displaying the augmented reality map: displaying, on the display, map information in a map view that is different than the augmented reality map.   
     
     
         3 . The method of  claim 2 , wherein the method further comprises determining the field of view of the handheld communication device at least by:
 detecting a geographic position of the handheld communication device and a camera direction of a camera of the image capture component; and   determining a field of view based on the geographic position and the camera direction.   
     
     
         4 . The method of  claim 2 , wherein the method further comprises determining the field of view of the handheld communication device using a compass corresponding to the handheld communication device. 
     
     
         5 . The method of  claim 2 , wherein the current angle of the handheld communication device is measured with respect to the ground. 
     
     
         6 . The method of  claim 2 , wherein the criteria for displaying the augmented reality map comprises a range of angles for the handheld communication device, and wherein the method further comprises determining the range of angles based on at least one of: (a) an environment of the handheld communication device or (b) user preferences. 
     
     
         7 . The method of  claim 2 , wherein determining that the current angle meets the criteria for displaying the augmented reality map comprises determining that the angle of the handheld communication device with respect to the ground is between 45 degrees and 180 degrees. 
     
     
         8 . The method of  claim 2 ,
 wherein augmenting the video stream, being displayed on the display in real-time, with information identifying the point of interest or the street comprises: presenting a navigational instruction overlaid on the video stream, and   wherein displaying map information in the map view that is different than the augmented reality map comprises: displaying a navigational instruction on a two-dimensional map.   
     
     
         9 . A handheld communication device including a processor, an image capture component, and a display, the handheld communication device being configured to perform operations comprising:
 determining a current angle of the handheld communication device;   determining whether the current angle meets one or more criteria for displaying an augmented reality map that displays captured images augmented with additional information;   responsive to determining that the current angle meets the one or more criteria, displaying the augmented reality map at least by:
 capturing, by the handheld communication device, a video stream using the image capture component; 
 displaying, on the display, the video stream in real-time as the video stream is being captured; 
 augmenting the video stream, being displayed on the display in real-time, with information identifying a point of interest or a street that is within a field of view of the handheld communication device; 
   responsive to determining that the current angle does not meet the one or more criteria for displaying the augmented reality map: displaying, on the display, map information in a map view that is different than the augmented reality map.   
     
     
         10 . The handheld communication device of  claim 9 , wherein the operations further comprise determining the field of view of the handheld communication device at least by:
 detecting a geographic position of the handheld communication device and a camera direction of a camera of the image capture component; and   determining a field of view based on the geographic position and the camera direction.   
     
     
         11 . The handheld communication device of  claim 9 , wherein the operations further comprise determining the field of view of the handheld communication device using a compass corresponding to the handheld communication device. 
     
     
         12 . The handheld communication device of  claim 9 , wherein the current angle of the handheld communication device is measured with respect to the ground. 
     
     
         13 . The handheld communication device of  claim 9 , wherein the criteria for displaying the augmented reality map comprises a range of angles for the handheld communication device, and wherein the method further comprises determining the range of angles based on at least one of: (a) an environment of the handheld communication device or (b) user preferences. 
     
     
         14 . The handheld communication device of  claim 9 , wherein determining that the current angle meets the criteria for displaying the augmented reality map comprises determining that the angle of the handheld communication device with respect to the ground is between 45 degrees and 180 degrees. 
     
     
         15 . The handheld communication device of  claim 9 ,
 wherein augmenting the video stream, being displayed on the display in real-time, with information identifying the point of interest or the street comprises: presenting a navigational instruction overlaid on the video stream, and   wherein displaying map information in the map view that is different than the augmented reality map comprises: displaying a navigational instruction on a two-dimensional map.   
     
     
         16 . One or more non-transitory media comprising instructions which, when executed by one or more hardware processors, cause performance of a method by handheld communication device including a processor, an image capture component, and a display, the method comprising:
 determining a current angle of the handheld communication device;   determining whether the current angle meets one or more criteria for displaying an augmented reality map that displays captured images augmented with additional information;   responsive to determining that the current angle meets the one or more criteria, displaying the augmented reality map at least by:
 capturing, by the handheld communication device, a video stream using the image capture component; 
 displaying, on the display, the video stream in real-time as the video stream is being captured; 
 augmenting the video stream, being displayed on the display in real-time, with information identifying a point of interest or a street that is within a field of view of the handheld communication device; 
   responsive to determining that the current angle does not meet the one or more criteria for displaying the augmented reality map: displaying, on the display, map information in a map view that is different than the augmented reality map.   
     
     
         17 . The one or more non-transitory media of  claim 16 , wherein the method further comprises determining the field of view of the handheld communication device at least by:
 detecting a geographic position of the handheld communication device and a camera direction of a camera of the image capture component; and   determining a field of view based on the geographic position and the camera direction.   
     
     
         18 . The one or more non-transitory media of  claim 16 , wherein the method further comprises determining the field of view of the handheld communication device using a compass corresponding to the handheld communication device. 
     
     
         19 . The one or more non-transitory media of  claim 16 , wherein the current angle of the handheld communication device is measured with respect to the ground. 
     
     
         20 . The one or more non-transitory media of  claim 16 , wherein the criteria for displaying the augmented reality map comprises a range of angles for the handheld communication device, and wherein the method further comprises determining the range of angles based on at least one of: (a) an environment of the handheld communication device or (b) user preferences. 
     
     
         21 . The one or more non-transitory media of  claim 16 , wherein determining that the current angle meets the criteria for displaying the augmented reality map comprises determining that the angle of the handheld communication device with respect to the ground is between 45 degrees and 180 degrees. 
     
     
         22 . The one or more non-transitory media of  claim 16 ,
 wherein augmenting the video stream, being displayed on the display in real-time, with information identifying the point of interest or the street comprises: presenting a navigational instruction overlaid on the video stream, and   wherein displaying map information in the map view that is different than the augmented reality map comprises: displaying a navigational instruction on a two-dimensional map.

Join the waitlist — get patent alerts

Track US2023417567A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.