Augmented reality taxi assistant

Abstract

A system and method for providing a blended taxi display for an aircraft is disclosed. The system includes a camera mounted on the aircraft that provides a real time image feed and sensors that provide data display images related to a taxi trajectory for the aircraft. A cockpit display device blends the real time image feed from the camera with the data display images from the sensors to generate an augmented display image for assisting a pilot during taxi operations.

What is claimed is: 
     
         1 . A system for providing a blended taxi display for an aircraft, comprising:
 multiple cameras mounted on the aircraft that provide real time image feeds;   sensors that provide data display images related to a taxi trajectory for the aircraft; and   a cockpit display device that,   blends the real time image feeds from the cameras into a composite real time image feed, and   blends the composite real time image feed with the data display images from the sensors to generate an augmented display image for assisting a pilot during taxi operations.   
     
     
         2 . The system of  claim 1 , where the data display images are provided by a database. 
     
     
         3 . The system of  claim 1 , where the augmented display image may be turned on and off manually by the pilot. 
     
     
         4 . The system of  claim 1 , where the augmented display image is two dimensional (2D). 
     
     
         5 . The system of  claim 1 , where the augmented display image is three dimensional (3D). 
     
     
         6 . The system of  claim 1 , where the augmented display image is displayed on a heads up display (HUD). 
     
     
         7 . The system of  claim 1 , where the augmented display image is displayed on a helmet mounted image. 
     
     
         8 . The system of  claim 1 , where the data display images related to the taxi trajectory for the aircraft include taxiway (TWY) labels. 
     
     
         9 . The system of  claim 1 , where the data display images related to the taxi trajectory for the aircraft are color coded. 
     
     
         10 . A method for providing a blended taxi display for an aircraft, comprising:
 generating a real time image feeds from multiple cameras mounted on the aircraft;   generating data display images related to a taxi trajectory for the aircraft from sensors;   blending the real time image feeds from the cameras into a composite real time image feed;   blending the composite real time image feed with the data display images from the sensors to generate an augmented display image for assisting a pilot during taxi operations; and   displaying the augmented display image on a display device.   
     
     
         11 . The method of  claim 10 , where the data display images are generated by a database. 
     
     
         12 . The method of  claim 10 , where the augmented display image may be turned on and off manually by the pilot. 
     
     
         13 . The method of  claim 10 , where the augmented display image is two dimensional (2D). 
     
     
         14 . The method of  claim 10 , where the augmented display image is three dimensional (3D). 
     
     
         15 . The method of  claim 10 , where the augmented display image is displayed on a heads up display (HUD). 
     
     
         16 . The method of  claim 10 , where the augmented display image is displayed on a helmet mounted image. 
     
     
         17 . The method of  claim 10 , where the data display images related to the taxi trajectory for the aircraft include taxiway (TWY) labels. 
     
     
         18 . The method of  claim 10 , where the data display images related to the taxi trajectory for the aircraft are color coded.