Computer-aided system for 360° heads up display of safety / mission critical data

Abstract

A safety critical, time sensitive data system for projecting safety/mission critical data onto a display pair of Commercial Off The Shelf (COTS) light weight projection glasses or monocular creating an immersive omnidirectional HUD (Heads Up Display) system with 6 degrees of freedom movement with user immersion and user inputs & outputs. The system includes the display, haptic glove, haptic suit, vestibular interface, temperature emulation, smell emulation, and omnidirectional sound, the workstation, the application software, and inputs containing the safety/mission critical information (Current User Position, Total Collision Avoidance System—TCAS, Global Positioning System—GPS, Magnetic Resonance Imaging—MRI Images, CAT scan images. Weather data. Military troop data, real-time space type markings etc.). The workstation software processes the incoming safety/mission critical data and converts it into a three dimensional space for the user to immerse into the environment. Selecting any of the images may display available information about the selected item or may enhance the image, or moving hand or body will generate enhanced environmental perception & awareness, as well as inputs and outputs. Predicted position vectors may be displayed as well as 3D terrain.

What is claimed is: 
     
         1 . A system for displaying and updating data in three dimensions, comprising:
 a computer system connected to a communications network and configured to process data regarding multiple locations and create a virtual three dimensional orthogonal space wherein the data is associated with multiple locations in the virtual three dimensional orthogonal space;   a wearable display device connected to the computer system;   a head-tracking sensing sensor system connected to the wearable display device and to the computer system, configured to sense the movement and orientation of the wearable display device in real-time;   an eye-tracking sensor system connected to the wearable display device and to the computer system, configured to sense the eye movement of a user wearing the wearable display device in real-time; wherein the computer system is configured to receive real-time data from the head-tracking sensing system and the eye-tracking sensor system and to process said real-time data to generate an image of the virtual three dimensional orthogonal space for display on the wearable display device;   a pair of haptic gloves in communication with the computer system; and   a haptic suit in communication with the haptic gloves and the computer system;   wherein parts of an aircraft may be augmented to the user via the wearable display device so that the user can repair the aircraft.   
     
     
         2 . The system of  claim 1 , further comprising a second computer system in communication with the first computer system via a communication network to share information about spaces of interest. 
     
     
         3 . The system of  claim 1 , wherein the suit and gloves are both capable of delivering a temperature, humidity, pinching, electric shock, and aroma sensation to the user. 
     
     
         4 . The system of  claim 1 , wherein the user can activate a virtual keyboard display and interact with the virtual keyboard display using the haptic gloves. 
     
     
         5 . The system of  claim 1 , wherein:
 the system is configured to display the virtual three dimensional orthogonal space from the point of view of a selected object;   the system is configured to update the image of the virtual three dimensional orthogonal space based on movement of the user's head;   the system is configured to allow selection and manipulation of the image data by combining eye tracking and head tracking;   the system is configured to allow a vision impaired user to see; and   the computer system is configured to record the data of the virtual three dimensional orthogonal space over a specified time period.   
     
     
         6 . The system of  claim 1 , wherein the parts of the aircraft comprise electrical lines and hydraulic lines. 
     
     
         7 . An enhanced virtual reality device, comprising:
 a processor configured to process data regarding multiple locations and create a virtual three dimensional orthogonal space;   a display device in operative communication with the processor;   a head-tracking sensing sensor system coupled to the display device and configured to sense the movement and orientation of the display device in real-time;   an eye-tracking sensor system connected to the wearable display device and to the computer system, configured to sense the eye movement of a user wearing the wearable display device in real-time; wherein the computer system is configured to receive real-time data from the head-tracking sensing system and the eye-tracking sensor system and to process said real-time data to generate an image of the virtual three dimensional orthogonal space for display on the wearable display device; and   a haptic suit in operative communication with the processor for providing a plurality of sensory functions, wherein the display device is configured to highlight a surface terrain visible through the display device.   
     
     
         8 . The enhanced virtual reality device of  claim 7 , wherein:
 the enhanced virtual reality device is configured to display the virtual three dimensional orthogonal space from the point of view of a selected object;   the enhanced virtual reality device is configured to update the image of the virtual three dimensional orthogonal space based on movement of the user's head;   the enhanced virtual reality device is configured to allow selection and manipulation of the image data by combining eye tracking and head tracking;   the enhanced virtual reality device is configured to allow a vision impaired user to see; and   the enhanced virtual reality device is configured to record the data of the virtual three dimensional orthogonal space over a specified time period.