System and method for the robust implementation of AR applications on vehicles

Abstract

A system and method robustly displays augmented reality (AR) applications on a vehicle. The system has a mobile terminal that is configured to execute an AR application on the vehicle, wherein the AR application includes a display of AR contents on the vehicle using a three-dimensional grid. The mobile terminal has at least one sensor that is configured to capture physical sensor data relating to a position of the mobile terminal. The mobile terminal has a capture unit that is configured to capture a predefinable fixed point on the vehicle. The mobile terminal further includes a computing unit that is configured to evaluate the physical sensor data and the captured fixed point and to display the AR contents on the vehicle in a contact-analog manner.

What is claimed is: 
     
       1. A system for robust display of augmented reality (AR) applications on a vehicle, comprising:
 a mobile terminal that is configured to execute an AR application on the vehicle, wherein the AR application comprises a display of AR contents on the vehicle using a three-dimensional grid; 
 wherein the mobile terminal comprises:
 at least one sensor that is configured to capture physical sensor data relating to a position of the mobile terminal; 
 a capture unit that is configured to capture exactly one predefinable fixed point on the vehicle, wherein the predefinable fixed point corresponds to a feature on the vehicle; and 
 a computing unit that is configured to evaluate the physical sensor data and the captured fixed point and to display the AR contents on the vehicle in a contact-analog manner, and 
 
 wherein the evaluation of the physical sensor data and of the captured fixed point comprises using the captured fixed point to initialize the three-dimensional grid. 
 
     
     
       2. The system according to  claim 1 , wherein
 the mobile terminal comprises an input and output unit that is configured to receive a user input; and 
 the computing unit is configured to augment the AR contents with the user input. 
 
     
     
       3. The system according to  claim 1 , wherein the evaluation of the physical sensor data and of the captured fixed point further comprises:
 determining an exact relative position of the mobile terminal with respect to the captured fixed point; 
 determining an exact relative position of the vehicle with respect to the mobile terminal; 
 initializing the three-dimensional grid for the display of the AR contents on the vehicle in a contact-analog manner; and 
 displaying the AR contents in a contact-analog manner via simultaneous localization and mapping (SLAM). 
 
     
     
       4. The system according to  claim 1 , wherein the AR contents comprise at least one of:
 damage present on the vehicle; 
 an operating instruction for the vehicle; 
 an accessory for the vehicle; 
 a repair on the vehicle; or 
 informational content on the vehicle. 
 
     
     
       5. A method for robust display of augmented reality (AR) applications on a vehicle, comprising:
 executing, via a mobile terminal, an AR application on the vehicle, wherein the AR application comprises a display of AR contents on the vehicle using a three-dimensional grid; 
 wherein the executing of the AR application on the vehicle comprises:
 capturing, via at least one sensor, physical sensor data relating to a position of the mobile terminal; 
 capturing, via a capture unit, exactly one predefinable fixed point on the vehicle, wherein the predefinable fixed point corresponds to a feature on the vehicle; and 
 displaying, via a computing unit, the AR contents on the vehicle in a contact-analog manner after evaluation of the physical sensor data and of the captured fixed point by the computing unit, and 
 
 wherein the evaluation of the physical sensor data and of the captured fixed point comprises using the captured fixed point to initialize the three-dimensional grid. 
 
     
     
       6. The method according to  claim 5 , further comprising:
 receiving, via an input and output unit on the mobile terminal, a user input; and 
 augmenting, via the computing unit, the AR contents with the received user input. 
 
     
     
       7. The method according to  claim 5 , wherein the evaluation of the physical sensor data and of the captured fixed point further comprises:
 determining an exact relative position of the mobile terminal with respect to the captured fixed point; 
 determining an exact relative position of the vehicle with respect to the mobile terminal; 
 initializing the three-dimensional grid for the display of the AR contents on the vehicle in a contact-analog manner; and 
 displaying the AR contents in a contact-analog manner via simultaneous localization and mapping (SLAM). 
 
     
     
       8. The method according to  claim 5 , wherein the AR contents comprise at least one of:
 damage present on the vehicle; 
 an operating instruction for the vehicle; 
 an accessory for the vehicle; 
 a repair on the vehicle; or 
 informational content on the vehicle.