Ar display device for vehicle and method for operating same

Abstract

An Augmented Reality (AR) display device interoperating with a vehicle and a method for operating the same are disclosed. An AR display device according to the present disclosure can recognize an occurrence of a notification event related to a driving lane based on ADAS sensing data of the vehicle, map data relating to the current location of the vehicle, vehicle data, etc., and accordingly display a guidance associated with a lane to be driven, which corresponds to the notification event, by using a second AR object separated from a first AR object indicating a current driving state of the vehicle.

1 . An augmented reality, AR, display device for a vehicle comprising:
 a communication module configured to receive image data including a front image of the vehicle, location data including a current location of the vehicle, map data relating to the current location of the vehicle, and sensing data of the vehicle;   a processor configured to activate a preset application to render an AR graphic interface overlapping the front image, the AR graphic interface including a first AR object indicating a current driving state of the vehicle and a second AR object indicating a guide for driving based on the current location of the vehicle and the map data; and   a display configured to display a navigation screen including the front image overlapped by the AR graphic interface according to the rendering,   wherein the processor is further configured to update the AR graphic interface, in response to a notification event related to a driving lane recognized based on the sensing data and a current location of the vehicle updated, in a manner that separating the second AR object from the first AR object and rendering to change the separated second AR object into an guide image associated with the driving lane corresponding to the notification event.   
     
     
         2 . The AR display device of  claim 1 , wherein the notification event related to the driving lane of the vehicle comprises any one of changing the driving lane, predicting departure from the driving lane, overtaking a front object, and detecting a collision-impending object within a current driving lane or a lane to be changed. 
     
     
         3 . The AR display device of  claim 1 , wherein the sensing data of the vehicle for recognizing the notification event related to the driving lane includes a combination of ADAS sensing data of the vehicle and one or more of CAN data, GPS information, and navigation information of the vehicle. 
     
     
         4 . The AR display device of  claim 1 , wherein the processor is further configured to update the AR graphic interface, in response to a determination of a change of the driving lane of the vehicle as the notification event based on the sensing data of the vehicle, such that the first AR object is rendered in a current driving lane of the vehicle on the front image and the separated second AR object is rendered to include a plurality of trajectories images toward a driving lane to be changed as the guide image. 
     
     
         5 . The AR display device of  claim 4 , wherein the processor is further configured to detect an object approaching the vehicle based on the sensing data of the vehicle and the map data relating to the current location of the vehicle, and separates at least one of the plurality of trajectories images from the separated second AR object to point a location of the detected object by the separated at least one trajectory image. 
     
     
         6 . The AR display device of  claim 4 , wherein when an object with a possibility of collision is detected in the driving lane to be changed, the processor is further configured to change the plurality of trajectories images to indicate that the driving lane change is not allowed, and update some of the changed trajectories images to indicate a location of the detected object. 
     
     
         7 . The AR display device of  claim 6 , wherein the processor is further configured to update the plurality of trajectories images indicating that the driving lane change is not allowed to be located in the current driving lane or a lane to which the driving lane change is not allowed. 
     
     
         8 . The AR display device of  claim 1 , wherein the processor is further configured to update, in response to a prediction of a departure of the driving lane as the notification event associated with the driving lane of the vehicle, the AR graphic interface such that the first AR object is rendered to indicate a driving pose of the vehicle in the current driving lane and the separated second AR object is rendered to include at least one of a first guide for guiding a change in the driving pose of the vehicle and a second guide for alerting a lane departure so as for the vehicle to keep the lane. 
     
     
         9 . The AR display device of  claim 8 , wherein the processor is further configured to determine a time point for warning departure from the driving lane based on a driving speed of the vehicle, and update the separated second AR object to be changed into the second guide at a location corresponding to an predicted lane departure direction at the determined time point. 
     
     
         10 . The AR display device of  claim 8 , wherein the processor is further configured to update the displayed driving pose indicated by the first AR object and update the separated second AR object to display the first guide at a center of the driving lane, when deviation within the driving lane is determined to exceed a threshold range. 
     
     
         11 . The AR display device of  claim 1 , wherein the processor is further configured to updates the separated second AR object to display a plurality of trajectories images indicating an avoidance route and an overtaking point of a target object, in response to recognition of the overtaking as the notification event related to the driving lane. 
     
     
         12 . The AR display device of  claim 11 , wherein the processor is further configured to render the separated second AR object to be joined with the first AR object when the driving lane change of the vehicle is completed while the vehicle travels along the avoidance route, and
 separate the second AR object from the first AR object to display the plurality of trajectories images indicating a location of a lane to return when a current location of the vehicle approaches the overtaking point of the target object within a predetermined distance.   
     
     
         13 . The AR display device of  claim 11 , wherein during the overtaking, the processor is further configured to update the separated second AR object to keep displaying the plurality of trajectories images to be driven by the vehicle in the separated state until the vehicle completes the overtaking. 
     
     
         14 . The AR display device of  claim 13 , wherein the processor is further configured to update the separated second AR object to include a crossing point of a lane corresponding to the overtaking point of the target object and driving speed information for passing the crossing point between the plurality of trajectories images to be driven by the vehicle, on the basis of the current location of the vehicle and driving state of the vehicle. 
     
     
         15 . The AR display device of  claim 1 , wherein the processor is further configured to determine an avoidance driving lane based on the current location of the vehicle and ADAS sensing data of the vehicle, and update the separated second AR object to display the plurality of trajectories images for the vehicle to travel according to the determination, in response to a detection of a front object with a possibility of collision as the notification event related to the driving lane based on the ADAS sensing data of the vehicle. 
     
     
         16 . The AR display device of  claim 1 , wherein the processor is further configured to calculate, in response to a detection of a front object with a possibility of collision based on ADAS sensing data of the vehicle, a location of the detected front object based on the current location of the vehicle and the ADAS sensing data of the vehicle, and render an alarm object changed depending on the calculated location overlapping the front image.