Ar display device for vehicle and method for operating same

Abstract

An Augmented Reality (AR) display device interoperating with a vehicle and a method for operating the same are disclosed. An AR display device interoperating with a vehicle according to the present disclosure can display a current driving state of the vehicle while the vehicle is traveling and display a guide related to a predicted next driving situation on a navigation screen using an AR graphic interface. At this time, the AR display device can guide a predicted driving situation in advance by separating and locating a part of the AR graphic interface at a predetermined distance ahead of a predicted location, and allow the separated part of the AR graphic interface to move as the vehicle travels so as to display a guide trajectory along which the vehicle is supposed to travel. This can provide more intuitive and realistic AR guidance to the vehicle.

1 . An augmented reality, AR, display device for a vehicle comprising:
 a communication module configured to receive image data including a front image of the vehicle, location data including a current location of the vehicle, and map data relating to the current location of the vehicle;   a processor configured to activate a preset application to render an AR graphic interface overlapping the front image, the AR graphic interface including a first AR object indicating a current driving state of the vehicle and a second AR object indicating a guide for driving based on the current location of the vehicle and the map data; and   a display configured to display a navigation screen including the front image overlapped by the AR graphic interface according to the rendering,   wherein the processor is further configured to render the AR graphic interface in the manner of selectively separating the second AR object from the first AR object or joining the second AR object to the first AR object on the navigation screen.   
     
     
         2 . The AR display device of  claim 1 , wherein the processor is further configured to change the AR graphic interface based on data corresponding to a next driving situation of the vehicle predicted based on the map data and the current location of the vehicle updated. 
     
     
         3 . The AR display device of  claim 2 , wherein the AR graphic interface is changed at a second location that is at a predetermined distance ahead of a first location where the next driving situation of the vehicle starts, or that is a location that the vehicle passes at a predetermined time point prior to reaching the first location. 
     
     
         4 . The AR display device of  claim 1 , wherein the communication module is further configured to receive navigation information of the vehicle,
 any one of a first condition and a second condition is determined based on at least one of the map data, the current location, and the navigation information of the vehicle, and   wherein the processor is configured to render the AR graphic interface by joining the first and second AR objects to each other on the navigation screen when the first condition is satisfied, and by separating the first and second AR objects from each other on the navigation screen when the second condition is satisfied, the separated second AR object indicating the predicted next driving situation.   
     
     
         5 . The AR display device of  claim 4 , wherein the processor is further configured to:
 render, under the first condition, a panel region including AR objects associated with driving information of the vehicle to overlap a predetermined region of the front image, and   update, under the second condition, the panel region to be hidden or inclined while the separated second AR object indicates the next driving situation.   
     
     
         6 . The AR display device of  claim 1 , wherein the communication module is further configured to receive sensing data of the vehicle,
 the data corresponding to the next driving situation of the vehicle includes road shape information that is predicted based on at least one of the map data and sensing data of the vehicle and the current location of the vehicle, and   wherein the processor is configured to update the AR graphic interface to reflect a change of the road shape information.   
     
     
         7 . The AR display device of  claim 6 , wherein the AR graphic interface is rendered to rotate in a first direction based on a vehicle wheel angle corresponding to the road shape information, and
 wherein the processor is configured to update the AR graphic interface in a manner that a degree of distortion or a difference of rotation angles between first and second AR objects increases as the vehicle wheel angle increases.   
     
     
         8 . The AR display device of  claim 6 , wherein the AR graphic interface is rendered to rotate in a second direction based on a slope angle corresponding to the road shape information, and
 wherein the processor is configured to change the AR graphic interface in a manner that a direction and degree of a rotation angle of the second AR object is changed relative to the first AR object according to a direction and degree of the slope angle.   
     
     
         9 . The AR display device of  claim 1 , wherein the processor is configured to:
 render the second AR object to be separated from the first AR object and rotated relative to the first AR object while the first AR object shows the current driving state of the vehicle, in response to recognition of a route search state of the vehicle as the next driving situation of the vehicle, and   update the AR graphic interface in a manner that the separated first and second AR objects are joined together, in response to an end of the route search state of the vehicle.   
     
     
         10 . The AR display device of  claim 1 , wherein the communication module is further configured to receive sensing data and navigation information of the vehicle,
 and the processor is configured to change the AR graphic interface to include a notification of a driving warning situation of the vehicle in which a problem associated with the driving of the vehicle is recognized or anticipated, wherein the driving warning situation is recognized or anticipated based on the sensing data and navigation information of the vehicle.   
     
     
         11 . The AR display device of  claim 10 , wherein the processor is configured to change at least one of color, shape, blinking, and highlighting of the AR graphic interface when speeding of the vehicle is recognized or anticipated as the driving warning situation. 
     
     
         12 . The AR display device of  claim 3 , wherein the communication module is further configured to receive sensing data of the vehicle, and
 when turning is determined as the next driving situation of the vehicle based on the map data and the current location of the vehicle, preferably further based on the sensing data of the vehicle, the processor is configured to update the AR graphic interface such that the second AR object is separated to indicate at least one of direction and route of the turning at the second location while the first AR object indicates a current driving direction of the vehicle.   
     
     
         13 . The AR display device of  claim 12 , wherein the processor is configured to:
 keep displaying the second AR object separated from the first AR object to guide a next route for the vehicle to travel, in response to the current location of the vehicle approaching the second location within a predetermined distance, and   update the AR graphic interface by joining the first and second AR objects together, in response to the current location of the vehicle passing the second location.   
     
     
         14 . The AR display device of  claim 1 , wherein the processor is configured to:
 receive destination information from navigation information of the vehicle through the communication module, and   update the AR graphic interface such that the second AR object is separated and points to the first location, when the current location of the vehicle reaches the second location.   
     
     
         15 . A method of presenting an augmented reality, AR, interface on an AR display device for a vehicle, comprising:
 receiving image data including a front image of the vehicle;   receiving location data including a current location of the vehicle;   receiving map data relating to the current location of the vehicle;   activating a preset application to render an AR graphic interface to overlap the front image, the AR graphic interface including a first AR object indicating a current driving state of the vehicle and a second AR object indicating a guide for driving at least on the basis of the current location of the vehicle and the map data; and   generating signals for displaying a navigation screen including the front image overlapped by the AR graphic interface according to the rendering,   wherein the rendering of the AR graphic interface comprises selectively separating the second AR object from the first AR object or joining the second AR object to the first AR object on the navigation screen.