Display device interworking with vehicle and operating method thereof

Abstract

Disclosed are a display device linked to a vehicle and an operating method thereof. More specifically, the display device may communicate with a system to display AR digital signage on a building in a driving image of the vehicle on a floor-by-floor basis. Also, by mapping and displaying AR digital signage that has been displayed on the building on a floor-by-floor basis on an AR carpet displayed on a road in the driving image while the vehicle is about to or is expected to enter the building, it is possible to significantly enhance visibility and ensure safe driving.

1 . A display device linked to a vehicle, the display device comprising:
 a communication unit configured to communicate with a system for providing a digital signage platform;   a display configured to display a driving image of the vehicle acquired through a vision sensor; and   a control unit configured to:
 transmit to the system, via the communication unit, a request for point of interest (POI) information associated with sensing data of the vehicle
 recognize a spatial location of a building area including at least a plurality of pieces of POI information detected by the system; 
 transmit a first request for generating augmented reality (AR) digital signage corresponding to content information related to the plurality of pieces of POI information on a floor-by-floor basis of the building area based on the sensing data of the vehicle, the spatial location of the building area, and floor number information for each piece of POI information; 
 transmit a second request for generating an AR carpet for display on the driving image for guiding entry into the building area based on driving-related information included in the sensing data of the vehicle; 
 
 receive results corresponding to the first request and the second request; and 
 display an AR carpet corresponding to the result of the second request on a road in the driving image to be provided as a display area and map to the display area at least some images of AR digital signage corresponding to the result of the first request in response to the vehicle satisfying conditions for determining that the vehicle is to enter the building area. 
   
     
     
         2 . The display device of  claim 1 , wherein the at least some images of the AR digital signage corresponding to the result of the first request are initially displayed on the building area in floor order on the basis of a location and a driving direction of the vehicle. 
     
     
         3 . The display device of  claim 1 , wherein:
 the first request includes a command to extract floorwise representative POI information, and   an order of display of the AR digital signage on the AR carpet corresponds to a floor order of the floorwise representative POI information.   
     
     
         4 . The display device of  claim 1 , wherein whether the vehicle satisfies the conditions is determined based on at least one of a current location of the vehicle, driving-related information of the vehicle, characteristics of the building area, a correlation between the building area and a destination, or user preference. 
     
     
         5 . The display device of  claim 1 , wherein:
 the at least some images of the AR digital signage corresponding to the result of the first request are initially mapped and displayed on the building area in the driving image; and   the AR carpet is displayed in the driving image to include guidance route information in response to the vehicle approaching within a certain range from the building area with a driving speed less than or equal to a threshold range.   
     
     
         6 . The display device of  claim 5 , wherein the control unit is further configured to:
 determine that the vehicle is about to enter the building area based on the driving-related information of the vehicle; and   change a mapping of the at least some images of the AR digital signage from the building area of the driving image to the AR carpet.   
     
     
         7 . The display device of  claim 6 , wherein the control unit is further configured to:
 gradually reduce a number of images of the AR digital signage displayed on the building in the driving image on a floor-by-floor basis in response to the vehicle approaching the building area; and   transmit a rendering request to map the at least some images of the AR digital signage to the AR carpet instead at a certain time after the AR carpet is displayed.   
     
     
         8 . The display device of  claim 1 , wherein:
 based on one of the plurality of pieces of the POI information being set as a destination of the vehicle, the control unit displays an image of AR digital signage of a floor corresponding to the destination in the display area in response to the vehicle approaching the building area.   
     
     
         9 . The display device of  claim 8 , wherein an image of AR digital signage of the floor corresponding to the destination and images of AR digital signage of other floors are displayed such that they are visually distinct from each other. 
     
     
         10 . The display device of  claim 1 , wherein the control unit is further configured to vary a transparency of the AR carpet and the at least some images of the AR digital signage in response to detecting an obstacle in the display area of the AR carpet in the driving image. 
     
     
         11 . The display device of  claim 1 , wherein the control unit is further configured to stop displaying the AR carpet and map and displays the at least some images of the AR digital signage in another display area of the driving image to in response to detecting an obstacle in the display area of the AR carpet in the driving image. 
     
     
         12 . An operating method of a display device linked to a vehicle, the method comprising:
 performing a connection to a system for providing a digital signage platform in response to a user input;   transmitting a request to the system for point of interest (POI) information associated with sensing data of the vehicle;   recognizing a spatial location of a building area including a plurality of pieces of POI information detected by the system;   transmitting a first request for generating augmented reality (AR) digital signage corresponding to content information related to the plurality of pieces of POI information on a floor-by-floor basis of the building area based on the sensing data of the vehicle, the spatial location of the building area, and floor number information for each piece of POI information;   transmitting a second request for generating an AR carpet for display on a driving image of the vehicle acquired through a vision sensor for guiding entry into the building area based on driving-related information included in the sensing data of the vehicle;   receiving results corresponding to the first request and the second request; and   displaying an AR carpet corresponding to the result of the second request on a road in the driving image to be provided as a display area and mapping to the display area at least a portion of AR digital signage corresponding to the result of the first request in response to the vehicle satisfying conditions for determining that the vehicle is to enter the building area.   
     
     
         13 . The operating method of  claim 12 , wherein the AR digital signage corresponding to the result of the first request is initially displayed on the building area in floor order on the basis of a location and a driving direction of the vehicle. 
     
     
         14 . The operating method of  claim 12 , wherein whether the vehicle satisfies the conditions is determined based on at least one of a current location of the vehicle, driving-related information of the vehicle, characteristics of the building area, a correlation between the building area and a destination, or user preference. 
     
     
         15 . The operating method of  claim 12 , wherein
 the AR digital signage corresponding to the result of the first request is initially mapped and displayed on the building area of the driving image; and   the AR carpet is displayed in the driving image to include guidance route information in response to the vehicle approaching within a certain range from the building area with a driving speed less than or equal to a threshold range.