Navigation device linked to vehicle, ar platform apparatus, ar platform system comprising same, and operation method

Abstract

Disclosed are a navigation device linked to a vehicle, an augmented reality (AR) platform apparatus, an AR platform system including the same, and an operating method thereof. The navigation device linked to the vehicle may operate to present an AR coupon in a driving image acquired through a vision sensor of the vehicle and to download a coupon corresponding to the AR coupon when the vehicle passes through a physical location corresponding to a display area where the AR coupon is displayed. By providing coupon information filtered based on user information and/or sensing data of the vehicle as an AR coupon in the driving image of the vehicle, it is possible to intuitively provide coupon information useful and suitable for a driver.

1 . A navigation device for a vehicle, the navigation device comprising:
 a display;   a communication unit configured to communicate with a system for providing an augmented reality (AR) platform;   a coupon service interface configured to communicate with a server for managing coupons through an interface of the system; and   a control unit configured to:
 transmit, to the system, a request for associating coupon information from the coupon service interface with a current location of the vehicle with map information; 
 receive, from the system, an AR matching result which comprises filtered coupon information associated with point of interest (POI) information of the map information, wherein the filtered coupon information is filtered based on sensing data of the vehicle; 
 transmit, to the system, a rendering request for displaying an AR coupon corresponding to the filtered coupon information in a display area determined based on the location of the POI information; 
 receive a rendering result and map and display via the display the AR coupon in the display area included in a driving image acquired through a vision sensor of the vehicle in real time; 
 download a coupon corresponding to the AR coupon based on a distance between the vehicle and a physical location corresponding to the display area of the AR coupon; and 
 transmit information related to the downloaded coupon to the system and request the system to upload the information related to the downloaded coupon to the server for managing coupons. 
   
     
     
         2 . The navigation device of  claim 1 , wherein the coupon is downloaded based on the current location of the vehicle and a physical location corresponding to the display area of the AR coupon being less than or equal to a predetermined threshold distance as determined based on the sensing data. 
     
     
         3 . The navigation device of  claim 1 , wherein the transmitted information related to the downloaded coupon comprises user information, point-of-interest (POI) information, and coupon information corresponding to the downloaded coupon. 
     
     
         4 . The navigation device of  claim 1 , wherein the coupon is downloaded in response to a selection input for the AR coupon displayed in the display area of the driving image. 
     
     
         5 . The navigation device of  claim 1 , wherein the display area is associated with the current location of the vehicle and a preset destination. 
     
     
         6 . The navigation device of  claim 5 , wherein based on the preset destination being set as the POI information and a distance from the current location of the vehicle to the preset destination is greater than or equal to a threshold distance range, the display area is determined as a front or a side of a building corresponding to the POI information and the AR coupon is displayed in the display area in a digital signage form. 
     
     
         7 . The navigation device of  claim 5 , wherein based on the preset destination being set as the POI information and a distance from the current location of the vehicle to the preset destination is less than a threshold distance range, the display area is set as an AR carpet on a road in the driving image for guiding entry to the preset destination and the AR coupon is displayed on the AR carpet. 
     
     
         8 . The navigation device of  claim 7 , wherein a varied AR coupon is mapped and displayed on the front or side of a building corresponding to the POI information in the driving image in a digital signage form while the AR coupon is displayed on the AR carpet. 
     
     
         9 . The navigation device of  claim 1 , wherein the coupon is downloaded when the vehicle passes through a physical location of the POI information corresponding to the AR coupon. 
     
     
         10 . The navigation device of  claim 1 , wherein a plurality of coupons corresponding to a plurality of AR coupons are downloaded when the vehicle enters physical location corresponding to the POI information, and information related to the plurality of downloaded coupons is transmitted to the system. 
     
     
         11 . The navigation device of  claim 1 , wherein
 the control unit is further configured to display identification information for sharing the downloaded coupon with a mobile terminal, wherein the mobile terminal scans the displayed identification information to download the coupon on the basis of user authentication.   
     
     
         12 . An augmented reality (AR) platform providing apparatus linked to a vehicle, the AR platform providing apparatus comprising:
 a communication module configured to communicate with a navigation device linked to the vehicle;   a coupon management interface configured to communicate with a server for managing coupons;   a memory; and   at least one processor communicatively connected to the memory and configured to execute at least computer-readable program included in the memory,   wherein the at least one program includes instructions to:
 receive coupon information associated with a current location of the vehicle from the server and associate the coupon information with map information in response to a request received from the navigation device; 
 filter the received coupon information on the basis of sensing data of the vehicle; 
 perform rendering for displaying an AR coupon corresponding to the filtered coupon information in a display area determined based on point-of-interest (POI) information corresponding to the coupon information; 
 transmit a rendering result to the navigation device and transmit a request for the navigation device to map and display an AR coupon corresponding to the rendering result in a display area included in a driving image acquired through a vision sensor in real time; and 
 transmit registration information of a coupon corresponding to the AR coupon to the server for downloading the AR coupon based on a distance between the location of the vehicle and a physical location corresponding to the display area to which the AR coupon is mapped. 
   
     
     
         13 . The AR platform providing apparatus of  claim 12 , wherein the registration information of the coupon includes coupon information, a usage status, an expiration date, POI information, and user information of the coupon. 
     
     
         14 . The AR platform providing apparatus of  claim 12 , wherein the filtering of the received coupon information is performed based on the sensing data of the vehicle including status information of the vehicle, information on the current location of the vehicle, information on a preset destination, and information on a driving time of the vehicle. 
     
     
         15 . The AR platform providing apparatus of  claim 12 , wherein
 the communication module comprises a sub-module configured to perform communication with a mobile terminal, and   wherein the at least one program further includes instructions for the at least one processor to, in response to receiving a signal for accessing the AR platform providing apparatus through a preset application, request the mobile terminal to perform user authentication and download a coupon uploaded to the server on the basis of the user authentication.   
     
     
         16 . The navigation device of  claim 12 , wherein based on a determination using the sensing data of the vehicle that a distance between the current location of the vehicle and a physical location corresponding to the display area of the AR coupon is less than or equal to a predetermined threshold distance, the at least one processor downloads the coupon corresponding to the AR coupon, transmits the coupon to the navigation device, and transmits information related to the downloaded coupon to the server. 
     
     
         17 . An augmented reality (AR) platform providing system comprising:
 a server for managing coupons;   an AR platform providing apparatus configured to communicate with the server;   a navigation device linked to a vehicle; and   a mobile terminal,   wherein
 the AR platform providing apparatus receives coupon information associated with a current location of the vehicle from the server and associates the coupon information with map information in response to a request received from the navigation device, filters the received coupon information on the basis of sensing data of the vehicle, and performs rendering for displaying an AR coupon corresponding to the filtered coupon information in a display area determined based on point-of-interest (POI) information corresponding to the coupon information, 
 the navigation device receives a rendering result, maps and displays, in real time, an AR coupon corresponding to the received result in a display area included in a driving image acquired through a vision sensor, downloads a coupon corresponding to the AR coupon when it is detected that the vehicle approaches within a certain range from a physical location corresponding to the display area of the AR coupon, and transmits information related to the downloaded coupon to the system to request the system to upload the information related to the downloaded coupon to the server, 
 the server performs validation of the information related to the downloaded coupon received from the system and stores the information related to the downloaded coupon in a database and registers the coupon on the basis of a result of the validation, and 
 the mobile terminal executes a preset application to access the AR platform providing apparatus and downloads a coupon uploaded to the server on the basis of a result of the user authentication.