Digital signage platform providing device, operating method thereof, and system including digital signage platform providing device

Abstract

Disclosed are a digital signage platform providing apparatus, an operating method thereof, and a system including the same. By calculating a reference point of a building area for displaying content information related to a plurality of pieces of POI information based on sensing data of a vehicle and floor number information and spatial coordinates for the building area, rendering AR digital signage corresponding to the content information in one or more AR display areas determined based on the calculated reference point, and providing the rendering result to a user terminal, the result may be mapped, on a floor-by-floor basis, to an AR display area of a building in a driving image acquired through a vision sensor. Accordingly, it is possible to overcome the limitation of displaying only one advertisement and maximize an advertisement effect to provide a plurality of various advertisements in one building.

What is claimed is: 
     
         1 . A digital signage platform providing apparatus comprising:
 a communication module configured to communicate with a user terminal and a cloud server;   a memory; and   at least one processor operably connected to the memory and configured to execute at least one computer-readable program included in the for:
 receiving sensing data of a vehicle associated with the user terminal and transmitting a request to the cloud server for map information in response to a request received from the user terminal; 
 calculating, based on the received map information, spatial coordinates for a building area and acquiring floor number information for each of a plurality of POI information associated with the building area; 
 calculating at least one reference point of the building area based on the sensing data of the vehicle and the spatial coordinates and the-floor number information for the building area; 
 performing a rendering for displaying one or more augmented reality (AR) digital signage corresponding to the-content information related to the plurality of POI information at one or more AR display areas of the building area determined based on the calculated at least one reference point; and 
 transmitting a rendering result to the user terminal for mapping the AR digital signage on the one or more AR display areas of the building area as displayed in a driving image acquired at the vehicle. 
   
     
     
         2 . The digital signage platform providing apparatus of  claim 1 , wherein the one or more AR display areas are determined using the floor number information for each of the plurality of POI information and height information of the building area calculated based on the spatial coordinates for the building area. 
     
     
         3 . The digital signage platform providing apparatus of  claim 2 , wherein the one or more reference points are calculated by detecting reference coordinates of the building area in the driving image based on a driving direction and location of the vehicle. 
     
     
         4 . The digital signage platform providing apparatus of  claim 3 , wherein at least one of the location or shape of each of the one or more AR display areas is corrected by the processor on the basis of a result of a comparison of the height information of each of the one or more AR display areas and data included in the received map information. 
     
     
         5 . The digital signage platform providing apparatus of  claim 1 , wherein based on not being able to acquire the spatial coordinates for the building area based on the received map information, the one or more AR display areas are determined using floor number information and height information of the building area estimated using camera sensing information included in the sensing data. 
     
     
         6 . The digital signage platform providing apparatus of  claim 5 , wherein the at least one reference point is calculated based on detecting edges of the building area in the driving image and a driving direction of the vehicle. 
     
     
         7 . The digital signage platform providing apparatus of  claim 2 , wherein_
 an image correction request is transmitted by the processor such that each of the one or more AR display areas is spaced apart from the at least one reference point by a height corresponding to the floor number information.   
     
     
         8 . The digital signage platform providing apparatus of  claim 1 , wherein the AR digital signage is mapped to surround at least one side of the building area in the driving image. 
     
     
         9 . The digital signage platform providing apparatus of  claim 1 , wherein the content information includes at least one of a brand trademark, a 3D model, a still image, or a moving image related to the POI information. 
     
     
         10 . The digital signage platform providing apparatus of  claim 1 , wherein an image correction request for the AR digital signage is transmitted based on the at least one reference point and a driving direction and speed of the vehicle. 
     
     
         11 . The digital signage platform providing apparatus of  claim 10 , wherein when the driving direction of the vehicle is toward the at least one reference point, an image correction request is transmitted by the processor for that-dynamically adjusting a shape change ratio of the AR digital signage in the display area of the driving image based on the driving speed of the vehicle. 
     
     
         12 . The digital signage platform providing apparatus of  claim 11 , wherein the image correction request for the dynamic adjustment of the shape change ratio of the AR digital signage is transmitted only when the driving speed of the vehicle satisfies a predetermined speed limit. 
     
     
         13 . The digital signage platform providing apparatus of  claim 10 , wherein a stop request for stopping output of the AR digital signage is transmitted by the processor based on an angular change in the driving direction of the vehicle being greater than or equal to a preset threshold value. 
     
     
         14 . A method of providing a digital signage platform, the method comprising:
 receiving sensing data of a vehicle and transmitting a request to a cloud server for map information in response to a request received from a user terminal;   calculating, based on the received map information, spatial coordinates for a building area and acquiring floor number information for each of a plurality of POI information associated with the building area;   calculating at least one reference point of the building area based on the sensing data of the vehicle and the spatial coordinates and the-floor number information for the building area;   performing a rendering fordisplaying one or more augmented reality (AR) digital signage corresponding to the-content information related to the plurality of POI information at one or more ARdisplay areas of the building area determined based on the calculated at least one reference point; and   transmitting a rendering result to the user terminal for mapping the AR digital signage on the one or more AR display areas of the building area as displayed in a driving image acquired at the vehicle.   
     
     
         15 . The method of  claim 14 , wherein the one or more AR display areas are determined using the floor number information for each of the plurality of pieces of POI information and height information of the building area calculated based on the spatial coordinates for the building area. 
     
     
         16 . The method of  claim 15 , wherein_ is transmitted such that each of the one or more AR display areas is spaced apart from the at least one reference point by a height corresponding to the floor number information. 
     
     
         17 . The method of  claim 15 , wherein the AR digital signage is mapped to surround at least one side of the building area in the driving image. 
     
     
         18 . The method of  claim 14 , wherein when-based on not being able to acquire the spatial coordinates for the building area based on the received map information, the one or more AR display areas are determined using floor number information and height information of the building area estimated using camera sensing information included in the sensing data. 
     
     
         19 . The method of  claim 14 , further comprising transmitting the-an image correction request for the AR digital signage based on the at least one reference point and a driving direction and speed of the vehicle. 
     
     
         20 . A digital signage providing system comprising:
 a user terminal linked with a vehicle; and   a digital signage platform providing apparatus configured to communicate with the user terminal and a cloud server,   wherein the digital signage platform providing apparatus is configured to:
 receive sensing data of the vehicle and transmit a request to the cloud server for map information in response to a request received from the user terminal; 
 calculate, based on the received map information, spatial coordinates for a building area and acquire floor number information for each of a plurality of pieces of POI information associated with the building area; 
 calculate at least one a reference point of the building area based on the sensing data of the vehicle and the spatial coordinates and the floor number information for the building area; and 
 perform a rendering based on an augmented reality (AR) engine for displaying one or more AR digital signage corresponding to content information related to the plurality of POI information at one or more AR display areas of the building area determined based on the calculated at least one reference point, 
   wherein the user terminal is configured to:
 receive a rendering result; 
 map the AR digital signage on the one or more AR display areas of the building area as displayed in a driving image acquired at the vehicle; 
 output the mapped driving image; 
 receive an image correction request from the digital signage platform providing apparatus; and 
 update the output image of the AR digital signage in response to the image correction request.