Imputing knowledge graph attributes to digital multimedia based on image and video metadata

Abstract

Techniques are disclosed herein for imputing attributes to multimedia content (e.g., an image or a video) based on metadata of the multimedia content. An analysis tool of a multimedia service platform evaluates content metadata to identify at least a time and a first location at which the content was captured. The time and first location is correlated with a knowledge graph. The knowledge graph stores information describing a plurality of locations, including the first location. The knowledge graph also stores information describing events scheduled to occur at one or more of the plurality of locations. The analysis tool identifies, from the correlated information, one or more of the attributes of the first location to impute to the content. Thereafter, the analysis tool imputes the identified attributes to the content.

What is claimed is: 
     
         1 . A method for imputing attributes to multimedia content based on metadata of the content, the method comprising:
 evaluating content metadata to identify at least a time and a first location at which the content was captured;   correlating the time and the first location with a knowledge graph, wherein the knowledge graph stores information describing a plurality of locations, including the first location, and describes events scheduled to occur at one or more of the plurality of locations;   identifying, from the correlated information, one or more of the attributes of the first location to impute to the content; and   imputing the identified attributes to the content.   
     
     
         2 . The method of  claim 1 , wherein identified attributes include a name of the first location, an event scheduled to occur at the first location during the time. 
     
     
         3 . The method of  claim 2 , wherein the identified attributes further include at least one of a name of the event, a start time of the event, and a price range of the event. 
     
     
         4 . The method of  claim 1 , further comprising:
 for each attribute imputed to the content, updating a user-attribute matrix to reflect the attribute imputed to the content.   
     
     
         5 . The method of  claim 3 , further comprising:
 evaluating the user-attribute matrix to determine at least a first concept, wherein the first concept is determined based on a co-occurrence between one or more attributes in the user-attribute matrix.   
     
     
         6 . The method of  claim 1 , wherein the data sources includes at least one of an events source, an online encyclopedia source, and a weather source. 
     
     
         7 . The method of  claim 1 , wherein the time and first location are correlated with the knowledge graph within a specified spatiotemporal range. 
     
     
         8 . The method of  claim 1 , wherein the multimedia content is one of an image or a video. 
     
     
         9 . A non-transitory computer-readable storage medium storing instructions, which, when executed on a processor, performs an operation for imputing attributes to multimedia content based on metadata of the image, the operation comprising:
 evaluating content metadata to identify at least a time and a first location at which the content was captured;   correlating the time and the first location with a knowledge graph, wherein the knowledge graph stores information describing a plurality of locations, including the first location, and describes events scheduled to occur at one or more of the plurality of locations;   identifying, from the correlated information, one or more of the attributes of the first location to impute to the content; and   imputing the identified attributes to the content.   
     
     
         10 . The computer-readable storage medium of  claim 9 , wherein identified attributes include a name of the first location, an event scheduled to occur at the first location during the time. 
     
     
         11 . The computer-readable storage medium of  claim 10 , wherein the identified attributes further include at least one of a name of the event, a start time of the event, and a price range of the event. 
     
     
         12 . The computer-readable storage medium of  claim 9 , wherein the operation further comprises:
 for each attribute imputed to the content, updating a user-attribute matrix to reflect the attribute imputed to the content.   
     
     
         13 . The computer-readable storage medium of  claim 12 , wherein the operation further comprises:
 evaluating the user-attribute matrix to determine at least a first concept, wherein the first concept is determined based on a co-occurrence between one or more attributes in the user-attribute matrix.   
     
     
         14 . The computer-readable storage medium of  claim 9 , wherein the data sources includes at least one of an events source, an online encyclopedia source, and a weather source. 
     
     
         15 . The computer-readable storage medium of  claim 9 , wherein the time and first location are correlated with the knowledge graph within a specified spatiotemporal range. 
     
     
         16 . The computer-readable storage medium of  claim 9 , wherein the multimedia content is one of an image or a video. 
     
     
         17 . A system, comprising:
 a processor; and   a memory storing one or more application programs configured to perform an operation for imputing attributes to multimedia content based on metadata of the content, the operation comprising:   evaluating content metadata to identify at least a time and a first location at which the content was captured;   correlating the time and the first location with a knowledge graph, wherein the knowledge graph stores information describing a plurality of locations, including the first location, and describes events scheduled to occur at one or more of the plurality of locations;   identifying, from the correlated information, one or more of the attributes of the first location to impute to the content; and   imputing the identified attributes to the content.   
     
     
         18 . The system of  claim 17 , wherein identified attributes include a name of the first location, an event scheduled to occur at the first location during the time. 
     
     
         19 . The system of  claim 18 , wherein the identified attributes further include at least one of a name of the event, a start time of the event, and a price range of the event. 
     
     
         20 . The system of  claim 17 , wherein the operation further comprises:
 for each attribute imputed to the content, updating a user-attribute matrix to reflect the attribute imputed to the content.   
     
     
         21 . The system of  claim 17 , wherein the data sources includes at least one of an events source, an online encyclopedia source, and a weather source. 
     
     
         22 . The system of  claim 17 , wherein the time and first location are correlated with the knowledge graph within a specified spatiotemporal range. 
     
     
         23 . The system of  claim 17 , wherein the multimedia content is one of an image or a video.