Systems and methods for analyzing metadata tag relevance ratings for cohesiveness

Abstract

A content item may be associated with metadata comprising one or more tags. A user may indicate a relevance rating associated with a tag. The relevance rating may indicate whether the user feels the tag is relevant to the associated content item. Using a plurality of user-provided relevance ratings, a tag relevance model may be established. A tag relevance model may comprise a weighted or un-weighted average and/or median relevance rating of the tag and/or a cohesiveness of the of the relevance ratings. Rating cohesiveness may be used to identify controversial tags. Tag relevance information may be used to order search results. Tag ratings may also be used to aggregate users into groups comprising users having a similar point of view relative to one or more tag ratings. In addition, users may be grouped according to content access and/or tags rated regardless of the relevance rating applied.

1 . A method for presenting relevance ratings of user-submitted metadata tags, comprising:
 receiving a plurality of user-submitted metadata tags, each metadata tag associated with a respective content item;   providing for a community of users to submit relevance ratings of the metadata tags, each relevance rating indicating how relevant a metadata tag is to a respective content item;   calculating a statistical consistency level of the relevance ratings of each of the metadata tags; and   providing for displaying the consistency level of the relevance ratings of a metadata tag in association with the metadata tag to a user on a display.   
     
     
         2 . The method of  claim 1 , wherein calculating a statistical consistency level of metadata tag relevance ratings comprises calculating a deviation of the metadata tag relevance ratings. 
     
     
         3 . The method of  claim 1 , further comprising ordering a search result comprising a plurality of content items based upon respective consistency levels of relevance ratings of metadata tags of the search result content items. 
     
     
         4 . The method of  claim 1 , further comprising:
 determining a cohesiveness of the relevance ratings of each of the metadata tags; and   ordering content items in a search result based upon the cohesiveness of the relevance ratings of metadata tags of the search result content items.   
     
     
         5 . The method of  claim 1 , further comprising:
 identifying controversial metadata tags using the respective statistical consistency levels of the relevance ratings of the metadata tags; and   ordering content items in a search result based upon whether metadata tags of content items in the search result comprise controversial metadata tags.   
     
     
         6 . The method of  claim 1 , further comprising assigning rating weights to the users in the user community, wherein the rating weight assigned to a user is based upon relevance ratings of metadata tags submitted by the user, and wherein the user rating weights determine the relative weight afforded to relevance ratings submitted by the users. 
     
     
         7 . The method of  claim 6 , further comprising calculating an average relevance rating of a metadata tag by applying a respective user rating weight to each relevance rating of the metadata tag. 
     
     
         8 . The method of  claim 6 , further comprising providing for displaying a content item and an associated metadata tag to a user, the display comprising an indicator of an average relevance rating of the metadata tag and an indicator of a consistency level of the relevance ratings of the metadata tag. 
     
     
         9 . A non-transitory computer-readable storage medium comprising instructions to cause a computing device to perform a method for presenting relevance ratings of user-submitted metadata tags, the method comprising:
 receiving a plurality of user-submitted metadata tags, each metadata tag pertaining to a respective content item;   providing for a community of users to submit relevance ratings of the metadata tags, each relevance rating indicating how relevant a metadata tag is to a respective content item;   calculating a statistical consistency level of the relevance ratings of each of the metadata tags; and   identifying controversial metadata tags using the statistical consistency levels of the relevance ratings of the metadata tags.   
     
     
         10 . The non-transitory computer-readable medium of  claim 9 , wherein calculating a statistical consistency level of metadata tag relevance ratings comprises calculating a deviation of the metadata tag relevance ratings. 
     
     
         11 . The non-transitory computer-readable medium of  claim 9 , the method further comprising ordering a search result comprising a plurality of content items based upon respective consistency levels of relevance ratings of metadata tags of the search result content items. 
     
     
         12 . The non-transitory computer-readable medium of  claim 9 , the method further comprising ordering content items in a search result based upon whether metadata tags of content items in the search result comprise controversial metadata tags. 
     
     
         13 . The non-transitory computer-readable medium of  claim 9 , the method further comprising assigning rating weights to the users in the user community, wherein the rating weight assigned to a user is based upon relevance ratings of metadata tags submitted by the user, and wherein the user rating weights determine the relative weight afforded to relevance ratings submitted by the users. 
     
     
         14 . The non-transitory computer-readable medium of  claim 9 , the method further comprising:
 calculating an average relevance rating of each of the metadata tags; and   providing for displaying a content item and an associated metadata tag to a user, the display comprising an indicator of an average relevance rating of the metadata tag and an indicator of a consistency level of the relevance ratings of the metadata tag.   
     
     
         15 . A system for managing relevance ratings of user-submitted metadata tags, comprising:
 a computer-readable storage medium comprising a plurality of content items, each content item being associated with respective metadata tags;   a server configured to receive metadata tag relevance ratings submitted by users of a user community over a network, each rating the relevance of a respective metadata tag as pertaining to a respective content item,   wherein the server calculates a statistical consistency level of relevance ratings of each of the metadata tags, and   wherein the server provides for storing the relevance ratings of each of the plurality of metadata tags and the consistency levels of the relevance ratings of each metadata tag on the computer-readable storage medium.   
     
     
         16 . The system of  claim 15 , wherein statistical consistent level of a metadata tag comprises a standard deviation of the relevance ratings of the metadata tag. 
     
     
         17 . The system of  claim 15 , wherein the server calculates an average relevance rating of each metadata tag. 
     
     
         18 . The system of  claim 17 , wherein the server provides an interface to display a content item and an associated metadata tag, and wherein the user interface displays an indicator of an average relevance rating of the metadata tag and an indicator of a statistical consistency level of the relevance ratings. 
     
     
         19 . The system of  claim 15 , wherein the server provides an interface to display a content item and an associated metadata tag, and wherein the user interface comprises an input to receive a user-submitted rating of the relevance of the associated metadata tag as pertaining to the content item. 
     
     
         20 . The system of  claim 15 , wherein the server orders a search result comprising a plurality of content items based upon consistency levels of relevance ratings of metadata tags associated with the content items. 
     
     
         21 . The system of  claim 15 , wherein the server identifies controversial metadata tags using the respective statistical consistency levels of the relevance ratings of the metadata tags, and orders content items in a search result based upon whether metadata tags of the content items in the search result are associated with controversial metadata tags.