Content monitoring in a high volume on-line community application

Abstract

Disclosed are embodiments a system and method for managing an on-line community. Electronic postings are pre-screened based on one or more metrics to determine a risk value indicative of the likelihood that an individual posting contains objectionable content. These metrics are based on the profile of a poster, including various parameters of the poster and/or the poster's record of objectionable content postings. These metrics can also be based on the social network profile of a poster, including the average of various parameters of other users in the poster's social network and/or a compiled record of objectionable content postings of other users in the poster's social network. If the risk value is relatively low, the posting can be displayed to the on-line community immediately. If the risk value is relatively high, display of the posting can be delayed until further content analysis is completed. Finally, if the risk value is above a predetermined high risk threshold value, the posting can be removed automatically.

1 . A system for managing an on-line community, said system comprising:
 a database adapted to store a plurality of metrics based on information related to users of said on-line community, wherein said information comprises parameters associated with each of said users, records of objectionable content postings for each of said users, and social networks of each of said users wherein said objectionable content is defined by preset standards; and   a content management system in communication with said database and adapted to monitor postings from users to said on-line community for said objectionable content,   wherein said content management system comprises a pre-screener adapted to determine, based on at least one predetermined metric, a risk value that indicates a likelihood that a given posting by a given user contains said objectionable content, and   wherein said content management system is further adapted to allow said given posting to be displayed to said on-line community, if said risk value is below a threshold value.   
   
   
       2 . The system of  claim 1 , all the limitations of which are incorporated herein by reference, wherein said at least one predetermined metric comprises at least one of the following:
 a metric based on parameters associated with said given user;   a metric based on a record of objectionable content postings by said given user;   a metric based on average predetermined parameters associated with other users in a social network of said given user;   a metric based on a compiled record of objectionable content postings by other users in a social network of said given user, wherein said other users in said social network have a direct relationship with said given user; and   a metric based on a compiled record of objectionable content postings by other users in a social network of said given user, wherein at least some of said other users in said social network have an indirect relationship with said given user.   
   
   
       3 . The system of  claim 1 , all the limitations of which are incorporated herein by reference, wherein said content management system is further adapted to automatically remove said given posting of said given user, if said risk value is above a second threshold value. 
   
   
       4 . The system of  claim 1 , all the limitations of which are incorporated herein by reference, wherein said content management system further comprises a content filter adapted to analyze content of each of said postings to determine an objectionable content score, wherein an order in which each of said postings is analyzed is based on said risk value. 
   
   
       5 . The system of  claim 1 , all the limitations of which are incorporated herein by reference, wherein said content management system further comprises a content filter adapted to analyze content of each of said postings to determine an objectionable content score, wherein said objectionable content score is weighted based on said risk value. 
   
   
       6 . A method for managing an on-line community, said method comprising:
 receiving postings to said on-line community from users;   prior to analyzing each of said postings for objectionable content, as determined by preset standards, determining for each given posting from each given user a risk value based on at least one predetermined metric, wherein said risk value indicates a likelihood that said given posting by said given user contains said objectionable content; and,   if said risk value is below a threshold value, displaying said given posting to said on-line community.   
   
   
       7 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, wherein said at least one predetermined metric comprises a metric based on parameters associated with said given user. 
   
   
       8 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, wherein said at least one predetermined metric comprises a metric based on a record of objectionable content postings by said given user. 
   
   
       9 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, wherein said at least one predetermined metric comprises a metric based on average parameters associated with other users in a social network of said given user. 
   
   
       10 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, wherein said at least one predetermined metric comprises a metric based on a compiled record of objectionable content postings by other users in a social network of said given user, wherein said other users in said social network have a direct relationship with said given user. 
   
   
       11 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, wherein said at least one predetermined metric comprises a metric based on a compiled record of objectionable content postings by other users in a social network of said given user, wherein at least some of said other users in said social network have an indirect relationship with said given user. 
   
   
       12 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, further comprising, if said risk value is above said threshold value, automatically removing said posting. 
   
   
       13 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, further comprising, if said risk value is above said threshold value, requesting posting confirmation from said given user and notifying said given user of ramifications for violations of said standards. 
   
   
       14 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, further comprising, dynamically determining an order for analyzing said postings for said objectionable content, wherein said order is based on said risk value of each of said postings. 
   
   
       15 . The method of  claim 6 , all the limitations of which are incorporated herein by reference, further comprising, analyzing each of said postings to determine an objectionable content score, wherein said objectionable content score is weighted based on said risk value. 
   
   
       16 . A computer program product comprising a computer useable medium having a computer readable program, wherein said computer readable program when executed causes said computer to perform a method an on-line community, said method comprising:
 prior to analyzing postings to said on-line community from users for objectionable content, as determined by preset standards, determining for each given posting from each given user a risk value based on at least one predetermined metric, wherein said risk value indicates a likelihood that said given posting by said given user contains said objectionable content; and   if said risk value is below a threshold value, displaying said given posting to said on-line community.   
   
   
       17 . The computer program product of  claim 16 , all the limitations of which are incorporated herein by reference, wherein said at least one predetermined metric comprises at least one of the following metrics:
 a metric based on parameters associated with said given user;   a metric based on a record of objectionable content postings by said given user;   a metric based on average parameters associated with other users in a social network of said given user; and   a metric based on a compiled record of objectionable content postings by other users in a social network of said given user, wherein at least some of said other users in said social network have an indirect relationship with said given user.   
   
   
       18 . The computer program product of  claim 16 , all the limitations of which are incorporated herein by reference, wherein said method further comprises, if said risk value is above said threshold value, automatically removing said posting. 
   
   
       19 . The computer program product of  claim 16 , all the limitations of which are incorporated herein by reference, wherein said method further comprises, dynamically determining an order for analyzing said postings for said objectionable content, wherein said order is based on said risk value of each of said postings. 
   
   
       20 . The computer program product of  claim 16 , all the limitations of which are incorporated herein by reference, wherein said method further comprises, analyzing each of said postings to determine an objectionable content score, wherein said objectionable content score is weighted based on said risk value.