Reduced Bias Submission Review System

Abstract

A reduced bias submission review system distributed on one or more servers operably coupled to one or more client computing devices over a network supports a program including computer executable instructions accessible by browser based on-line processing to enable one or more clients to submit a plurality of submissions for submission review and depending on the application repeatedly serves the plurality of submissions in a prioritized order to a plurality of reviewers until each of the plurality of submissions receives a pre-selected target number of submission reviews or until each of the plurality of reviewers performs the preselected target number of submission reviews.

1 - 16 . (canceled) 
     
     
         17 . A computer, comprising:
 a processor communicatively coupled to a non-transitory memory containing a computer code, said computer code including:
 a submission receiving module which functions to receive a plurality of submissions from a plurality of submitters; 
 a submission group generator module which allocates said plurality of submissions into one or more submission groups; 
 a submission server module which functions to serve said plurality of submissions included one of said submission group to a plurality of reviewers; 
 a submission review target number assignment module which functions to associate a pre-selected target number of submission reviews to each of said plurality of submissions within said submission group; 
 repeatedly serve said plurality of submissions in said submission group to said plurality of reviewers until each of said plurality of submissions receives said pre-selected target number of submission reviews associated with said submission group. 
   
     
     
         18 . The computer of  claim 17 , further comprising a submission priority order module which functions to serve said plurality of submissions in said submission group to said plurality of reviewers in a prioritized order. 
     
     
         19 . The computer of  claim 18 , further comprising a submission priority order module which functions to:
 determine a number of submission reviews associated with each one of said plurality of submissions within said submission group; and   serve said plurality of submissions in said submission group to said plurality of reviewers based on having a fewest number of submission reviews within said submission group.   
     
     
         20 . The computer of  claim 19 , wherein said priority order module further functions to:
 determine submission date associated with each one said plurality of submissions within said submission group; and   serve said plurality of submissions in said submission group to said plurality of reviewers based on having an earliest submission date.   
     
     
         21 . The computer of  claim 20 , further comprising submission review rank module which generates a plurality of submission review ranks corresponding to said pre-selected target number of submission reviews. 
     
     
         22 . The computer of  claim 21 , wherein said submission server module further functions to repeatedly serve each of said plurality of submissions in said submission group to said plurality of reviewers until each one of said plurality of submissions in said submission group receives a submission review in a first one of said plurality of submission review ranks prior to serving each of said plurality of submissions in said submission group to said plurality of reviewers to receive said submission review in a second one of said plurality of submission review ranks. 
     
     
         23 . The computer implemented system of  claim 22 , further comprising a submission review allocation module which functions to:
 determine number of reviews associated with each reviewer within said plurality of reviewers; and   serve said plurality of submissions in said submission group to said reviewer within said plurality of reviewers having fewest submitted reviews.   
     
     
         24 . The computer of  claim 23 , wherein said submission review allocation module correspondingly associates each submission review with said reviewer having performed said submission review within said plurality of reviewers. 
     
     
         25 . The computer of  claim 24 , further comprising a submission review edit module which functions retrieve submission reviews performed by said reviewer, and receives edits of said submission reviews from said reviewer. 
     
     
         26 . The computer of  claim 22 , further comprising a user interface module which functions to depict a submissions list including said plurality of submissions against said plurality of submission review ranks, each one of said plurality of submission review ranks correspondingly including a submission review indicator field associated with each of said plurality of submissions in said submissions list. 
     
     
         27 . The computer of  claim 26 , wherein said user interface module further functions to depict, upon receiving a submission review, a submission review indicator in one of said plurality of submission review indicator fields corresponding to said submission associated with said submission review. 
     
     
         28 . The computer of  claim 27 , wherein said plurality of submissions comprise electronic media content. 
     
     
         29 . The computer of  claim 28 , wherein said electronic media content is selected from the group consisting of: electronic text or graphics, video recordings, audio recordings, multimedia presentations, slide presentations, spreadsheets, or combinations thereof 
     
     
         30 . The computer of  claim 17 , further comprising a submitter group generation module which functions to allocate each of said plurality of submitters to one of a plurality of submitter groups. 
     
     
         31 . The computer of  claim 30 , wherein said submission group generator module further functions to allocate said plurality of submissions from one of said plurality of submitter groups into a corresponding one of said one or more submission groups. 
     
     
         32 . The computer of  claim 30 , further comprising a reviewer roster generation module which functions to associate each of said plurality of reviewers to one of a plurality of reviewer rosters, each of said plurality of reviewer rosters correspondingly served said plurality of submissions included in one of said one or more submission groups. 
     
     
         33 . The computer of  claim 31 , wherein said reviewer roster generation module further functions to allocate said plurality of submitters in a submitter group to generate a corresponding one said reviewer rosters. 
     
     
         34 . The computer of  claim 32 , further comprising a target submission review allocation module which functions to associate a pre-selected target number of submission reviews to each of said plurality of reviewers. 
     
     
         35 . The computer of  claim 34 , wherein submission server module further functions to serve said plurality of submissions included in one of said submission groups to said plurality of reviewers until each of said plurality of reviewers submits said pre-selected target number of submission reviews. 
     
     
         36 . The computer of  claim 35 , wherein said priority order module further functions to:
 determine a number of submission reviews performed by each of said plurality of reviewers; and   serve said plurality of submissions in said submission group to one of said plurality of reviewers having submitted the fewest reviews.   
     
     
         37 - 48 . (canceled)