Methods and systems for use with an evaluation workflow for an evidence-based evaluation

Abstract

Several embodiments provide systems and methods for use in creating an evaluation workflow defining a multiple step evaluation process for use by one or more users variously involved in an evidence-based evaluation. The systems and methods allow the user to define the evaluation workflow and store the evaluation workflow in a database, allow the user to add a plurality of assessments to the evaluation workflow and store the plurality of assessments in association with the evaluation workflow in the database, each assessment defining an evaluation event at a given point in time to be assessed as part of the evaluation process spanning an evaluation period of time, and allow the user to add one or more parts to each of the plurality of assessments and store the one or more parts in association with the plurality of assessments in the database.

What is claimed is: 
     
         1 . A processor-based system for use in creating an evaluation workflow defining a multiple step evaluation process for use by one or more users variously involved in an evidence-based evaluation, comprising:
 at least one processor and at least one memory storing executable program instructions and configured, through execution of the executable program instructions, to provide a user interface displayable to a user to:   allow the user to define the evaluation workflow and store the evaluation workflow in a database;   allow the user to add a plurality of assessments to the evaluation workflow and store the plurality of assessments in association with the evaluation workflow in the database, each assessment defining an evaluation event at a given point in time to be assessed as part of an evaluation process spanning an evaluation period of time; and   allow the user to add one or more parts to each of the plurality of assessments and store the one or more parts in association with the plurality of assessments in the database, wherein at least one part defines one or more items of information to be associated with an assessment and needed for completion of the assessment, wherein each part is associated with a corresponding part type selected by the user from a plurality of selectable part types, wherein the plurality of selectable part types comprises an observation part type, the one or more items of information including one or more of: live observation-related information, a recorded observation; a document file, a populated fillable form, and an external measurement imported from a source external to the evaluation workflow.   
     
     
         2 . The processor-based system of  claim 1  wherein the at least one processor is further configured to: allow the user to assign a scoring weight to one or more of the plurality of assessments and store the scoring weight in the database. 
     
     
         3 . The processor-based system of  claim 1  wherein at least one part of at least one assessment is observation event dependent and wherein at least one part of at least one assessment is observation event independent. 
     
     
         4 . The processor-based system of  claim 1  wherein at least one part of at least one assessment is observation event dependent and corresponds to a pre-observation item of information. 
     
     
         5 . The processor-based system of  claim 1  wherein at least one part of at least one assessment is observation event dependent and corresponds to a post-observation item of information. 
     
     
         6 . The processor-based system of  claim 1  wherein the plurality of assessments includes at least one observation event over a period of time covered by the evaluation workflow. 
     
     
         7 . The processor-based system of  claim 1  wherein the at least one processor is configured to provide the user interface displayable to the user to allow the user to edit one or more of the plurality of assessments. 
     
     
         8 . The processor-based system of  claim 1  wherein the at least one processor is configured to provide the user interface displayable to the user to allow the user to edit one or more parts of the plurality of assessments. 
     
     
         9 . The processor-based system of  claim 1  wherein the at least one processor is configured to provide the user interface displayable to the user to allow the user to change an order in time of the plurality of assessments. 
     
     
         10 . The processor-based system of  claim 1  wherein the at least one processor is configured to provide the user interface displayable to the user to allow the user to change an order in time of one or more parts of the plurality of assessments. 
     
     
         11 . The processor-based system of  claim 1  wherein the evidence-based evaluation is of a teacher and is to be performed by an educational evaluator. 
     
     
         12 . The processor-based system of  claim 11  wherein the evaluation period of time comprises one or more academic school year. 
     
     
         13 . The processor-based system of  claim 11  wherein an evaluation event of at least one assessment comprises an announced observation of the teacher. 
     
     
         14 . The processor-based system of  claim 11  wherein an evaluation event of at least one assessment comprises an unannounced observation of the teacher. 
     
     
         15 . The processor-based system of  claim 11  wherein an evaluation event of at least one assessment comprises a review of the teacher. 
     
     
         16 . The processor-based system of  claim 11  wherein an evaluation event of at least one assessment comprises a data collection event. 
     
     
         17 . The processor-based system of  claim 11  wherein the observation part type comprises at least one of a live observation part type and a recorded observation part type. 
     
     
         18 . The processor-based system of  claim 11  wherein the plurality of selectable part types comprises the observation part type and one or more of a document file part type, a populatable form part type and an external measurement part type. 
     
     
         19 . The processor-based system of  claim 11  wherein the one or more items of information include one or more of: a recorded video observation, a recorded audio observation, a recorded audio and video observation, as pre-observation form, a post-observation form, a photograph, a video file, a lesson plan, a student survey, a teacher survey, an administrator survey, a walk-through survey, a teacher self-assessment, student work data, a student work sample, a standard test score, a teacher review form, teacher review data, a report, student learning objectives, a school district report, and a school district survey. 
     
     
         20 . A computer-implemented method for use in creating an evaluation workflow defining a multiple step evaluation process for use by one or more users variously involved in an evidence-based evaluation, the method using at least one processor and at least one memory, the method comprising:
 allowing a user to define the evaluation workflow and store the evaluation workflow in a database;   allowing the user to add a plurality of assessments to the evaluation workflow and store the plurality of assessments in association with the evaluation workflow in the database, each assessment defining an evaluation event at a given point in time to be assessed as part of an evaluation process spanning an evaluation period of time; and   allowing the user to add one or more parts to each of the plurality of assessments and store the one or more parts in association with the plurality of assessments in the database, wherein at least one part defines one or more items of information to be associated with an assessment and needed for completion of the assessment, wherein each part is associated with a corresponding part type selected by a user from a plurality of selectable part types, wherein the plurality of selectable part types comprises an observation part type, the one or more items of information including one or more of: live observation-related information, a recorded observation, a document file, a populated fillable form, and an external measurement imported from a source external to the evaluation workflow.   
     
     
         21 . A processor-based system for use with an evaluation workflow defining a multiple step evaluation process for use by one or more users variously involved in an evidence-based evaluation, comprising:
 at least one processor and at least one memory storing executable program instructions and configured, through execution of the executable program instructions, to provide a user interface displayable to a user to:   display the evaluation workflow including a plurality of assessments each defining an evaluation event at a given point in time to be assessed as part of an evaluation process spanning an evaluation period of time, wherein each assessment includes one or more parts, wherein at least one part defines one or more items of information to be associated with an assessment and needed for completion of the assessment, wherein each part is associated with a corresponding part type selected by the user from a plurality of selectable part types, wherein the plurality of selectable part types comprises an observation part type, wherein a scoring weight is displayed for one or more of the plurality of assessments;   allow one or more users to associate the one or more items of information to at least one part of at least one assessment, the one or more items of information including two or more of: live observation-related information, a recorded observation; a document file, a populated fillable form, and an external measurement imported from a source external to the evaluation workflow;   allow the one or more users to view the one or more items of information once associated with the at least one part of at least one assessment; and   allow the one or more users to track a progress of the evaluation process from assessment to assessment.   
     
     
         22 . The processor-based system of  claim 21  wherein the processor-based system is programmed to allow the one or more users to associate the one or more items of information comprising a document file to the at least one part of at least one assessment by causing a document file upload interface to be displayed, wherein the document file upload interface comprises one or more of a document file upload field, a document file name field, a document file description field, and a comment field. 
     
     
         23 . The processor-based system of  claim 21  wherein the processor-based system is programmed to allow the one or more users to associate the one or more items of information comprising a populated fillable form to the at least one part of at least one assessment by causing the display of a fillable form interface, wherein the fillable form interface comprises one or more of an free-form text comment, a yes/no selection, a multiple choice selection, a drop-down menu selection, a matrix selection, and a check-box. 
     
     
         24 . The processor-based system of  claim 21  wherein the processor-based system is programmed to determine a completion status of a least one of the plurality of assessments and display the completion status in the user interface displayable to the user. 
     
     
         25 . The processor-based system of  claim 21  wherein the processor-based system is programmed to selectively allow the user to associate the one or more items of information to the at least one part of at least one assessment based on a profile associated with the use. 
     
     
         26 . The processor-based system of  claim 21  wherein the processor-based system is programmed to store received items of information on a database. 
     
     
         27 . The processor-based system of  claim 21  wherein the evaluation workflow corresponds to an teacher and is to be performed by an educational evaluator. 
     
     
         28 . The processor-based system of  claim 27  wherein an evaluation event of at least one assessment comprises at least one of an announced observation of the teacher, an unannounced observation of the teacher, a review of the teacher, and a data collection event. 
     
     
         29 . The processor-based system of  claim 27  wherein the observation part type comprises at least one of a live observation part type and a recorded observation part type. 
     
     
         30 . The processor-based system of  claim 27  wherein the plurality of selectable part types comprises the observation part type and one or more of a document file part type, a populatable form part type and an external measurement part type. 
     
     
         31 . The processor-based system of  claim 27  wherein the one or more items of information include one or more of: a recorded video observation, a recorded audio observation, a recorded audio and video observation, as pre-observation form, a post-observation form, a photograph, a video file, a lesson plan, a student survey, a teacher survey, an administrator survey, a walk-through survey, a teacher self-assessment, student work data, a student work sample, a standard test score, a teacher review form, teacher review data, a report, student learning objectives, a school district report, and a school district survey. 
     
     
         32 . A computer-implemented method for use in with an evaluation workflow defining a multiple step evaluation process for use by one or more users variously involved in an evidence-based evaluation, the method comprising:
 displaying the evaluation workflow including a plurality of assessments each defining an evaluation event at a given point in time to be assessed as part of an evaluation process spanning an evaluation period of time, wherein each assessment includes one or more parts, wherein at least one part defines one or more items of information to be associated with an assessment and needed for completion of the assessment, wherein each part is associated with a corresponding part type selected by the user from a plurality of selectable part types, wherein the plurality of selectable part types comprises an observation part type, wherein a scoring weight is displayed for one or more of the plurality of assessments;   allowing one or more users to associate the one or more items of information to at least one part of at least one assessment, the one or more items of information including two or more of: live observation-related information, a recorded observation; a document file, a populated fillable form, and an external measurement imported from a source external to the evaluation workflow;   allowing the one or more users to view the one or more items of information once associated with the at least one part of at least one assessment; and   allowing the one or more users to track a progress of the evaluation process from assessment to assessment.