Assessment with a rubric allows the assessment to be more transparent and controlled for the assessor and the participant. Rubrics have two forms: standard or custom. These are created by authors in WISEflow. This article focuses on assessment with a standard rubric which calculates a mean score based on a predefined set of criteria and rankings.
For custom rubric assessment, see the article Assessing with a Custom Rubric.
Technically, the rubrics addition to WISEflow, comes in two parts: The rubric and the mark converter. Both of these can be added to the flow individually by the assessor (see the article: Adding your own rubrics or mark converter) if they have not been defined by the manager beforehand. Furthermore, the mark converter can be enforced or unenforced:
- Enforced - The mark is solely dependent on and decided by the rubric score
- Unenforced - The mark is only guided by the rubric score and can be changed by the assessor without reopening.
This article will go over assessing a standard rubric, where the manager has defined the rubric and enforcement before the assessment. When you open the flow page, open the assessment tool (previously called Annotate), as usual.
- Filling out the rubric
- Mark converter
As you enter the assessment tool, two new sections have been added with the rubric module. (1) In the header menu, a Rubrics section has been added (*). From the assessment tool you also (2) open the rubric window, where you can fill-out and approve the rubric.
(*) Click here for an example: If a mark converter has been added by the manager, the assessor can preview the marking matrix by clicking Mark converter and see whether the converter is enforced or unenforced.
Filling out the rubric
Click the Rubric-button in the top right area of the assessment tool to open the rubric window.
In the standard rubric attached to this flow, we see two criteria: Spelling and Content. Each of these are accompanied by 4 rankings and a commentary field (text or audio). Below is an overview of the rubric window.
- Share the filled rubric with the participant, the co-assessor or both. The default option is private.
- Minimise or open all criteria (example). This feature allows the assessor to better see rubrics with large numbers of criteria. Furthermore, if the criteria fill out the rubric window, it is possible to scroll up or down.
- Minimise or open a criteria.
- Criteria weighting. The weight defines how much the criteria affects the calculated mean score of the rubric.
- Click the rank box, turning the text green, to choose this ranking for the respective criteria. Hold over each rank box to see a tooltip with the description (example).
- Text commentary field.
- Audio commentary field. Click the red dot to record.
- Number of assessed criteria.
- Approve the rubric.
When approving the rubric, the feature is changed according to whether or not a mark converter has been added by the manager.
As mentioned, you can open the header menu to preview the mark converter and see whether or not it has been added or enforced. This leaves assessing a rubric with three scenarios: enforced mark converter, unenforced mark converter, and no mark converter has been added.
Enforced mark converter
In the header menu you can preview the mark converter and see that it is mandatory.
When you click Approve rubric in the bottom of the rubric window, you are shown the mean score (1) of the rubric. This score is never shown to the participant, even if the rubric is shared as feedback. The resulting mark (2) calculated from the mark converter matrix is also shown.
Click Approve rubric and register assessment to register (not submit) the mark for the participant.
When the mark converter is enforced, the assessment is solely decided by the rubric score. Therefore, the assessor cannot change the mark, except by reopening the rubric (3) and reassessing the criteria.
Unenforced mark converter
In the header menu, you can preview the mark converter and see described that it is not mandatory.
Approving the rubric is exactly the same as with enforced mark converter. However, after approving the rubric, it is possible to change the registered mark without reopening the rubric by opening the participant menu.
No mark converter
In the header menu, you can see that there is no mark converter associated with the flow.
When approving the rubric, you have to manually choose the mark given by the rubric mean score.
Like with unenforced mark converter, the assessor can change the mark afterwards without reopening the rubric.