Assessment with a rubric allows the assessment to be more transparent and controlled for the assessor and the participant. Rubrics have two forms: standard or custom. These are created by authors in WISEflow. This article focuses on assessing with a custom rubric, which calculates the points of an assignment based on the answers to a set of questions input by the assessor. The custom rubric is very similar to a normal FLOWmulti exam set, in that the author can fully customise and the questions and points calculated.
For standard rubric, see article Assessing with a Standard Rubric.
Technically, the rubrics addition to WISEflow, comes with two parts: the rubric and the mark converter. Both of these can be added to the flow individually by the assessor (see the article: Adding your own rubrics or mark converter), if they have not been defined by the manager beforehand. Furthermore, the mark converter can be enforced or unenforced:
- Enforced - The mark is solely dependent on and decided by the rubric score
- Unenforced - The mark is only guided by the rubric score and can be changed by the assessor without reopening.
This article will go over assessing a custom rubric, where the manager has defined the rubric and enforcement before the assessment. When you open the flow page, open the assessment tool (previously named Annotate), as usual.
- Filling out the rubric
- Mark converter
As you enter the assessment tool, two new sections have been added with the rubric module. (1) In the header menu, a Rubrics section has been added (*). From the assessment tool you also (2) open the rubric window, where you can fill-out and approve the rubric.
(*) Click here for an example: If a mark converter has been added by the manager, the assessor can preview the marking matrix by clicking Mark converter and see whether the converter is enforced or unenforced.
Filling out the rubric
Click the Rubric-button in the top right area of the assessment tool to open the Rubric window.
In the custom rubric attached to this flow, we see that the rubric has 3 questions with yes or no answers. Furthermore, we see that there are more than one section, indicated by the blue Next button and the "0/6" questions answered below it.
- Share the filled rubric with the participant, the co-assessor or both. The default option is private.
- A question. Answers are indicated by the colour yellow.
- Go to the previous section.
- Go to the next section.
- Number of answered questions.
- Approve the rubric.
When approving the rubric, the feature is changed according to whether or not a mark converter has been added by the manager.
As mentioned, you can open the header menu to preview the mark converter and see whether or not it has been added or enforced. This leaves marking a rubric with three scenarios: enforced mark converter, unenforced mark converter, and no mark converter has been added.
Enforced mark converter
In the header menu, you can preview the mark converter and see that it is mandatory.
When you click Approve rubric in the bottom of the rubric window, you are shown the mean score (1) of the rubric. This score is never shown to the participant, even if the rubric is shared as feedback. The resulting mark (2) calculated from the mark converter matrix is also shown.
Click Approve rubric and register assessment to register (not submit) the mark for the participant.
When the mark converter is enforced, the assessment is solely decided by the rubric score. Therefore, the assessor cannot change the mark, except by reopening the rubric (3) and reassessing the criteria.
Unenforced mark converter
In the header menu, you can preview the mark converter and see described that it is not mandatory.
Approving the rubric is exactly the same as with enforced mark converter. However, after approving the rubric, it is possible to change the registered mark without reopening the rubric by opening the participant menu.
No mark converter
In the header menu, you can see that there is no mark converter associated with the flow.
When approving the rubric, you have to manually choose the mark given by the rubric mean score.
Like with unenforced mark converter, the assessor can change the mark afterwards without reopening the rubric.