WISEflow supports several different workflows which enable assessors and reviewers to collaborate in the marking and grading process. There are two broad methods for organising these workflows, namely Marker agreement and Reviewer Approval and this article will explore some of the nuances of each.
The option can be configured at the flow level and is found on the flow setup page under Marking and review > Manage settings.
Marker Agreement
Marker agreement means that, where more than one assessor is assigned to mark a participant's submission, the assessors are required to converge on the agreed mark before it can be registered as a final grade. Using this method, each assessor submits their marks or grades independently and these are displayed as provisional until both assessors have submitted. Once both assessors have submitted, matching grades will be locked in and confirmed, or the system will indicate where any discrepancies exist and require both assessors to resubmit an agreed mark. This logic applies when several assessors are allocated to the same participant individually or as an assessor group.
It is important to note that if only one assessor is assigned to the participant, their entered grade will carry forward as the final grade without needing to match that of a co-assessor.
Approval by reviewer
As an alternative to marker agreement, the approval by reviewer option enables a reviewer to determine the final grade based on the marking that assessors have submitted. The use of this option requires that a reviewer is assigned and is given the highest level of access on the flow (Decide final grade).
The approval by reviewer option is flexible and can be used to support several different practical applications such as arbitration between two or more internal assessors (as shown in the below screenshot) or establishing assessor hierarchies where one user supervises and approves the work of another.