Licenced Defined Assessor Types - Managing

This article has been updated to reflect the enhancements that will be available after Friday 2 May as part of the May 2025 Release.

Assessor types are used to define the privileges that a group of assessors has, thereby allowing your institution to define its own assessor types to best fit the marking practices. Assessor types also provide the opportunity to furnish assessors with flow-level instructions on the marking role they have been assigned.

Assessor types are firstly defined at the licence level by the licence administrator but can be adjusted at the flow level by the manager.

For more information about managing assessor types at the licence level, please see our article Licence Defined Assessor Types - Licence Administration.

At the Flow Level

Manage Assessor Types on the the Flow

Managers can control the assessor types on a flow by clicking Manage assessors from the managing flow page.

The upper pane of the pop-up window shows the assessor types that that are currently available on the flow, as determined by the licence administrator. 

1. Amount on flow: Displays the number of assessors on the flow that have been assigned that assessor type.
2. Description: Displays the description of the assessor type as defined by the Licence Administrator
3. Assessor instructions: Displays an excerpt from the instructions that will be displayed to the assessor.
4. Privileges/Settings: Use the icon to access a list of the privileges and available feedback sharing states, including the default, that are associated with the assessor type.
5. Toggle columns: Selecting which columns you would like displayed in the table.
   
6. Edit: Edit the instructions, the assigned privileges and/or the sharing states to suit the flow. Any changes will be applicable to the current flow only. The original assessor type created at the licence level will not be affected. Changes that are required to be reflected for all newly created flows must be edited at the licence level by the licence administrator.
   
7. Remove from flow: Remove the assessor type from the flow.

The lower pane shows the remaining assessor types, defined by the licence administrator, that can be added to the current flow as necessary.

Once added to the flow, the assessor type's instructions and/or privileges can be edited as necessary.

Manage Assessors on the Flow

Managers can assign assessor types when adding assessors to a flow.

Once assessors have been selected, choose an assessor type from the dropdown list.

Once selected, the associated privileges and feedback sharing states, including the default, become visible in the table.

Grade Finalisation Trigger

In the Work Distribution table on the same page, you can decide how many of each assessor type is required to submit scores/grades to trigger the ability to finalise the grade, when working with the Marker Agreement marking model.

First, go to the setting for Grade Finalisation Trigger in Manage Settings:

There are two options:

• All allocated assessors has submitted: This means that all assessors allocated to a participant must submit their marking in order to be able to agree the final grade with the other assessors.
• Exactly this number of these assessor types: It is possible to define the number of types of assessors that must submit their marking in order to be able to agree the final grade (see below).

Selecting Exactly this number of these assessor types, allows the manager to define the minimum number of assessors from selected assessor types that are required to submit their marking before they can reach an agreement.

In this example, we can see from the Work Distribution table (in the Manage Assessors on the Flow section), that four assessors in total have been added to the flow, two internal assessors and two external assessors (these are the assessor types). Each assessor has been allocated to all participants.

In the image just above, the grade finalisation trigger has been set to one internal assessor and one external assessor. This means that despite there being four assessors allocated to each participant, it will only take one internal assessor and one external assessor to trigger the ability to finalise the grade through marker agreement.

If more than the minimum number of assessors from a specified assessor type submit marking, WISEflow will take the marking in timestamp order i.e. whoever submits first.

 

Back on the Work Distribution page, clicking the Finalisation trigger button will display the finalisation rules that have been set on the flow.

Assessor View

Once an assessor has been assigned an assessor type, this information appears on their flow page.

The information can be accessed by the icon, displaying the instructions and the associated privileges

(Please note that this appears on the legacy flow page only. The assessor types and accompanying privileges and feedback sharing states, including the default, are coming to the new flow page soon.)

Grade Justifications

Assessor types can be used to manage grade justifications.

Settings for grade justifications can be found under Tools alongside the participant list.

The setting Allow grade justification request in WISEflow allows you to enable participants being able to request a grade justification from within WISEflow. Simply click the edit icon and check the tick box.

The setting Assign grade justification to assessor type allows you to select an assessor type. All grade justification requests will then be automatically be forwarded to the assessor assigned that assessor type. Note that if there is more than one assessor with the selected assessor type, any grade justification requests will remain unassigned.

The two settings Allow grade justification request in WISEflow and Assign grade justification to assessor type have been moved from Manage settings under Marking and review. They are now located under Tools as described above.

Additional Material for Assessors and Reviewers

Assessors and reviewers can be provided with marking guidance and other material, as files and/or links, according to their assessor type.

Click on the Additional material for assessors and reviewers button under Marking and review on the flow page. Click on Add file or Add link for either Marking guidance or Other material.

Once you have added a file or link, select the assessors types that should be able to see them.