FLOWmulti: Convert points to assessments

Depending on the the way the manager has set up a flow, point-based assessment for an assessor can take two forms - assessors are assigned to participants or assessors are assigned to sections. This guide will try to explain a run through an example of the former, assigned to participants. See FLOWmulti: Point-based assessment - assigned to section for the latter.

• Assessment
• Converting points to assessments

Assessment

When the manager of a FLOWmulti has assigned assessors to participants, the assessor has the choice of assessing and marking each participant individually, or to ease-up the process and more objectively assess the participant, use point-based assessment.

In the example that we will go through in this guide, we have a small test with 5 pages - 1 essay question (not eligible for automatic assessment) worth -1/2 points and 4 simple multiple-choice questions worth -1/1 points. The maximum and minimum points where chosen when the activity for the test was created.

No matter what assessment method is chosen, the assessor should first go through the exam sections, re-checking the automatic assessment of the system and scoring sections that are not eligible for automatic assessment. Participant one, section 1 first.

1. Click the  button to add an annotation to the page. This opens the annotation editor on the right side of your screen.
   Note: To the right of the add-button, you see the current score of the section. This section has an automatically assessed score of 0, because it could not be assessed by the system (due to it being an essay).
2. (Optional) Here you can write a comment for you annotation (reasoning behind the score). This is mostly used when annotations are shared with participants or co-assessors (4).
3. Choose addition or subtraction from the current point score of the section.
   Note: The amount of points the assessor can add here is unlimited, allowing the assessor to give or take extra points for remarkable answers etc.
4. Choose sharing options (share with participants, co-assessors or both).
5. Close the editor. There is no Save-button as annotations are saved as you edit it.

When you have created the annotation, notice that the score of the section 1 is now 2 points.

Now we go through section 2 of participant 1.

This section was a simple multiple-choice question, and therefore it is eligible for automatic assessment. On section 2, we see that the system has given the section 1/1 point. If the automatic assessment has been setup incorrectly or in any other way has malfunctioned, the assessor can add or subtract points from the assessment as before.

The rest of the sections are the same as section 2. From our run through of participant 1, we can determine that we only need to manually score the points of section 1 for all of the assigned participants. To quickly go through section 1 for all participants, click on the bottom of section 1 to quickly skip to this section for the next participant.

Converting points to assessments

To mark the participants with point-based assessment, click the flow name in the top and click "Convert points to assessments".

This opens the assessment window.

1. The mark converter.
   • Show the marks and how participants are distributed between the marks.
   • Drag the dividing points between mark left or right to change the distribution.
   • Maximum and minimum score is determined by the maximum and minimum score achieved by the participants. You can increase or decrease these as you see fit.

   Note: Any changes made to the mark converter is personal. It will not be shared with any co-assessors.

2. Participant table.
   • An overview table of the participant IDs, names, whether they have handed in etc.
   • The participants' score according to the assessors editing.
   • The participants' currently calculated mark according to their score and the mark converter.
   • The mark given to the participant. If you have manually assigned or edited the mark (Student name > set assessment) these will also show up here. This means that "assessment from distribution" and "assessment" do not have to be the same.
3. Save the distribution settings made in the mark converter (for next time you open "Convert points to assessments") or set the final assessment of all participants according to the distribution settings made in the mark converter.

Now the only thing needed is to register (submit) the assessments as usual.