Depending on the the way the manager has setup a flow, point-based assessment for an assessor can take two forms - Assessors are assigned to participants or Assessors are assigned to pages. This guide will try to explain an run through an example of the former, assigned to pages. See FLOWmulti: Point-based assessment - Assigned to pages for the latter.
To the top >>
When the manager of a FLOWmulti has assigned assessors to participants, the assessor has the choice of whether to assess and grade each participant individually or, to ease-up the process and objectify the grade, use point-based assessment.
In the example that will follow the whole guide, we have a small test with 5 pages - 1 essay question (not eligible for automatic assessment) worth -1/2 points and 4 simple multiple choice questions worth -1/1 points. The maximum and minimum points where chosen when the activity for the test was created.
No matter what assessment method is chosen, the assessor should first go through the exam pages, re-checking the automatic assessment of the system and scoring pages that are not eligible to automatic assessment. Participant one, page 1 first.
- Click the button to add an annotation to the page. This opens the annotation editor on the right side of your screen.
Note: to the right of the add-button you see the current score of the page. This page has a automatically assessed score of 0 because it could not be assessed by the system (Essay).
- (Optional) Here you can write a comment for you annotation (reasoning behind the score). This is mostly used when annotations are shared with participants or cooperating assessors (4).
- Choose addition or subtraction from the current point score of the page.
Note: The amount of points the assessor can add here is unlimited, allowing the assessor to be able to give or take extra points for remarkable answers etc.
- Choose sharing options (Share with participants, co-assessors or both).
- Close the editing view of the annotation. There is no Save-button as annotations are saved as you edit it.
When you have created the annotation, notice that the score of the page 1 is now 2 points.
Now we go through page 2 of participant one.
This page was a simple multiple choice question and therefore it was created to be eligible for automatic assessment. On page 2 we see that the system has scored the page a 1/1 point. If the automatic assessment has been setup incorrectly or in any other way has malfunctioned, the assessor can add or subtract points from the assessment as before.
The rest of the pages are the same as page two. From our run through of participant one we can determine that we only need to manually score the points of page one for all of the assigned participants. To quickly go through all page ones for all participants, click on the bottom of page 1 to quickly skip to this page on the next participant.
Grading with point-based assessment
To the top >>
To grade the participants with point-based assessment, click the flow name in the top and click "Point-based assessment".
This opens the Point-based assessment window.
- The grade key distribution.
- Show the grades and how participants are distributed between the grades.
- Drag the dividing points between grade left or right to change the distribution.
- Max and minimum score is determined by the maximum and minimum score achieved by the participants. You can increase or decrease these as fit.
- Participant table.
- And overview table of the participant ID's, names, whether they have handed in etc.
- The participants score according to the assessors editing.
- The participants currently calculated grade according to their score and the grade key distribution.
- The grade given to the participant. If you have manually assigned or edited the grade (Student name > set assessment) these will also show up here. This means that Assessment from distribution and Assessment do not have to be the same.
- Save the current distribution setting (for next time you open the menu) or set the assessment of participant according to the point-based assessment distribution for all participants.
Now the only thing needed is to register (submit) the grades as usual.