Using the New Marking Tool

This article has been updated to reflect the enhancements that will be available after Friday 31 January as part of the January Release 2025.

The new marking tool brings together the processes of providing comments, feedback and entering marks and, reviewing and submitting a final grade. When using the new marking tool, it is no longer necessary to go to the marking overview to finalise and submit the final grades. For the moment, however, the marking overview is still part of the assessing landing page and you can read our corresponding article on using the marking overview tool.

Accessing Submissions

To access the submissions from the flow landing page, navigate into the marking tool under the commenting and feedback area. It is also possible to jump straight to an individual submission from the participant list at the bottom of the page.

The New Marking Tool Layout

FLOWassign/FLOWhandin/FLOWlock FLOWmulti FLOWattend/FLOWoral

Submissions made to a FLOWassign, FLOWhandin and FLOWlock will be presented in the marking tool as shown below:

With multiple functions available, we shall take each section of the tool in turn. Please note that the screen views may differ according to how flows have been set up.

Left-hand Navigation Pane

Participants

1. Open the list of participants
2. Number of participants listed
3. Apply Early release feedback for all to all participants (this setting can be enabled/disabled individually within the grading window)
4. Filter the list of participants by selecting a criteria from the pop-up window
5. Remove the filter
6. Select the columns you wish to be visible in the table of participants
7. Filter the list using any of the column headers
8. Go to a participant's submission by clicking on the row in the table
9. Identifies participants that have made a submission
10. Identifies participants for whom you have entered a grade but yet submitted a final grade
11. Identifies participants for whom a final grade has been submitted
12. Opens the navigation bar allowing you to move between participants or between files submitted by the same participant
13. Confirms your network status e.g. online
14. Takes you back out of the marking tool

Common Feedback

1. Open the common feedback window
2. Text box for entering feedback to all participants to whom the assessor is allocated
3. Identifies the number of feedback comments submitted and to whom they have been shared
4. Filter and sort the list of feedback
5. Identifies the assessor and when the feedback was last edited
6. Minimise or maximise the window
7. Identifies the number of files attached by the assessor
8. Edit the feedback text
9. Delete the feedback or amend the sharing options
10. Identifies the name, format and size of the attached file
11. Download the attached file
12. Delete the attached file
13. Feedback text
14. Confirms the connection to WISEflow and number of annotations still be updated
15. Return to the flow landing page

Main Navigation Pane

Header Bar and Navigation Bar

1. Flow name and current student name (when not anonymised)
2. Open options menu to select download, print and settings functions
3. Full screen view
4. Navigate between multiple pages within the current file
5. Select options for displaying transition between pages, page orientation (option to rotate pages) and page layout (single or double pages displayed)
6. Select preferred magnification
7. Zoom in and out
8. Pan around e.g. when an image is highly magnified
9. Select text
10. View the current page
11. Annotate utilising the tools listed in No. 14
12. Annotate utilising shapes that show beneath: freehand, free hand highlight, rectangle, ellipse, polygon, line, polyline and arrow and select a colour: red, blue, black or green
13. Insert a signature, rubber stamp, or a date
14. Annotation tools: highlight, underline, strikeout, squiggly (underline), note and free text
15. Undo last action
16. Redo last action
17. Eraser
18. Search for text within the current file
19. Show all annotations in the right-hand pane; can be re-ordered according to preference
20. Indicates which participant (index number) submission you are currently viewing
21. Navigate up and down through the list of participants
22. Navigate left and right through the files submitted by the current participant
23. Move the navigation bar to your preferred location on the screen
24. Close the navigation bar

Right-hand Navigation Pane

Submission Overview

1. Open the submission overview
2. Close the submission overview
3. Build a package for export that can be downloaded and marked outside of WISEflow
4. Identifies the main PDF submission (FLOWassign)
5. Similarity percentage as generated by the designated similarity service (Turnitin or Ouriginal)
6. List of appendices, if applicable (FLOWassign)

Rubrics

1. Open the rubric
2. Close the rubric
3. Select with whom the rubric should be shared
4. The rubric to be completed
5. Progress of the rubric completion
6. Once complete, approve the rubric

Submission Feedback

1. Open submission feedback window
2. Close submission feedback window
3. Enter feedback comments on the current submission
4. Displays number of feedback comments and with whom they have been shared
5. Filter and sort the list of feedback comments
6. Identifies the assessor and when the comment was last edited
7. Minimise and maximise the comment
8. Identifies the number of files attached by the assessor
9. Edit the feedback text
10. Delete the feedback or amend the sharing options
11. Identifies the name, format and size of the attached file
12. Download the attached file
13. Delete the attached file
14. Feedback text

Grade

1. Open the grading window
2. Preliminary grade according to the completed rubric (definitive if the grade scaler is enforced)
3. Close the grading window
4. Feedback table detailing the numbers of annotations, submission feedback items and common feedback items followed by the number of each of those items that will be shared with participants
5. Score as calculated/entered through completion of the rubric
6. View the grade scaler if one has been added
7. View the completed rubric for the submission (if a rubric is present on the flow)
8. Grade that has been entered (either manually, calculated through completion of the rubric or automatically if the mark converter is enforced)
9. View the grade audit trail for the participant, e.g. previously submitted and subsequently unlocked final grade
10. Early release of feedback for that participant only (if the appropriate setting has been enabled on the flow), allows feedback to be available to the participant prior to the end of marking period
11. Submit the completed assessment for the submission: a pop-up window asks for confirmation that the grade is correct and allows the assessor to add an internal note to the grade audit trail

Submissions made to a FLOWmulti will be presented in the marking tool as shown below where you will immediately be presented with the first item of the assignment (including auto-scored items) or the first item to which you have been allocated (item-based marking). 

With multiple functions available, we shall take each section of the tool in turn. Please note that the screen views may differ according to how flows have been set up.

Left-hand Navigation Pane

Participants

1. Open the list of participants
2. Number of participants listed
3. Apply Early release feedback for all to all participants (this setting can be enabled/disabled individually within the grading window)
4. Filter the list of participants by selecting a criteria from the pop-up window
5. Remove the filter
6. Select the columns you wish to be visible in the table of participants
7. Open the statistics module
8. Filter the list using any of the column headers
9. Go to a participant's submission by clicking on the row in the table
10. Identifies participants that have made a submission
11. Identifies participants for whom you have entered a grade but yet submitted a final grade
12. Identifies participants for whom a final grade has been submitted
13. Opens the navigation bar allowing you to move up and down between participants or left and right between items answered by the same participant
14. Confirms your network status e.g. online
15. Takes you back out of the marking tool

Common Feedback

 

1. Open the common feedback window
2. Text box for entering feedback to all participants to whom the assessor is allocated
3. Identifies the number of feedback comments submitted and to whom they have been shared
4. Filter and sort the list of feedback
5. Identifies the assessor and when the feedback was last edited
6. Minimise or maximise the window
7. Identifies the number of files attached by the assessor
8. Edit the feedback text
9. Delete the feedback or amend the sharing options
10. Identifies the name, format and size of the attached file
11. Download the attached file
12. Delete the attached file
13. Feedback text
14. Confirms the connection to WISEflow and number of annotations still be updated
15. Return to the flow landing page

Main Navigation Pane

Item View

1. Flow name and current participant name (when not anonymised)
2. View: view the items as they were submitted (interactive files such MP4s can be accessed from here)
3. Annotate: access the annotations functionalities and create inline annotations against any part of the submission which in this view is essentially a PDF (interactive files such MP4s cannot be accessed from here); find out more detail on creating annotations
4. Displays present overall score for the participant
5. Displays current score of the item
6. Indicates which participant (index number) submission you are currently viewing
7. Navigate up and down through the list of participants
8. Navigate left and right through the items answered by the current participant
9. Move the navigation bar to your preferred location on the screen
10. Close the navigation bar

Right-hand Navigation Pane

Item Overview

1. Open the item overview window
2. Close the item overview window
3. Displays the total number of items
4. Click on the item row to open that item
5. Click on the item's score to open the scoring window for that item

Scoring

1. Open the scoring window
2. Close the scoring window
3. Item number/title
4. Question number/title
5. Identifies auto-scored items
6. Displays current score and maximum score of the item
7. Open the full list of the items and navigate between them
8. Move to the next item for the same participant
9. Confirms the score for the item

Submission Feedback

1. Open submission feedback window
2. Close submission feedback window
3. Enter feedback comments on the current submission
4. Displays number of feedback comments and with whom they have been shared
5. Filter and sort the list of feedback comments
6. Identifies the assessor and when the comment was last edited
7. Minimise and maximise the comment
8. Identifies the number of files attached by the assessor
9. Edit the feedback text
10. Delete the feedback or amend the sharing options
11. Identifies the name, format and size of the attached file
12. Download the attached file
13. Preview the attached file
14. Delete the attached file
15. Feedback text

Rubrics

1. Open the rubric
2. Close the rubric
3. Select with whom the rubric should be shared
4. The rubric to be completed
5. Calculated score based on the completed rubric
6. Suggested grade based in the grade scaler
7. View the grade scaler
8. Select the final grade (this is not possible if the grade scaler is enforced)
9. Enter the rubric grade

Grading

1. Open the grading window
2. Preliminary grade according to the completed rubric (definitive if the grade scaler is enforced)
3. Close the grading window
4. Feedback table detailing the numbers of annotations, submission feedback items and common feedback items followed by the number of each of those items that will be shared with participants
5. Score as calculated/entered by marking/auto-scoring of the assignment items and/or a rubric (if applicable) [NOTE: rubrics are rarely used for marking FLOWmulti assignments
6. View the grade scaler if one has been added
7. View the completed rubric for the submission (if a rubric is present on the flow)
8. Grade that has been entered (either manually, calculated through completion of the rubric or automatically if the mark converter is enforced)
9. View the grade audit trail for the participant, e.g. previously submitted and subsequently unlocked final grade
10. Early release of feedback for that participant only (if the appropriate setting has been enabled on the flow), allows feedback to be available to the participant prior to the end of marking period
11. Submit the completed assessment for the submission: a pop-up window asks for confirmation that the grade is correct and allows the assessor to add an internal note to the grade audit trail

As the marking tool for FLOWattend works in the same way for FLOWoral, please refer to The Examination Tool below on how to use the marking tool for FLOWattend.

Flow Page Overview for FLOWoral

FLOWoral is designed to support scheduled assessment activities where the assessor interacts with the candidate or observes them completing an activity or performing a particular skill. As such, candidates are not required to submit artefacts to WISEflow, rather they are scored based on the assessor's live observation. It also means that the scoring usually takes place in a real-time context as the assessor observes the candidate completing their assessment. To support this format the WISEflow interface differs from some of the other flow types.

1. Open the examination tool (access scoring and grading tools)
2. Grade overview (where final grades will eventually be submitted)
3. Period overview (details the candidates to which you have been assigned as an assessor and in which order they are due to appear)
4. Toggle between candidate list and exam timetable views (alternative view shown below)
5. Print summary
6. The different times indicate the start time for preparation, the start time of the oral examination and the end time of the examination. If time has been allocated for the discussion of the grade, this will be reflected in the end time for an individual participant.

1. Overview displayed as a candidate list
2. Option to adjust periods (if enabled by the flow manager)
3. Feedback sentiment analysis
4. Details of any co-assessors

The Examination Tool

Although no submission will be present, the examination tool itself works in a very similar way and many of the same tools for marking and feedback are provided.

1. List of participants: navigate through the cohort

2. Common feedback: provide feedback on the participants to whom you have been allocated

3. Submission feedback: provide feedback on an individual's submission
4. Rubrics: access and complete any attached rubrics

Moving Between Submissions

Moving between submissions is possible in several different ways.

From the Flow Landing Page

Click the green speech bubble against any row to jump straight to the corresponding submission in the marking tool.

From the Participant List in the Marking Tool

The participant list can be accessed from the left-hand navigation pane and displays all the participants to which you have been assigned as an assessor and provides a quick way to move between each submission from inside the marking tool.

From the Navigation Bar

An icon identifies the participant you are currently viewing. Use the cursors to move up and down through the participants.

Between Flows (FLOWseries and FLOWcombine only)

When flows are grouped together in a FLOwseries or FLOWcombine, it is possible to access the same participant's submission on each flow, using the dropdown list or using the left and right buttons.

Working with Group Submissions

Group assessments can be incorporated into FLOWassign, FLOWhandin, FLOWoral and FLOWattend and may be in one of two formats:

1. Group submission: Each group hands in one submission. Any of the group members can submit on behalf of the group.
2. Individual submission: Participants are still arranged into groups, but each has to make their own individual submission.

Group information is available to assessors via the participant list. Where groups have been enabled the flow page will display an additional column showing the group number (please note that the value in this list is a system-generated number and may not necessarily correspond with a group name if separate group name labels have been added).

Group Submissions

For group submissions, the flow menu in the marking tool will display a single entry for the group. Simply select the group submission and assess it in the normal way. Each individual participant will receive the same feedback you provide.

Individual Submissions

Individually submitted papers will appear as a list of individual participants. These can be completed in the usual way where each participant receives the individual feedback you provide.

The Marking Archive

Flows are archived by default one month after the end of the assessment period (this may vary if your institution has set up different retention rules). You can find archived flows in the marking archive, available from the marking landing page.