On flows set up with rubrics, it is possible to extract the participant rubrics response data, including assessorId, responses, items and scoring using the API. This data can be correlated with the rubric data and used for analysis and reporting purposes.
Participant rubric response data can be fetched from GET /flows/{flowId}/participants/{participantId}/rubrics. Below is the participant rubric response data, filled in by the assessor during the marking period. The participant rubric response data have different information that can be correlated with the rubric data, e.g. to analyse the marking process and rationale behind the final grade.
Note that it is not possible to get audio feedback and rubric attachments from a rubric.
The rubric is set up with different criteria on which the participant will be evaluated, as seen below:
The participant rubric response data shown here is a simple data extract. The 'Question reference' can be used to correlate the data with information fetched from the rubric. The 'Question reference' value holds information on the activity (A2CZ-HICK), the item (i2204505), and the question (q5303903). The 'Response value' is the data filled in by the assessor during the marking period.
| Assessor Id | Rubric state | Question reference | Question type | Response value |
|---|---|---|---|---|
|
5280071
|
APPROVED
|
A2CZ-HICKi2204505q5303903
|
Rating
|
4 |
|
A2CZ-HICKi2204505q5303904
|
Long text
|
The participant is missing some key points |
The raw rubric data is fetched using GET /flows/{flowId}/rubrics. As a rubric can be set up differently, the extracted rubric data will differ as question types and scoring depend on the setup. The extracted data is always the raw rubric data.
Note that the 'Question reference' is the same as the reference above. The 'Weighted value' is the score that corresponds to each value.
Below is a cutout of the rubric data from the first item above. The remaining items have the same option and values.
| Question reference | Data options | Value | Weighted value |
|---|---|---|---|
|
A2CZ-HICKi2204505q5303903
|
Below minimum
|
2 |
5 |
|
Minimum
|
4 | 10 | |
|
Above minimum
|
8 |
20 |
|
|
Perfect
|
12 | 30 |
It is possible to correlate the participant rubric response data with the rubric data using the 'Question reference'. From the participant rubric response data, the following has been extracted:
- 'Response value', which is how the assessor evaluated the participant.
From the rubric data, the following has been extracted:
- The 'Weighted value' value is the score based on the response value.
- 'Total score' and 'Max score' is the total score, and the highest possible score.
| Question reference | Response value | Weighted value | Total score | Max score |
|---|---|---|---|---|
| A2CZ-HICKi2204505q5303903 | 4 | 10 |
|
30 |
| A2CZ-HICKi2204505q5303904 |
The participant is missing some key points |
|||
| A2CZ-HICKi2204505q5303905 | 8 | 20 | 30 | |
| A2CZ-HICKi2204505q5303906 | The participant is doing good on this part | |||
| A2CZ-HICKi2204505q5303907 | 4 | 10 | 30 | |
| A2CZ-HICKi2204505q5303908 | The participant is missing a conclusion on this assignment | |||
| 30 | 90 |