Extract Data on Rubrics Using the API

On flows set up with rubrics, it is possible to extract the participant rubrics response data, including assessorId, responses, items and scoring using the API. This data can be correlated with the rubric data and used for analysis and reporting purposes.

Getting the Participant Rubric Response Data

Participant rubric response data can be fetched from GET /flows/{flowId}/participants/{participantId}/rubrics. Below is the participant rubric response data, filled in by the assessor during the marking period. The participant rubric response data have different information that can be correlated with the rubric data, e.g. to analyse the marking process and rationale behind the final grade.

The rubric is set up with different criteria on which the participant will be evaluated, as seen below:

Screenshot_2023-01-02_at_14.25.57.png

The participant rubric response data shown here is a simple data extract. The 'Question reference' can be used to correlate the data with information fetched from the rubric. The 'Question reference' value holds information on the activity (A2CZ-HICK), the item (i2204505), and the question (q5303903). The 'Response value' is the data filled in by the assessor during the marking period.

Assessor Id Rubric state Question reference Question type Response value
5280071
APPROVED
A2CZ-HICKi2204505q5303903
Rating
4
   
A2CZ-HICKi2204505q5303904
Long text
The participant is missing some key points
Getting the Rubric data

The raw rubric data is fetched using GET /flows/{flowId}/rubricsAs a rubric can be set up differently, the extracted rubric data will differ as question types and scoring depend on the setup. The extracted data is always the raw rubric data. 

Note that the 'Question reference' is the same as the reference above. The 'Weighted value' is the score that corresponds to each value.

Below is a cutout of the rubric data from the first item above. The remaining items have the same option and values.

Question reference Data options Value Weighted value
A2CZ-HICKi2204505q5303903
Below minimum

2

5

 
Minimum
4 10
 
Above minimum

8

20

 
Perfect
12 30
Correlating the Participant Rubric Response Data with Rubric Data

It is possible to correlate the participant rubric response data with the rubric data using the 'Question reference'. From the participant rubric response data, the following has been extracted:

  • 'Response value', which is how the assessor evaluated the participant.

From the rubric data, the following has been extracted: 

  • The 'Weighted value' value is the score based on the response value.
  • 'Total score' and 'Max score' is the total score, and the highest possible score. 
Question reference Response value Weighted value Total score Max score
A2CZ-HICKi2204505q5303903 4 10

 

30

A2CZ-HICKi2204505q5303904

The participant is missing some key points

     
A2CZ-HICKi2204505q5303905 8 20   30
A2CZ-HICKi2204505q5303906 The participant is doing good on this part      
A2CZ-HICKi2204505q5303907 4 10   30
A2CZ-HICKi2204505q5303908 The participant is missing a conclusion on this assignment      
      30 90

 

Was this article helpful?
0 out of 0 found this helpful

Articles in this section

See more