Export Data on FLOWmulti Submissions Using the API

When a submission has been made to a FLOWmulti, it is possible to extract the submission response data, items, and scoring using the API. This data can be correlated with the assignment data and used for analysis and reporting purposes.

Getting the Response Data

The submission response data from a FLOWmulti assignment can be fetched from GET /flows/{flowId}/submissions/{submissionId}/responses. Below is the submission response data for an assignment with two questions. The submission response data have different information that can be correlated with the assignment data to analyse the response and effectiveness of the assignment. 

The submission response data shown here is a simple data extract. It does not tell anything about the assignment. The 'Activity Id' and the 'Question reference' can be used to correlate the data.

Activity Id	Question reference	Attempted	Response value	Score	Max score
103c8a46-4df6-44bb-95c0-db69e905cb5f	b17f3c7d-4195-4e0d-8e42-8aa74d00a9ab	True	0	1.0	1.0
	f67296fc-28b7-4f0d-b127-6c0a1caaf028	True	dog brown	0.0	1.0

From the submission response data, it is also possible to extract an overall score of the entire submission, as shown below:

Number of questions attempted	Number of questions	Score	Possible max score
2	2	1.0	2.0

Getting the Assignment Data

The submission data can be correlated with data from the assignment to get the questions and validation. The assignment is fetched using GET /flow/{flowId}/assignments. 

Depending on the assignment and the question types, the assignment data might look different. It is possible to extract all data from the assignment such as the minimum and max scores, auto validation, descriptions, templates used and more. 

Note the references, the 'Assignment reference' is a reference to the 'Activity Id' from the submission above. The 'Question reference' is a reference to the question. If the assignments have multiple questions, there is a reference to each question. 

Below is the assignment data on the first question from the above submission.

Assignment reference	Question reference	Question type	Stimulus	Options	Values	Valid response
103c8a46-4df6-44bb-95c0-db69e905cb5f	b17f3c7d-4195-4e0d-8e42-8aa74d00a9ab	mcq	What is the capital of Denmark?	Copenhagen	0	0
				Aarhus	1
				Odense	2
				Aalborg	3

Below is the assignment data on the second question from the above submission. Note the different 'Question reference' and the added 'Template' and 'Possible responses' columns. These columns have been added, as the question type is different. 

Assignment reference	Question reference	Question type	Stimulus	Template	Possible responses	Valid response
103c8a46-4df6-44bb-95c0-db69e905cb5f	f67296fc-28b7-4f0d-b127-6c0a1caaf028	Cloze association	Insert the correct words	The quick {{response}} fox jumps over the lazy {{response}}	brown dog	brown dog

Correlating the Assignment Data with Submission Data

It is possible to correlate the assignment with the submission using the 'Assignment reference' and the 'Question reference'.

Four columns have been added:

• 'Response value', which is what the participant responded to the question.
• The 'Attempted' value tells whether the participant attempted the question or not.
• 'Score' and 'Max score' is the actual score the participant got from the question, and the highest possible score. 

Assignment reference	Question reference	Stimulus	Options	Values	Valid response	Response value	Attempted	Score	Max score
103c8a46-4df6-44bb-95c0-db69e905cb5f	b17f3c7d-4195-4e0d-8e42-8aa74d00a9ab	What is the capital of Denmark?	Copenhagen	0	0	0	True	1.0	1.0
			Aarhus	1
			Odense	2
			Aalborg	3

The second question can also be correlated with the submission data:

Assignment reference	Question reference	Template	Possible responses	Valid responses	Response value	Attempted	Score	Max score
103c8a46-4df6-44bb-95c0-db69e905cb5f	f67296fc-28b7-4f0d-b127-6c0a1caaf028	The quick {{response}} fox jumps over the lazy {{response}}	brown dog	brown dog	dog brown	True	0.0	1.0

Note that the 'Valid responses' and the 'Response value' is not the same. In this case, the participant put in the wrong response to the question and hence got a 'Score' of 0.0 out of a 'Max score' of 1.0.