FLOWmulti: Statistics

The flow statistics is a tool specific for FLOWmulti and is accessed via the flow menu in the Assessor tool. Collected on this page, the specific FLOWmulti is summarised graphically in many different ways. Each of these are showcased in the sections below. 

Top section: Distribution of points, answers and summary

Distribution of points

A histogram depicting participant density over score intervals. Click the wrench to change the size of each interval to 2, 5, 10 or 20.

Distribution of answers

A pie chart depicting the proportion of sections. Notice, that sections, which can contain multiple questions, are counted and not questions. Sections are coloured by status fully correct, partially correct, wrong, not answered, or requires manual scoring. You can hide each of these statuses by clicking them in the legend.

Summary

A brief summary of the flow with average, highest, and lowest score. Best performing participant is also shown along with the number of students who have handed in. 

Participants

1. Participant information. Anonymised information is removed from this table.
2. Access individual participant overview (See Individual participant overview) for each participant by clicking the search glass button.
3. See a summary of the annotations added to the participant.
4. Hand in status.
5. Final calculated score (with manual scoring)
6. Distribution of section status for the participant: Correct, Partially correct, Wrong, Requires manual scoring, and Not answered. In this example, each section had 5 questions, except section 5 who had a manual scored question.
7. Export table to CSV-file. Hide columns and export all data or only visible columns.

Score

1. Participant information. Anonymised information is removed from this table.
2. Access individual participant overview (See Individual participant overview) for each participant by clicking the search glass button.
3. The collected score given by automatic assessment, manual scoring and the sum of these.
4. A detailed table of each question in each section (e.g. section 2, question 1: "2:1"). You can see manual correction by hovering over a question box.
5. Export table to CSV-file. Hide columns and export all data or only visible columns.

Assignment

1. Section number/ID.
2. Access detailed stats for individual sections (See Individual sections overview).
3. Average/Mean, Variance and Spread.
4. The distribution of participants who had the section correct, partially correct, wrong, requires manual scoring, or have not answered.
5. Export table to CSV-file. Hide columns and export all data or only visible columns.

Selected response

Selected responses gives an overview of each participant's choice in the exam. The order of the answers (A, B, C, ...) is the same as the original setup of the assignment in the author tool. Note that this might not be the same order as the one the participant has seen (in the case of shuffled answers). The Correct score displays the maximum amount of points available on the question (in the case of several answers and partial scoring). Click the search glass buttons for individual section overview (see Individual section overview).

Individual sections overview

The individual section overview lets the assessor overview the performance and statistics of a single section on all assigned participants. This includes a summary, score distribution, answer distribution, point score box plot, participant answers, and content of the section.

1. Summary: Brief summary of average, spread, max/min, and quantiles. Hover over the number for more decimals.
2. Answer (status) distribution: A pie chart depicting the proportion of participants that are fully correct, partially correct, wrong, not answered, or requires manual scoring. You can hide each of these statuses by clicking them in the legend.
3. Answer distribution on question: The distribution of choices made by participants (A, B, C, etc.). Click the dropdown-menu in the lower right corner to choose between questions of the section.
4. (Point) Box plot of the section: The box plot displays the max/min and quantiles of each section. The current selected section is depicted by blue. Click each section in the left column to see exact statistics.

Below, you can overview how many points each participant got on the section (automated, manual and summed score), as well as the individual answer to each question in the section.

On the bottom of the page, you can review the content of the section.

Individual participant overview

1. Participant information: The information section shows all available information on the participant. When participants are anonymised, this information is limited.
2. Point distribution: Distribution of the amount of point gathered by the participant on the activity (includes manual points given by the assessor).
3. Answer distribution: A pie chart depicting the proportion of sections that are fully correct, partially correct, wrong, not answered, or requires manual scoring for the participant.
4. Participant score compared to all participants: Histogram of participant scores with the current participant's position depicted by a darker blue. Click the settings button to change the size of the intervals of the x-axis.

On the bottom of the page, you can overview the whole activity for the participant. This includes the status of each section (correct, partially correct, wrong, not answered, or requires manual scoring), auto, manual, and summed score, annotations, and the average score on the flow.