Once I publish a quiz, what kinds of quiz statistics are available?
You can view quiz statistics for quizzes that have been published and have at least one submission. You can also download comma separate value (CSV) files to view Student Analysis or Item Analysis for each quiz question. For more detailed information about item analysis limitations and calculations, please refer to the Item Analysis resource document.
For optimum course performance in the Canvas interface, quiz statistics will only generate for quizzes with 100 or fewer unique questions or 1000 total attempts. For instance, a quiz with 200 questions will not generate quiz statistics. However, a quiz with 75 questions will generate quiz statistics until the quiz has reached 1000 attempts. Results greater than these maximum values can be viewed by downloading the Student Analysis report and viewing the CSV file.
Notes:
- Editing a quiz with student submissions may affect quiz statistics. If the Question Breakdown charts no longer correctly display the information you expect after you edit a quiz, the Student Analysis report can provide the correct data.
- Media items do not display in quiz statistics.
- Answers that were edited or created in the Rich Content Editor for a Multiple Answers quiz question do not display in quiz statistics.
Open Quizzes
In Course Navigation, click the Quizzes link.
Open Quiz
Click the title of the quiz you want to open.
Open Quiz Statistics
Click the Quiz Statistics link.
Note: Quiz Statistics will not be available until at least one student has completed the quiz.
View Statistics
By default, the quiz summary shows statistics for all sections including the quiz average score, high score, low score, standard deviation (how far the values are spread across the entire score range), and average time of quiz completion [1].
To view quiz statistics for a section, click the Section Filter drop-down menu [2]. To access additional survey results, generate a Student/Item Analysis report [3].
In the summary graph, the x-axis indicates the quiz scored percentages [4], and the y-axis indicates the number of students who received each percentage [5].
If a student had multiple assignment attempts, you can view past attempts in SpeedGrader. Quiz stats will only display the kept score for the student (highest score or latest score). To view the score setting for multiple attempts, edit your quiz and view the multiple attempts settings option. If necessary, you can give your students an extra attempt.
View Analysis Reports
Download CSV files to view Student Analysis or Item Analysis for each quiz question to count all student attempts in the statistics. For more detailed information about item analysis limitations and calculations, please refer to the Quiz Item Analysis resource document.
When you generate an analysis report, Canvas shows the last time the report was generated. If there is an error with the report, you can retry the option or cancel the analysis completely.
The Student Analysis report includes a tabular representation of each student's answers and the grade awarded for each answer.
Notes:
- By default, the submitted time in the Student Analysis report is shown in UTC, not your set time zone.
- The Item Analysis report only displays statistics for Multiple Choice and True/False questions.
- If you have permission to read SIS data in the course, the sis_id column is included in the CSV download.
View Question Breakdown
Quiz question shows the total percentage of students who answered the quiz question correctly [1].
Each question includes a breakdown with each question answer choice. Correct answer response(s) are shown in a green bar with a check mark [2]; incorrect responses are shown in a black bar [3]. Question types that do not have set answer choices, such as Fill-in-the-Blank questions, display entries other than the correct answer in a black striped bar [4]. The horizontal bars are scaled according to the answer response percentage [5].
Each response also displays the number of respondents who selected the answer [6]. To view the names of the students who selected an answer choice, click the [x respondents] link.
View Manually Graded Questions
Quiz statistics also show relative grade performance for manually graded essay and file upload quiz question types. Manually graded question types are shown in the same table format as other quiz types.
A manually graded quiz type is marked as correct if it contains a student score greater than or equal to the question points possible.
Grade breakdown responses are shown as the top 27% [1], middle 46% [2], and bottom 27% [3]. The statistics also show submissions that have not yet been graded [4]. However, if all scores are identical, a response category may show more than the percentage number of students (e.g., all students score 100%).
Manually graded questions also include access to SpeedGrader for quick reference [5].
View Discrimination Index
True/False and Multiple Choice quiz questions include an item discrimination index, which provides a measure of how well a single question can tell the difference between students who do well on an exam and those who do not.
It divides students into three groups based on their score on the whole quiz: the top 27%, the middle 46%, and the bottom 27%. The number of correct answers from the bottom group is subtracted from the number of correct answers in the top group, then the total is divided by the size of the group.
Lower discrimination scores are scored +0.24 or lower; good scores are +0.25 or higher. An ideal discrimination index shows students who scored higher on the quiz getting the quiz question right, students who scored lower on the quiz getting the quiz question wrong, and students in the middle range on either side. A discrimination index of zero shows all students getting the quiz question right or wrong.
Ideally, students who did well on the exam should get the question right. If students do well on the overall exam but not on the question, the question itself may need to be revised.