The advanced question analysis can be found as a link in the upper right corner of the results tab in the test tool.
This triggers the calculation and subsequent download of an excel (.xslx) file. The calculation is performed on all questions, using all attempts that are submitted, assessed and being counted at the time of calculation.
If a student submits a new attempt later that becomes the counting attempt, simply click the link again to trigger a new analysis.
The excel spreadsheet will have a header row, followed by a row with a short descriptions of what each column contains. There is one row for each question in the test.
Further column classification:
- Question text: Displays up to 100 characters of text. HTML is not displayed. For Fill in the blank or Select from a list, what is shown is the introduction text, not the question.
- Max possible score: Positive number, up to 2 decimals. Question score as set by the teacher when creating the question.
- Average score: Positive number, up to 2 decimals. Average score achieved in the attempts included in the analysis.
- Standard deviation: Positive number, up to 2 decimals. Standard deviation of the scores achieved in the attempts included in the analysis. Calculated as standard deviation for a sample population.
- Variance: Positive number, up to 2 decimals. Variance of the scores achieved in the attempts included in the analysis. Calculated as variance for a sample population.
- Answers with max score (%): Positive number, up to 2 decimals. Percentage of attempts with score = max score, based on the number of attempts included in the analysis.
- Difficulty: Hard, medium or easy. The difficulty is based on the percentage of attempts that received the max score, and is categorized as follows:
- > 80% = Easy (meaning more than 80% of students got this correct)
- 30-80% = Medium
- < 30% = Hard (meaning less than 30% of students got this correct)
- Discrimination score: Positive number between 0 and 1 (up to 2 decimals), or blank. The discrimination score is calculated as the Pearson's correlation coefficient for a sample population. The coefficient cannot be calculated in cases where all attempts have the same score.
- Discrimination:Good, fair, poor or cannot calculate. The discrimination is based on the discrimination score, and categorized as follows:
- > 0.3 = Good
- 0.1 - 0.3 = Fair
- < 0.1 = Poor
- Review recommended:Yes or no. Based on the difficulty and discrimination values, a review of the question will be recommended if at least one of the following conditions is met:
- Difficulty = Easy
- Difficulty = Hard
- Discrimination = Poor