How do I enable and use question metadata for assessment Statistics?
You can add metadata terms (keywords and objectives) to in an assessment. Recording question metadata for auto-graded questions (such as multiple choice and true false) creates a new data point that is visible in the Statistics and Item Analysis pages after students submit the assessment. This data shows the percentage of correctly answered questions tied to a specific keyword or objective. You can use the data to infer how well students are meeting a particular learning goal.
For information on editing additional settings, see:
- How do I inspect and adjust the settings of an assessment?
- How do I edit my assessment title or description, or add an Honor Pledge check box?
- What are the Availability and Submissions options for an assessment?
- How do I give specific students different date or time settings on an assessment?
- What are the Grading and Feedback options for an assessment?
- How do I adjust the layout and appearance of an assessment?
Required: Enable the option to add question metadata in the assessment's Settings.
For steps to access the Settings page, see How do I inspect and adjust the settings of an assessment?
- Question metadata must be added in the Working Copies tab or in the Published Copies tab before anyone accesses the assessment to take it.
- Changes made to assessments in Working Copies do not affect assessments in Published Copies, and vice versa.
- Select About this Assessment on the assessment's Settings page.
- Or select the Expand All button to open all the sections on the Settings page.
Scroll down on the page under the Honor Pledge and Attachments sections, and select Metadata to open that section.
- Under Question Metadata, select the Record question metadata to Statistics checkbox.
- At the bottom of the page, select Save.
You can add metadata to questions as you create them, or edit existing questions to add metadata to them.
For steps to add a question, see How do I add a new question (with the assessment builder)?
While creating or editing the question:
- Scroll down to the Metadata section near the bottom of the page.
- Enter a term in the Objective and/or Keyword box. Pictured above is an example where Learn about historical figures has been entered in the Objective box, and UVA History has been entered in the Keyword box.
- Select Save.
You will need to repeat this step for each question you want to associate with particular metadata terms. Enter the same keyword or objective for multiple questions to include those questions in the data analysis.
Note: Using letters (no accent marks) A-Z (either lowercase or uppercase), numbers 0-9, and spaces in metadata terms is recommended. Avoid using special characters such as commas (,), semicolons (;), and slashes (/).
After students have submitted the assessment, you can find the metadata terms and associated statistics in the Statistics and Item Analysis pages while grading.
Select the Published Copies tab to view the assessments that have been released to students in your site.
- Select the Actions menu for the assessment.
- Select Scores.
- Alternatively, you may select the number of student submissions in the Submitted column to view the submissions.
Scroll down on the page under the Final Score Distribution graph to find the statistics associated with the Objectives and Keywords. The Percent Correct for answers to auto-graded questions (such as multiple choice and true false) associated with each objective or keyword will be displayed.
When metadata terms have been associated with questions, an Objectives and/or Keywords column is available in the Item Analysis table, listing the term(s) for each question.
For details about other data found in the Statistics and Item Analysis pages, see How do I view statistics about a completed assessment?