How do I enable and use question metadata for assessment Statistics?

You can add metadata terms (keywords and objectives) to in an assessment. Recording question metadata for auto-graded questions (such as multiple choice and true false) creates a new data point that is visible in the Statistics and Item Analysis pages after students submit the assessment. This data shows the percentage of correctly answered questions tied to a specific keyword or objective. You can use the data to infer how well students are meeting a particular learning goal.

For information on editing additional settings, see:

Required: Enable the option to add question metadata in the assessment's Settings.

Access the assessment's settings.

Actions menu with Settings selected

For steps to access the Settings page, see How do I inspect and adjust the settings of an assessment?

Note:

  • Question metadata must be added in the Working Copies tab or in the Published Copies tab before anyone accesses the assessment to take it.
  • Changes made to assessments in Working Copies do not affect assessments in Published Copies, and vice versa.

Select About this Assessment.

  1. Select About this Assessment on the assessment's Settings page.
  2. Or select the Expand All button to open all the sections on the Settings page.

Select Metadata.

Scroll down on the page under the Honor Pledge and Attachments sections, and select Metadata to open that section.

Enable the option to Record question metadata to Statistics.

  1. Under Question Metadata, select the Record question metadata to Statistics checkbox.
  2. At the bottom of the page, select Save.

Edit the assessment.

  1. Select the Actions menu for the assessment.
  2. Select Edit.

Add or edit a question.

You can add metadata to questions as you create them, or edit existing questions to add metadata to them.

Add a question.

Add Question menu on the Questions editing page shown with Multiple Choice selected.

For steps to add a question, see How do I add a new question (with the assessment builder)?

Or edit an existing question.

Select the Edit Question link to the right of the question number.

Add metadata terms.

While creating or editing the question:

  1. Scroll down to the Metadata section near the bottom of the page.
  2. Enter a term in the Objective and/or Keyword box. Pictured above is an example where Learn about historical figures has been entered in the Objective box, and UVA History has been entered in the Keyword box.
  3. Select Save.

You will need to repeat this step for each question you want to associate with particular metadata terms.  Enter the same keyword or objective for multiple questions to include those questions in the data analysis.

Note: Using letters (no accent marks) A-Z (either lowercase or uppercase), numbers 0-9, and spaces in metadata terms is recommended. Avoid using special characters such as commas (,), semicolons (;), and slashes (/).

Edit settings and publish the assessment.

Actions menu in the Working Copies tab with Publish selected

After you have finished adding questions to your assessment, follow the steps to edit other settings as needed and publish the assessment to make it available to students at the date you specify in the Settings.

View metadata statistics.

After students have submitted the assessment, you can find the metadata terms and associated statistics in the Statistics and Item Analysis pages while grading.

Go to Tests & Quizzes.

Select Tests & Quizzes from the tool menu in your site.

Select the Published Copies tab.

Select the Published Copies tab to view the assessments that have been released to students in your site.

Go to the assessment submissions.

  1. Select the Actions menu for the assessment.
  2. Select Scores.
  3. Alternatively, you may select the number of student submissions in the Submitted column to view the submissions.

Select the Statistics tab.

View metadata statistics.

Scroll down on the page under the Final Score Distribution graph to find the statistics associated with the Objectives and Keywords.  The Percent Correct for answers to auto-graded questions (such as multiple choice and true false) associated with each objective or keyword will be displayed.

Select the Item Analysis tab.

View Item Analysis page.

When metadata terms have been associated with questions, an Objectives and/or Keywords column is available in the Item Analysis table, listing the term(s) for each question.

Learn more about assessment statistics.

For details about other data found in the Statistics and Item Analysis pages, see How do I view statistics about a completed assessment?