Creating a Constructed Response Item
The form for creating a constructed response item is shown below. It is similar to a multiple-choice item, except that there are no answer choices. You can add attachments, rationale, enter formatted text, and formulas. There are two main differences. You can add a scoring guide and specify how the question should be scored automatically.
Scoring Guide (optional)
Use a scoring guide when you want to manually score the question. A scoring guide can be a rubric. For example, if the question is worth 4 points and students are asked to write a short paragraph to explain their understanding of a concept, you can have a scoring guide to inform you as to what type of response will receive a score of 4, what type of response will receive a score of 3, etc. 21.
Auto-scoring the Item
To set the item up to scored automatically by Naiku, first click on “Add matcher for auto-scoring”. Then select the type of answer you want for the question. Auto-scoring works best when the answer to the question is a short word or phrase or a number. You have following choices:
• Text — Use this for text based answers. These work best when they are short one or two word phrases. An example for scoring a text item is shown below.
• Range — Use this for numbers that are acceptable within a range. For example, if students are asked to estimate and you want to accept any number between 3,000 and 4,000, then set the answer up as a range.
• Number — Use this for an exact number answer (such as 25.0).
• Fraction — Use this when the number answer is a fraction. Students will enter a fraction like 1/2 by type “1 / 2”.
• Precision — Use this if you want a precise answer scored to a significant digit like 3.14.
Scoring a Text Item
To score a text based item, follow this example. For this item, we are asking students to type in the name of the first president of the United States. We’ve selected Text as the answer Type. We’ve then entered “Washington” as the answer. Note that we’ve also entered “George Washington” as an alternative correct answer. We have the option to allow for misspelling, which we’ve selected here. By doing this, if students mistype or mis-spell Washington, as long as it is close enough, the student’s response will be counted as correct. Note that you do not have to enter all the possible incorrect spellings you think the students will make. We also have the option to enforce case sensitivity, which we have not done here. So if students enter “washington” without capitalizing the “W," the student’s response will still be counted as correct. If students enter “Geo. Washington”, that will be counted as incorrect. However, after scoring the test, if you want to accept “Geo. Washington” as correct, you can do that on the Item Analysis Report (see page 44). The number of required answers is set to “1” since we are only requiring one answer. However, if our question asked for two answers (let’s assume we have asked for the first two presidents of the United States), then we would enter “2” for the number of required answers.