Anatomy of a multiple choice item
| Part | Purpose | Design test |
|---|---|---|
| Stem | States the problem or question | Can a prepared student understand the task before reading the options? |
| Key | The best or correct response | Is it defensible without relying on hidden assumptions? |
| Distractors | Represent plausible errors or alternatives | Would each distractor attract a student with a specific misconception? |
| Context | Provides data, scenario, text, image, or constraints | Is every detail needed to answer the question? |
Write a strong item
- Start with the learning outcome and identify the decision or reasoning you want to observe.
- Write the correct response before the distractors. Verify that it remains correct under the stated conditions.
- Build distractors from common errors, incomplete reasoning, or nearby concepts—not random wrong answers.
- Keep options parallel in grammar, specificity, and approximate length.
- Remove clues such as absolute wording, repeated phrases, unequal detail, or a key that is consistently longest.
- Ask a colleague or student assistant to explain how each option might be chosen.
Higher education item patterns
- Interpretation: provide a graph, excerpt, dataset, code sample, or clinical finding and ask for the best interpretation.
- Application: describe a new case and ask which principle, method, or next action applies.
- Error analysis: show a worked solution and ask where the reasoning first becomes invalid.
- Comparison: present two approaches and ask which better meets stated constraints.
- Prediction: ask what is most likely to happen when one condition changes.
- Best justification: provide a decision and ask which evidence most strongly supports it.
Common mistakes
- Testing trivia that is easy to write but unrelated to important outcomes.
- Using “all of the above,” which can reward partial recognition rather than full reasoning.
- Writing negative stems without a genuine reason; if necessary, emphasize the negative term.
- Creating trick questions whose difficulty comes from wording rather than the subject.
- Using overlapping options or more than one defensible key.
- Reusing exposed questions without reviewing whether they still provide valid evidence.
After administration, review both statistics and student reasoning. A difficult item is not automatically good, and an easy item is not automatically weak. Look for unexpected option patterns, ambiguity, content that was not taught, and distractors no one selected. Instructor review remains essential before changing a grade or reusing the item.
