How to Write a Multiple-Choice Question That Actually Tests Understanding

Teaching

A badly written multiple-choice question tests one thing: whether a student can spot the option that looks different from the others. A good one tests whether they understand the material. The gap between the two is a handful of rules that assessment researchers have spent decades nailing down.

Multiple choice has a bad reputation, and often it is deserved — but usually the format is not the problem, the writing is. A well-built multiple-choice question can probe real understanding, mark itself instantly, and work brilliantly as retrieval practice. A badly built one just rewards test-taking cunning. The good news is that the difference comes down to a short, learnable checklist.

Much of what follows is distilled from a widely used review by Thomas Haladyna and colleagues, who went through the research and textbooks on item writing and boiled it into a set of practical guidelines for classroom tests. Here are the ones that matter most.

1. Put the whole question in the stem

The stem is the part before the options. A reader should be able to cover the answers, read the stem alone, and know exactly what is being asked. If the stem is just a fragment that only makes sense once you have read all four options, it is doing the wrong job.

The second version asks a complete question. A student who knows the material can answer it before even glancing at the options — which is exactly what you want.

2. Ask something worth asking

The format is neutral; the cognitive demand is up to you. You can write multiple-choice questions that ask only for a recalled fact, or ones that require applying an idea to a new situation. Both have their place, but a test made entirely of the first kind measures very little. Aim some questions at “why” and “what happens if,” not just “what is.”

3. Make every wrong answer tempting

The wrong options are called distractors, and they are where most of the craft lives. A distractor only works if a student who has a genuine misunderstanding would find it plausible. Silly, obviously-wrong options are free marks — they let people guess correctly by elimination without knowing a thing.

The best distractors are built from real mistakes: the common misconception, the answer you get if you make the usual slip, the fact that belongs to a neighbouring topic. If you have taught the material, you already know what those errors are — put them in the options.

A good distractor is not a random wrong answer. It is the mistake you expect a half-prepared student to actually make.

4. Keep the options parallel and tidy

Small giveaways let test-wise students score without knowing the answer. Research on item writing keeps flagging the same tells, so screen every question for them:

The odd one out. If the correct answer is noticeably longer, more detailed or more carefully hedged than the rest, it stands out. Keep all options similar in length and grammatical form.

Grammar that only fits one option.A stem ending in “an” quietly rules out every option starting with a consonant. Make sure each option reads correctly with the stem.

“All of the above” and “none of the above.”These invite guessing tricks — spot two correct options and “all of the above” is locked in — and they muddy what the question actually measures. Most guidelines recommend avoiding them.

5. One defensibly correct answer

There should be exactly one option a knowledgeable person would choose, and you should be able to justify why each of the others is wrong. If two options are arguably correct, or the “right” one depends on an unstated assumption, the question is testing mind-reading, not knowledge. Reading each question back as if you were a bright, slightly argumentative student catches most of these.

6. Write it plainly

Unless you are specifically testing reading, dense wording just adds noise. Negatives are the worst offender: “Which of the following is nottrue?” trips up students who know the material but misread the question. If you must use a negative, make it impossible to miss — and prefer a positively phrased question wherever you can.

A quick checklist

Before a question goes live, run it past these:

• Can you answer the stem with the options covered?
• Is it asking something worth knowing, not just a stray fact?
• Is every distractor a mistake a real student might make?
• Are the options similar in length, form and grammar?
• Is there exactly one defensible answer?
• Is the wording plain, with no sneaky negatives?

Let the tools do the grunt work

Writing good questions is a skill, but writing a lotof them is just time — and that is where it helps to start from a strong draft rather than a blank page. This is one of the better uses of AI in teaching: it can turn a topic or a set of notes into a first batch of questions and plausible distractors in seconds, leaving you to do the part that needs a human — checking that each one is fair, clear and actually tests what you meant.

That is how Yippito is built to work: it drafts a full quiz — questions, options and distractors — from whatever you give it, so you spend your time editing and improving rather than typing from scratch. Bring the checklist above, and a few minutes of tidying turns a decent draft into a genuinely good quiz.

Sources

• Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment. Applied Measurement in Education, 15(3), 309–334.
• How to Write a Multiple-Choice Question (According to the Research) — Carnegie Mellon University, METALS.