Capstone: Ship a Ten-Item Set

Learning goals

Produce a ten-item MBE practice set that passes every Academy gate.
Document the set: blueprint, mappings, review log, and coverage table.
Present the set for faculty-development documentation.

Lesson 1 — The Capstone Brief

Write ten original MBE-style items: at least five subjects represented, every item mapped to one NCBE outline subtopic, estimated difficulty tiers balanced (roughly 3 easy / 4 medium / 3 hard), every distractor with a written error rationale, and a blueprint table published with the set. All items must be 100% original — never adapted from commercial banks or real exams.

Lesson 2 — The Gates, In Order

1. Foundations gate: every item has a stated tested point, a focused call, parallel options. 2. Flaw gate: run the twelve-defect checklist on each item. 3. Cold-solve gate: two independent solvers per item; disagreements diagnosed and fixed, re-solved. 4. Sensitivity gate: review for gratuitous identity detail. 5. Mapping gate: every item has exactly one outline address. 6. Blueprint gate: the set's coverage table is published honestly.

Lesson 3 — The Documentation Packet

Ship the set with: the blueprint table, the subject × subtopic coverage grid, the cold-solve review log (disagreements and fixes), and a one-page author reflection — which module's lesson changed your writing most, and what you'll do differently next set. This packet is your faculty-development artifact.

Lesson 4 — What "Done" Looks Like

Done is not ten items — it's ten items plus the packet, with every gate signed off. Most authors discover 2–4 items need rework at the cold-solve gate; that's the system working. Revise, re-solve, then ship.

Spot-the-flaw drill

Flaw: gates skipped are gates failed. "Looked fine" is not a cold solve; without the p

gates skipped are gates failed. "Looked fine" is not a cold solve; without the packet, the set's quality is unverifiable and its coverage is a claim, not a fact.

Correction

Run the gates in order and document each. The packet below is the minimum.

Model rewrite

— the capstone packet checklist:

[ ] Blueprint table (subjects × tiers × counts) published with the set
[ ] Every item mapped to one NCBE outline subtopic
[ ] Written tested point + distractor error rationale per item
[ ] Two-solver cold-solve log with disagreements, diagnoses, fixes, re-solves
[ ] Sensitivity review signed off
[ ] Author reflection (one page)

Drill key

The checklist is the capstone. Items are the product; the packet is the proof.

Sources

Downing, S. M., & Haladyna, T. M. (Eds.). (2006). Handbook of test development. Lawrence Erlbaum Associates.
National Conference of Bar Examiners. MBE Subject Matter Outline.
Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15(3), 309–334.