| Penn State People | Departments | Penn State

Writing multiple choice items to assess higher-order thinking


Although multiple choice test items are well-suited for assessing fact recall and comprehension, with some extra effort, they can also be used to assess higher-order thinking such as application, analysis and evaluation. The category of intellectual ability assessed by your multiple choice questions is driven by your learning objectives, which can be used to construct a test blueprint to help in planning your test.


If your objective is to have students achieve higher-order thinking, it is necessary that the test items reflect this intention. A multiple choice item developed to assess higher-order thinking usually provides a situation/scenario or graphic/chart followed by several questions that require students to use what they have learned to provide the correct answer. For example, an item may provide a scenario that describes the symptoms of a patient and asks learners to judge which stage of a disease that particular patient exemplifies. Compare this item to one that asks learners to recall the symptoms of a particular stage of a disease. The former provides an opportunity for learners to apply what they have learned; the latter merely requires students to remember the facts.


Developing test items to assess higher-order thinking is not an easy task. A useful technique is to start from your existing items and transform them into items assessing more than recalling facts. The “Assessing more than facts” resource provides examples of how you can transform your items. The additional resources provide a range of examples of multiple choice items developed to assess different levels of thinking.




Resources

  • Assessing more than facts Opens in new window
    This link provides examples for constructing multiple choice items that assess comprehension, application, and analysis.
  • 14 Rules for Writing Multiple-Choice Questions Opens in new window (pdf) Used with permission, CTL,
    Brigham Young University

    Pages 1 and 2 contain comparisons of multiple choice items written to assess recall versus application of knowledge. These may give you some ideas about how to transform recall items to items that require application.
  • Techniques for writing multiple-choice items that demand critical thinking Opens in new window
    This Web resource provides examples of multiple choice items that assess intellectual skills, such as analogical thinking, application and evaluation.
  • Writing good multiple-choice exams Opens in new window (pdf)
    This is a comprehensive resource on writing multiple choice exams. Pages 20 to 24 provide examples of multiple choice items written to measure learning outcomes of different categories of intellectual skills. On page 30 to 32, scenario-based problem-solving item sets exemplify items that test complex thinking, application and integration of knowledge.