Module 3: Designing Objective Assessment Tools
Course Title: Assessment in Learning 1
Module Duration: Weeks 7–9
Target Audience: Pre-service Teacher Education Students
I. Module Overview & Outcomes
Objective assessment tools require students to select or supply a specific, predetermined correct
response. Because scoring is objective and consistent regardless of who evaluates the test, these tools
are widely used to measure knowledge, comprehension, and application efficiently across large student
groups. This module focuses on the principles of constructing high-quality selected-response and short
constructed-response test items, identifying common item-writing flaws, and applying standard
formatting guidelines.
Intended Learning Outcomes (ILOs)
By the end of this module, you should be able to:
1. Differentiate between selected-response and short constructed-response item formats based
on their pedagogical utility.
2. Apply guidelines for constructing multiple-choice, true/false, matching-type, completion, and
identification test items.
3. Identify structural flaws, unintended clues, and ambiguities in draft test items.
4. Revise poorly constructed test items to align with item-writing standards.
II. Lesson Content
Lesson 1: Selected-Response Test Formats
Selected-response items present learners with a problem and a set of options from which they must
choose the correct or best answer.
1. Multiple-Choice Questions (MCQs)
The multiple-choice item is the most versatile and widely used objective test format. It can assess both
low-level recall and higher-level cognitive skills (application, analysis).
[ STEM ] ───────────────────► "Which stage of mitosis involves line-up?"
│
├── [ KEY ] ─────────────► A. Metaphase (Correct Answer)
│
└── [ DISTRACTORS ] ─────► B. Prophase │ Plausible, but
C. Anaphase │ incorrect options
D. Telophase │
Core Rules for Constructing MCQs:
• Rule 1.1: Present a single, clear problem in the stem. The stem should be understandable
without reading the options.
o Poor: Photosynthesis (A) occurs in plants (B) requires oxygen (C) produces sugar (D) all
of these.
o Better: What primary organic compound is produced during photosynthesis?
• Rule 1.2: Avoid negative phrasing when possible. If a negative word (e.g., NOT, EXCEPT) must
be used, capitalize and bold it for emphasis.
o Example: Which of the following is NOT a function of the liver?
• Rule 1.3: Ensure distractors are plausible. Options should appeal to students who have not
mastered the material or who hold common misconceptions.
• Rule 1.4: Avoid grammatical and verbal clues. Ensure all options are grammatically consistent
with the stem.
o Poor: An example of an mammal is an: (A) alligator (B) elephant (C) snake (D) lizard.
(Option B is the only option starting with a vowel).
• Rule 1.5: Keep options uniform in length and structure. Avoid making the correct answer
consistently longer or more detailed than distractors.
• Rule 1.6: Avoid "All of the Above" and "None of the Above." "All of the above" allows students
to guess correctly if they recognize at least two true options; "None of the above" measures
detection of errors rather than knowledge.
2. True/False (Binary-Choice) Items
Binary-choice items consist of a statement that the student evaluates as true or false, correct or
incorrect, or fact or opinion. They are easy to write and cover wide content quickly, but have a high
guessing probability ($50\%$).
Core Rules for Constructing True/False Items:
• Rule 2.1: Test a single idea per item. Do not combine multiple concepts into one sentence.
• Rule 2.2: Avoid absolute qualifiers. Words like always, never, all, and none usually signal a false
statement. Use non-absolute terms with caution.
• Rule 2.3: Avoid negative and double-negative statements.
o Poor: It is not uncommon for warm fronts to fail to produce rain.
o Better: Warm fronts frequently produce rain.
• Rule 2.4: Balance true and false statements. Keep the number of true and false items roughly
equal across the test paper.
3. Matching-Type Items
Matching items assess the ability to identify associations between two related lists of concepts (e.g.,
terms and definitions, causes and effects, symbols and names).
COLUMN A (Premises / Longer Descriptions) COLUMN B (Responses / Short Terms)
1. Measures internal test consistency A. Content Validity
2. Measures alignment with learning outcomes B. Kuder-Richardson 20
3. Measures stability over time C. Test-Retest Reliability
Core Rules for Constructing Matching Items:
• Rule 3.1: Keep content homogeneous. All items in Column A and Column B should belong to the
same topic or category.
• Rule 3.2: Make Column A longer than Column B. Place premises (longer text) on the left
(Column A) and responses (shorter text/single words) on the right (Column B) to reduce reading
fatigue.
• Rule 3.3: Use unequal numbers of items. Supply more options in Column B than premises in
Column A (or explicitly state that responses may be used once, more than once, or not at all) to
prevent guessing by elimination on the final item.
• Rule 3.4: Limit list length. Keep the number of premises between 5 and 10 to avoid
overwhelming students visually.
Lesson 2: Short Constructed-Response Test Formats
Short constructed-response items require students to supply the word, phrase, number, or symbol
necessary to complete a statement or answer a prompt. They reduce guessing significantly compared to
selected-response formats.
1. Completion Items (Fill-in-the-Blank)
Students fill in one or more blanks within a incomplete sentence.
Core Rules:
• Rule 1: Place blanks near or at the end of the sentence. This allows the student to process the
context before encountering the missing word.
o Poor: The ______________ is the instrument used to measure atmospheric pressure.
o Better: The instrument used to measure atmospheric pressure is the ______________.
• Rule 2: Limit blanks to one per sentence. Avoid "mutilated" sentences with multiple blanks that
obscure meaning.
o Poor: In ________, the ________ declared ________ in ________.
• Rule 3: Keep blank lengths uniform. Variable blank lengths give visual clues about the length of
the required response.
2. Short-Answer / Identification Items
Students respond to a direct question with a concise word, phrase, or number.
Core Rules:
• Direct questions are generally preferred over incomplete statements because they are less
ambiguous.
o Incomplete Statement: Water boils at ____________. (Ambiguous: 100°C? 212°F? high
temperature?)
o Direct Question: What is the boiling point of water in degrees Celsius at sea level?
Lesson 3: Summary Matrix of Objective Test Formats
Test Primary Cognitive Key Primary
Best Used For
Format Domain Advantages Limitations
High reliability, Difficult and time-
Comprehensive
Multiple Knowledge to wide coverage, consuming to
unit tests,
Choice Application/Analysis objective construct good
diagnostic tests
scoring distractors
Easy to write, $50\%$ guessing
Quick formative
True / Knowledge and fast to probability,
checks, factual
False Understanding administer and susceptible to
verification
score memorization
Compact
format, Vocabulary,
Limited to lower-
Matching Knowledge / evaluates definitions,
order recall and
Type Association related dates,
associations
concepts classification
efficiently
Eliminates
Susceptible to Terminology,
Knowledge and guessing, tests
Completion ambiguous correct formulas, basic
Recall memory
answers identification
retrieval
III. Learning Activities
Activity 3.1: Item Flaw Identification & Revision
Analyze each draft item below. Identify the item-writing flaw and write a revised version that adheres to
standard rules.
1. Item 1 (Multiple Choice):
Draft: An evaluation that takes place at the end of instruction is an:
A. Formative evaluation
B. Diagnostic assessment
C. Summative evaluation
D. Placement test
a. Flaw Identified:
____________________________________________________________________
b. Revised Item:
____________________________________________________________________
2. Item 2 (True / False):
Draft: Teachers should never use multiple-choice tests because they always measure low-level recall.
a. Flaw Identified:
____________________________________________________________________
b. Revised Item:
____________________________________________________________________
3. Item 3 (Completion):
Draft: The ____________ is calculated by dividing the ____________ by the ____________.
a. Flaw Identified:
____________________________________________________________________
b. Revised Item:
____________________________________________________________________
Activity 3.2: Item Construction Task
Select one specific topic from your specialization/subject area. Draft a mini-quiz containing:
1. Two (2) well-constructed Multiple-Choice Items (Assessing Understanding or Application level).
2. One (1) Matching-Type Set (4 premises, 6 options).
IV. Formative Assessment / Self-Check
1. Multiple Choice: Which of the following is the most significant disadvantage of using True/False
items?
a. A. They take too long to score.
b. B. They have a high probability of correct guessing ($50\%$).
c. C. They cannot measure simple factual knowledge.
d. D. They require complex Table of Specifications planning.
2. Short Answer: Why should the stem of a multiple-choice question contain as much of the item's
context as possible rather than putting context into the choices?