Utility in Test Development - Multiple Choice Questions
1. Which of the following best describes the term 'utility' in the context of psychological testing?
A. The accuracy of test scores in predicting outcomes
B. The reliability of a test across multiple administrations
C. The usefulness or practical value of a test in improving decision-making efficiency
D. The consistency of test instructions
Answer: C
Explanation: Utility refers to how useful or practical a test is in making efficient decisions based on
test scores.
2. What does a high reliability index indicate in the context of test utility?
A. The test is highly cost-effective
B. The test is valid for any population
C. The test consistently measures what it is supposed to measure
D. The test measures the intended construct accurately
Answer: C
Explanation: A high reliability index means the test results are consistent and dependable.
3. Despite being psychometrically sound, a test may have low utility if:
A. It has a low cost of administration
B. Test takers do not follow directions
C. It is valid and reliable
D. It is used for a short time
Answer: B
Explanation: Utility can be compromised if test takers fail to follow directions, even if the test is
psychometrically sound.
4. What is the primary function of utility analysis in test development?
A. To compute test scores
B. To establish test validity
C. To assess the cost-benefit ratio of using a test
D. To rank test takers
Answer: C
Explanation: Utility analysis evaluates whether the benefits of using a test outweigh the costs.
5. Which of the following methods uses expert judgment to set cut scores based on hypothetical
performance?
A. Bookmark Method
B. Angoff Method
C. Known Groups Method
D. Item Response Theory
Answer: B
Explanation: The Angoff Method involves expert judgments about how a minimally competent
person would respond to test items.
6. Which method involves placing a bookmark between items in a booklet to determine the cut
score?
A. Item Mapping
B. Known Groups Method
C. Bookmark Method
D. Naylor-Shine Table
Answer: C
Explanation: The Bookmark Method involves experts placing a bookmark at the point in a booklet of
items that separates minimally competent individuals from those who are not.