RELIABILITY
Test Rater Test Test
taker- reliability administr reliability
related a-tion
reliability reliability
1 Take enough samples of behaviour. X
2 Exclude items which do not discriminate well between X
weaker and stronger students.
3 Do not allow candidates too much freedom X X
4 Write unambiguous items X X
5 Provide clear and explicit instructions X
6 Ensure that tests are well laid out and perfectly legible X
7 Make candidates familiar with format and testing X
techniques
8 Provide uniform and non-distracting conditions X
of administration
9 Use items that permit scoring which is as objective X
as possible
10 Provide a detailed scoring key X X
11 Train scorers X
12 Identify candidates by number, not name X
13 Employ multiple, independent scoring X
Notes:
• Test taker-related reliability: consistency in a student’s performance
• Rater reliability: consistency among scorers
• Test administration reliability: consistency in test conditions
• Test reliability: overall consistency and accuracy of the test