100% found this document useful (1 vote)
1K views4 pages

Frequency of Correct Responses Analysis

The document contains data from a 70 item test administered to 104 students. It includes the percentage of students answering each question correctly (pi), the reliability of the test (KR20) and an interpretation of the reliability. The test showed excellent reliability (rxx=0.91), indicating scores are highly consistent and the test is a reliable measure of the construct it is assessing.

Uploaded by

K Cielo Ragonot
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
100% found this document useful (1 vote)
1K views4 pages

Frequency of Correct Responses Analysis

The document contains data from a 70 item test administered to 104 students. It includes the percentage of students answering each question correctly (pi), the reliability of the test (KR20) and an interpretation of the reliability. The test showed excellent reliability (rxx=0.91), indicating scores are highly consistent and the test is a reliable measure of the construct it is assessing.

Uploaded by

K Cielo Ragonot
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
  • Correct Responses by Students
  • Statistical Reliability Analysis
  • Additional Notes

CORRECT RESPONSES OF STUDENTS

35 34 35 104 104 28.08 SAMPLE 28


SCORES
ITEM
f Pi qi Piqi gold sapphire diamond
1 90 0.865 0.135 0.12 0.883506 34 33 23 90
2 88 0.846 0.154 0.13 31 30 27 88
3 38 0.365 0.635 0.23 25 7 6 38
4 48 0.462 0.538 0.25 20 10 18 48
5 86 0.827 0.173 0.14 35 30 21 86
6 62 0.596 0.404 0.24 30 21 11 62
7 75 0.721 0.279 0.20 31 25 19 75
8 51 0.490 0.510 0.25 27 12 12 51
9 23 0.221 0.779 0.17 14 3 6 23
10 45 0.433 0.567 0.25 27 14 4 45
11 46 0.442 0.558 0.25 18 15 13 46
12 55 0.529 0.471 0.25 24 14 17 55
13 48 0.462 0.538 0.25 27 15 6 48
14 50 0.481 0.519 0.25 18 21 11 50
15 36 0.346 0.654 0.23 10 14 12 36
16 32 0.308 0.692 0.21 13 10 9 32
17 33 0.317 0.683 0.22 19 5 9 33
18 28 0.269 0.731 0.20 12 10 6 28
19 48 0.462 0.538 0.25 15 19 14 48
20 23 0.221 0.779 0.17 6 12 5 23
21 31 0.298 0.702 0.21 16 7 8 31
22 42 0.404 0.596 0.24 15 13 14 42
23 32 0.308 0.692 0.21 24 3 5 32
24 33 0.317 0.683 0.22 23 8 2 33
25 46 0.442 0.558 0.25 31 13 2 46
26 56 0.538 0.462 0.25 33 13 10 56
27 56 0.538 0.462 0.25 30 19 7 56
28 36 0.346 0.654 0.23 19 9 8 36
29 47 0.452 0.548 0.25 22 13 12 47
30 48 0.462 0.538 0.25 26 16 6 48
31 78 0.750 0.250 0.19 34 27 17 78
32 58 0.558 0.442 0.25 28 16 14 58
33 45 0.433 0.567 0.25 17 18 10 45
34 59 0.567 0.433 0.25 28 18 13 59
35 60 0.577 0.423 0.24 28 18 14 60
36 54 0.519 0.481 0.25 26 14 14 54
37 55 0.529 0.471 0.25 23 22 10 55
38 68 0.654 0.346 0.23 35 29 4 68
39 44 0.423 0.577 0.24 24 17 3 44
40 64 0.615 0.385 0.24 29 21 14 64
41 78 0.750 0.250 0.19 33 26 19 78
42 69 0.663 0.337 0.22 33 20 16 69
43 63 0.606 0.394 0.24 32 14 17 63
44 49 0.471 0.529 0.25 22 16 11 49
45 65 0.625 0.375 0.23 32 20 13 65
46 52 0.500 0.500 0.25 25 13 14 52
47 60 0.577 0.423 0.24 32 14 14 60
48 39 0.375 0.625 0.23 22 13 4 39
49 62 0.596 0.404 0.24 33 21 8 62
50 52 0.500 0.500 0.25 22 18 12 52
51 37 0.356 0.644 0.23 12 12 13 37
52 52 0.500 0.500 0.25 26 13 13 52
53 36 0.346 0.654 0.23 23 9 4 36
54 51 0.490 0.510 0.25 29 18 4 51
55 62 0.596 0.404 0.24 33 16 13 62
56 53 0.510 0.490 0.25 29 19 5 53
57 59 0.567 0.433 0.25 26 20 13 59
58 45 0.433 0.567 0.25 26 9 10 45
59 38 0.365 0.635 0.23 22 7 9 38
60 38 0.365 0.635 0.23 24 8 6 38
61 59 0.567 0.433 0.25 31 19 9 59
62 55 0.529 0.471 0.25 24 20 11 55
63 53 0.510 0.490 0.25 27 15 11 53
64 63 0.606 0.394 0.24 33 19 11 63
65 76 0.731 0.269 0.20 33 29 14 76
66 44 0.423 0.577 0.24 23 12 9 44
67 36 0.346 0.654 0.23 9 13 14 36
68 49 0.471 0.529 0.25 30 11 8 49
KR20
69 22 0.212 0.788 0.17 7 9 6 22
70 26 0.250 0.750 0.19 16 5 5 26 rxx = _n__ SD2 – Σpiqi
TOTAL 15.98 n-1 SD2

= _104__ 157.69 – 15.98

104-1 157.69
R = 0.91 EXCELLENT RELIABILITY (1.009) ( 141.71)
=
TEST RELIABILITY is an indication of the consistency of the test. It is not an index of quality 157.69
("is this test a good measure of …?), but of relative reproducibility.
rxx = 0.91 (excellent reliability)
("How repeatable is this test?").
TEST RELIABILITY tells us how likely it is that a student would obtain the same score when he/she
takes the test again.
HIGHER TEST RELIABILITY indicates that the test measures whatever it measures in a consistent manner

RELIABILITINTERPRETATION
.90 and above Excellent reliability. At the level of the best standardized tests
.80-.90 Very good for a classroom test
.70-.80 Good for a classroom test. There are probably a few items which could be improved.
.60-.70 Somewhat low. This test needs to be supplemented by other measures (e.g. more tests) to determine grades. There are probably some items which could be improved.
.50-.60 Suggests need for revision of test, unless it is quite short (ten or fewer items). The test definitely needs to be supplemented by other measures (e.g. more tests) for grading
.50 or below Questionable reliability. This test should not contribute heavily to the course grade, and it needs revision.
ould be improved.
more tests) for grading

CORRECT RESPONSES OF STUDENTS
35
34
35
104
104
28.08 SAMPLE
28
ITEM
SCORES
f
Pi
qi
Piqi
gold
sapphire
diamond
1
90
0.865
0.13
27
56
0.538
0.462
0.25
30
19
7
56
28
36
0.346
0.654
0.23
19
9
8
36
29
47
0.452
0.548
0.25
22
13
12
47
30
48
0.462
0.538
0.25
59
38
0.365
0.635
0.23
22
7
9
38
60
38
0.365
0.635
0.23
24
8
6
38
61
59
0.567
0.433
0.25
31
19
9
59
62
55
0.529
0.471
0.25
24
ould be improved.
more tests) for grading

You might also like