Understanding ANOVA: One-Way Analysis
Understanding ANOVA: One-Way Analysis
The analysis of variance (ANOVA) is a statistical technique to test whether the means of three or
more populations are equal or not. This technique was developed by R A Fisher. This technique
is widely used in Professional Business and Physical Sciences.
A table showing the source of variation, the sum of squares, degrees of freedom, mean squares
and the formula for the F ratio is called ANOVA table.
If the given data is classified according to one factor, the classification is called one way
classification. Then ANOVA table for one-way classification is to be constructed.
If the given data is classified according to two factors, the classification is called two-way
classification. Then ANOVA table for two-way classification is to be constructed.
Notations:
𝑻 − Total sum all the observations
𝑁 − Number of observations.
𝑐 − Number of columns.
𝑇2
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 + ⋯ + Σ𝑋𝑘2 − 𝑁
Working rule:
Output
Machine 1 Machine 2 Machine 3
10 9 20
5 7 16
11 5 10
10 6 4
Output
𝑿𝟏 𝑋12 𝑋2 𝑋22 𝑋3 𝑋32
10 100 9 81 20 400
5 25 7 49 16 256
11 121 5 25 10 100
10 100 6 36 4 16
36 346 27 191 50 772
𝚺𝑿𝟏 Σ𝑋12 𝚺𝑿𝟐 Σ𝑋22 𝚺𝑿𝟑 Σ𝑋32
𝑁 = 4 + 4 + 4 = 12
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2 362 272 502 1132
𝑆𝑆𝐶 = + + − = + + − = 67.17
𝑛1 𝑛2 𝑛3 𝑁 4 4 4 12
𝑇2 1132
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 − = 346 + 191 + 772 − = 244.92
𝑁 12
Assume 𝐻0 : 𝜇1 = 𝜇2 = 𝜇3. All the three samples have equal population means.
Output
𝑿𝟏 𝑋12 𝑋2 𝑋22 𝑋3 𝑋32
10 100 9 81 14 196
12 144 7 49 11 121
9 81 12 144 15 225
16 256 11 121 14 196
13 169 11 121 16 256
60 750 50 516 70 994
𝚺𝑿𝟏 Σ𝑋12 Σ𝑋2 Σ𝑋22 Σ𝑋3 Σ𝑋32
𝑁 = 5 + 5 + 5 = 15
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2 602 502 702 1802
𝑆𝑆𝐶 = + + − = + + − = 40
𝑛1 𝑛2 𝑛3 𝑁 5 5 5 15
𝑇2 1802
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 − = 750 + 516 + 994 − = 100
𝑁 15
Reject 𝐻0 . All the three samples have not equal population means.
The sales data have a common factor 100. Divide all the above values by 100.
𝑋1 5 4 7 3 6
𝑋2 3 7 4 6 −
𝑋3 5 3 5 4 3
Assume 𝐻0 : 𝜇1 = 𝜇2 = 𝜇3 . All the three salesmen tend to make sales of the same size.
Output
𝑿𝟏 𝑋12 𝑋2 𝑋22 𝑋3 𝑋32
5 25 3 9 5 25
4 16 7 49 3 9
7 49 4 16 5 25
8 64 6 36 4 16
6 36 - - 3 9
30 190 20 110 20 84
𝚺𝑿𝟏 Σ𝑋12 Σ𝑋2 Σ𝑋22 Σ𝑋3 Σ𝑋32
𝑁 = 5 + 4 + 5 = 14
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2 302 202 202 702
𝑆𝑆𝐶 = + + − = + + − = 10
𝑛1 𝑛2 𝑛3 𝑁 5 4 5 14
𝑇2 702
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 − = 190 + 110 + 84 − = 34
𝑁 14
All the three salesmen tend to make sales of the same size.
𝑋1 5 10 3 6 1
𝑋2 0 −5 4 −2 3
𝑋3 −2 −6 0 −4 −
To find: SSC and SSE
Output
𝑿𝟏 𝑋12 𝑋2 𝑋22 𝑋3 𝑋32
𝟓 25 0 0 −2 4
𝟏𝟎 100 −5 25 −6 36
𝟑 9 4 16 0 0
𝟔 36 −2 4 −4 16
𝟏 1 3 9 − −
𝟐𝟓 171 0 54 −12 56
𝚺𝑿𝟏 Σ𝑋12 Σ𝑋2 Σ𝑋22 Σ𝑋3 Σ𝑋32
𝑁 = 5 = 5 + 4 = 14
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2 252 02 (−12)2 132
𝑆𝑆𝐶 = + + − = + + − = 148.93
𝑛1 𝑛2 𝑛3 𝑁 5 5 4 14
𝑇2 132
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 − = 171 + 54 + 56 − = 268.93
𝑁 14
Schools
𝑨 𝑩 𝑪 𝑫
8 12 18 13
10 11 12 9
12 9 16 12
8 14 6 16
7 4 8 15
𝑿𝟏 −2 0 2 −2 −3
𝑿𝟐 2 1 −1 4 −6
𝑿𝟑 8 2 6 −4 −2
𝑿𝟒 3 −1 2 6 5
Output
𝑿𝟏 𝑋2 𝑋12 𝑋22 𝑋3 𝑋32 𝑋4 𝑋42
−𝟐 4 2 4 8 64 3 9
𝟎 0 1 1 2 4 −1 1
𝟐 4 −1 1 6 36 2 4
−𝟐 4 4 16 −4 16 6 36
−𝟑 9 −6 36 −2 4 5 25
−𝟓 21 0 58 10 124 15 75
2
𝚺𝑿𝟏 Σ𝑋1 Σ𝑋2 Σ𝑋22 Σ𝑋3 Σ𝑋32 Σ𝑋4 Σ𝑋42
𝑁 = 5 + 5 + 5 + 5 = 20
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2
𝑆𝑆𝐶 = + + −
𝑛1 𝑛2 𝑛3 𝑁
= 5 + 0 + 20 + 45 − 20 = 50
𝟖 𝟕 𝟏𝟐
𝟏𝟎 𝟓 𝟗
𝟕 𝟏𝟎 𝟏𝟑
𝟏𝟒 𝟗 𝟏𝟐
𝟏𝟏 𝟗 𝟏𝟒
Assume 𝐻0 : 𝜇1 = 𝜇2 = 𝜇3 . All the three samples have taken from the same population.
𝑿𝟏 −2 0 −3 4 1
𝑿𝟐 −3 −5 0 −1 −1
𝑿𝟑 2 −1 3 2 4
To find: SSC and SSE
𝑁 = 5 + 5 + 5 = 15
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2
𝑆𝑆𝐶 = + + −
𝑛1 𝑛2 𝑛3 𝑁
= 0 + 20 + 20 = 40
𝑇2
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 − = 30 + 36 + 34 − 0 = 100
𝑁
All the three samples have not taken from the same population.
𝑨 𝑩 𝑪
𝟐𝟎 𝟏𝟖 𝟐𝟓
𝟐𝟏 𝟐𝟎 𝟐𝟖
𝟐𝟑 𝟏𝟕 𝟐𝟐
𝟏𝟔 𝟏𝟓 𝟐𝟖
𝟐𝟎 𝟐𝟓 𝟑𝟐
Find out if the average yields of land under different varieties of seeds show
significant differences.
𝑿𝟏 0 1 3 −4 0
𝑿𝟐 −2 0 −3 −5 5
𝑿𝟑 5 8 2 8 12
To find: SSC and SSE
𝑁 = 5 + 5 + 5 = 15
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2
𝑆𝑆𝐶 = + + −
𝑛1 𝑛2 𝑛3 𝑁
= 0 + 5 + 245 − 60 = 190
𝑇2 302
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 − = 26 + 63 + 301 − = 390 − 60 = 330
𝑁 15
The average yields of land under different varieties of seeds show significant differences.
Do the data indicate that the prices in the three cities are significantly different?
Assume 𝐻0 : 𝜇1 = 𝜇2 = 𝜇3 .
𝑿𝟏 6 −2 2 4
𝑿𝟐 4 0 0 −4
𝑿𝟑 −6 0 −2 −2
To find: SSC and SSE
𝑁 = 4 + 4 + 4 = 12
(Σ𝑋1 )2 (Σ𝑋2 )2 (Σ𝑋3 )2 𝑇2
𝑆𝑆𝐶 = + + −
𝑛1 𝑛2 𝑛3 𝑁
= 25 + 0 + 25 − 0 = 50
𝑇2
𝑆𝑆𝑇 = Σ𝑋12 + Σ𝑋22 + Σ𝑋32 − = 60 + 32 + 44 − 0 = 136
𝑁
In a two-way classification, the data are classified according to two different criteria or factors.
Expansion of abbreviations:
SSC – Sum of squares between columns CF – Correction Factor
SSR – Sum of squares between rows MSC – Mean squares of variations between columns
SST – Total sum of squares of variations MSR – Mean squares of variations between rows
SSE – Sum of squares due to errors MSE - Mean squares of variations between rows
Notation:
𝑇1 , 𝑇2 , 𝑇3 , 𝑇4 −Row totals 𝑇 − Grand total
𝑇5 , 𝑇6 , 𝑇7 − Column Totals N – Total number of elements
,
𝑀𝑆𝐶
𝐹𝐶 = , 𝑖𝑓 𝑀𝑆𝐶 > 𝑀𝑆𝐸. 𝑅𝑒𝑐𝑖𝑝𝑟𝑜𝑐𝑎𝑡𝑒 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒.
𝑀𝑆𝐸
𝑀𝑆𝑅
𝐹𝑅 = , 𝑖𝑓 𝑀𝑆𝑅 > 𝑀𝑆𝐸. 𝑅𝑒𝑐𝑖𝑝𝑟𝑜𝑐𝑎𝑡𝑒 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒.
𝑀𝑆𝐸
𝑹𝟏 𝑹𝟐 𝑹𝟑 𝑹𝟒 Total
𝑪𝟏 𝑎1 𝑏1 𝑐1 𝑑1 𝑇5
𝑪𝟐 𝑎2 𝑏2 𝑐2 𝑑2 𝑇6
𝑪𝟑 𝑎3 𝑏3 𝑐3 𝑑3 𝑇7
Total 𝑇1 𝑇2 𝑇3 𝑇4 𝑇
𝑇2
𝐶𝐹 = 𝑁
Working rule:
(v) Assume 𝐻0 :There is no significant difference between rows and between columns.
(vi) Construct ANOVA table for two-way classification.
Under 𝐻0 ,
𝑀𝑆𝐶
𝐹𝐶 =
, 𝑖𝑓 𝑀𝑆𝐶 > 𝑀𝑆𝐸. 𝑅𝑒𝑐𝑖𝑝𝑟𝑜𝑐𝑎𝑡𝑒 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒.
𝑀𝑆𝐸
𝑀𝑆𝑅
𝐹𝑅 = , 𝑖𝑓 𝑀𝑆𝑅 > 𝑀𝑆𝐸. 𝑅𝑒𝑐𝑖𝑝𝑟𝑜𝑐𝑎𝑡𝑒 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒.
𝑀𝑆𝐸
(vii) Find tabulated value at 𝛼 level at 𝜈1 , 𝜈2 degrees of freedom.
Where 𝜈1 - Degrees of freedom of the numerator
𝜈2 - Degrees of freedom of the denominator
(viii) If calculated value < tabulated value, accept 𝐻0 . Reject otherwise.
Assume 𝑯𝟎 : There is no significant difference between the four workers with respect to
mean productivity and mean productivity is the same for five different machines.
(i) Is there any significant difference in the sales made by the four salesmen?
(ii) Is there any significant difference in the sales made during different months?
Assume 𝑯𝟎 : There is no significant difference in the sales made by the four salesmen and
during different months.
The given data are coded by subtracting 40 from each observation.
A B C D Total
Summer 10 0 8 −1 17
Winter 6 8 10 5 29
Monsoon −1 4 0 −1 2
Total 15 12 18 3 48
𝑇 2 482
𝐶𝐹 = = = 192
𝑁 12
𝑇12 𝑇22 𝑇32 152 122 182 32
𝑆𝑆𝐶 = + + − 𝐶𝐹 = + + + − 192 = 42
3 3 3 3 3 3 3
𝑇42 𝑇52 𝑇62 172 292 22
𝑆𝑆𝑅 = + + − 𝐶𝐹 = + + − 192 = 91.5
4 4 4 4 4 4
Conclusion:
A B C D Total
Summer −2 0 1 −1 −2
Winter 5 2 9 −4 12
Monsoon 0 −2 2 2 2
Total 3 0 12 −3 12
𝑇 2 122
𝐶𝐹 = = = 12
𝑁 12
𝑇12 𝑇22 𝑇32 32 02 122 (−3)2
𝑆𝑆𝐶 = + + − 𝐶𝐹 = + + + − 12 = 42
3 3 3 3 3 3 3
= (4 + 25 + 0) + (0 + 4 + 4) + (1 + 81 + 4) + (1 + 16 + 4) − 12
= 29 + 8 + 86 + 21 − 12 = 132
Conclusion:
Assume 𝑯𝟎 : The salesmen and seasons are alike so far as the sales are concerned.
𝑇 2 (0)2
𝐶𝐹 = = =0
𝑁 9
𝑇12 𝑇22 𝑇32
𝑆𝑆𝐶 = + + − 𝐶𝐹
3 3 3
02 32 (−9)2 62
= + + + − 0 = 42
3 3 3 3
𝑇42 𝑇52 𝑇62
𝑆𝑆𝑅 = + + − 𝐶𝐹
4 4 4
82 02 (−8)2
= + + − 0 = 32
4 4 4
= 56 + 41 + 83 + 30 = 210
Conclusion:
Assume 𝑯𝟎 : The performance of three detergents are equal and the performance of three
different temperature of waters are equal.
𝑇 2 562
𝐶𝐹 = = = 348.44
𝑁 9
𝑇12 𝑇22 𝑇32
𝑆𝑆𝐶 = + + − 𝐶𝐹
3 3 3
102 32 432
= + + − 348.44 = 304.22
3 3 3
𝑇42 𝑇52 𝑇62
𝑆𝑆𝑅 = + + − 𝐶𝐹
4 4 4
292 192 82
= + + − 348.44 = 73.55
4 4 4
= 439.56
Conclusion:
(i) From the above table, calculated value of 𝐹𝐶 = 9.85
The tabulated value of 𝐹𝐶 for (2, 4) at 5% level of significance is 6.94
Calculated value > Tabulated value. Reject 𝐻0 .
Therefore, performance of three detergents are not equal.
𝑇 2 842
𝐶𝐹 = = = 588
𝑁 12
𝑇12 𝑇22 𝑇32 𝑇42
𝑆𝑆𝐶 = + + + − 𝐶𝐹
3 3 3 3
212 152 242 242
= + + + − 588 = 18
3 3 3 3
= 36
= 36 − (18 + 8) = 10
Conclusion: