Analysis of Variance (ANOVA)
• Appropriate when the predictors (IVs) are all
categorical and the outcome (DV) is
continuous
– Most common application is to analyze data
from randomized controlled experiments
DataCamp
!
!
Learning by doing
1
Analysis of Variance (ANOVA)
• Appropriate when the predictors (IVs) are all
categorical and the outcome (DV) is
continuous
– Most common application is to analyze data
from randomized controlled experiments
Analysis of Variance (ANOVA)
• More specifically, randomized controlled
experiments that generate more than two
group means
– If only two group means then use:
• Independent t-test
• Dependent t-test
Analysis of Variance (ANOVA)
• If more than two group means then use:
– Between groups ANOVA
– Repeated measures ANOVA
Example
• Working memory training
– Four independent groups (8, 12, 17, 19)
• IV: Number of training sessions
• DV: IQ gain
• Null hypothesis: All groups are equal
Analysis of Variance (ANOVA)
• ANOVA typically involves NHST
• The test statistic is the F-test (F-ratio)
– F = (Variance between groups) /
(Variance within groups)
Analysis of Variance (ANOVA)
• Like the t-test and family of t-distributions
• The F-test has a family of F-distributions
– The distribution to assume depends on
• Number of subjects per group
• Number of groups
One-way ANOVA
• F-ratio
F = between-groups variance / within-groups variance
F = MSBetween / MSWithin
F = MSA / MSS/A
One-way ANOVA
• F = MSA / MSS/A
• MSA = SSA / dfA
• MSS/A = SSS/A/ dfS/A
Summary Table
Source
SS
df
MS
F
A
n Σ(Yj - YT)2
a - 1
SSA/dfA
MSA /MSS/A
S/A
Σ(Yij - Yj)2
a(n -1)
SSS/A/dfS/A
-----
Total
Σ(Yij - YT)2
N - 1
-----
-----
Effect size
•
R2 2
= (eta-sqaured)
η
• η = SSA / SSTotal
2
Assumptions
• DV is continuous (interval or ratio variable)
• DV is normally distributed
• Homogeneity of variance
• Within-groups variance is equivalent for all groups
– Levene’s test