Absolutely.
For a major quiz, longer explanations help you understand the concepts rather than
just memorize definitions. Below is a more detailed reviewer with expanded descriptions,
explanations, examples, interpretations, assumptions, and important points professors commonly
ask in quizzes and exams.
ANALYSIS OF VARIANCE (ANOVA)
Introduction
Analysis of Variance (ANOVA) is a statistical technique used to determine whether there are
significant differences among the means of three or more groups. It helps researchers decide
whether observed differences between groups are likely caused by an experimental treatment or
simply by random variation.
ANOVA was developed by and is one of the most widely used inferential statistical methods in
research.
The fundamental purpose of ANOVA is to test whether group means differ enough that the
difference cannot reasonably be attributed to chance alone.
Why ANOVA Is Needed
Suppose a teacher wants to know whether three teaching methods produce different student
performances.
Group A = Lecture Method
Group B = Interactive Method
Group C = Online Method
If we only had two groups, a t-test would be enough.
However, with three or more groups, conducting multiple t-tests creates a higher risk of making
a Type I Error (incorrectly rejecting a true null hypothesis).
ANOVA solves this problem by comparing all groups simultaneously using a single test.
The Logic Behind ANOVA
ANOVA works by comparing two sources of variation:
1. Between-Group Variation
This refers to differences among the means of different groups.
For example:
Group A Mean = 70
Group B Mean = 75
Group C Mean = 90
The variation between these averages is called between-group variation.
Large between-group variation suggests that the treatment or grouping factor may have an effect.
2. Within-Group Variation
This refers to differences among individuals inside the same group.
Example:
Group A Scores
68, 70, 72
Although the mean is 70, students do not have identical scores.
These differences represent within-group variation.
ANOVA Principle
ANOVA compares:
\text{Between-Group Variance}
with
\text{Within-Group Variance}
If the between-group variance is substantially larger than the within-group variance, there is
evidence that the group means are significantly different.
F Statistic
The ANOVA test uses the F-ratio.
Where:
MSBetween = Mean Square Between Groups
MSWithin = Mean Square Within Groups
The F-ratio measures how much larger the between-group variability is compared to the within-
group variability.
Hypotheses in ANOVA
Null Hypothesis (H₀)
All population means are equal.
\mu_1=\mu_2=\mu_3
This means that any observed differences occurred by chance.
Alternative Hypothesis (H₁)
At least one group mean differs from the others.
ANOVA does not immediately identify which groups differ.
It only tells us that a difference exists somewhere among the groups.
Types of ANOVA
One-Way ANOVA
One-Way ANOVA examines the effect of a single independent variable on one dependent
variable.
Example:
Independent Variable: Teaching Method
Dependent Variable: Exam Score
Research Question:
"Does teaching method significantly affect examination performance?"
Only one factor is involved.
Two-Way ANOVA
Two-Way ANOVA examines the effects of two independent variables simultaneously.
Example:
Independent Variables:
Teaching Method
Gender
Dependent Variable:
Exam Score
Two-Way ANOVA can answer three questions:
1. Does teaching method affect scores?
2. Does gender affect scores?
3. Does gender influence how teaching methods affect scores?
The third question is called interaction.
Interaction Effect
An interaction occurs when the effect of one factor changes depending on another factor.
Example:
Method A may work best for males.
Method B may work best for females.
Because the effectiveness depends on gender, an interaction effect exists.
This is one of the major advantages of Two-Way ANOVA.
Assumptions of ANOVA
ANOVA requires several assumptions.
Normality
Data should be approximately normally distributed.
A normal distribution forms a bell-shaped curve.
Independence
Each observation should be independent of all others.
One participant's score should not affect another participant's score.
Homogeneity of Variance
The variances of all groups should be roughly equal.
Groups should show similar levels of variability.
Advantages of ANOVA
Compares several groups simultaneously.
Reduces Type I Error.
Allows investigation of multiple factors.
Commonly used in education, medicine, business, agriculture, and psychology.
Limitations of ANOVA
Does not identify which groups differ.
Sensitive to assumption violations.
Requires follow-up tests called Post Hoc Tests.
Examples of Post Hoc Tests:
Tukey Test
Scheffé Test
Bonferroni Test
CORRELATION
Introduction
Correlation is a statistical technique used to determine the degree to which two variables are
related.
It answers questions such as:
Do students who study more earn higher grades?
Are taller people generally heavier?
Does income increase with age?
Correlation measures both the direction and strength of a relationship.
Correlation Coefficient
The correlation coefficient is represented by:
r
Its value ranges from:
The closer the value is to ±1, the stronger the relationship.
Understanding Direction
Positive Correlation
A positive correlation means both variables move in the same direction.
As one variable increases, the other also increases.
Examples:
Study time and grades
Height and weight
Education and income
Negative Correlation
A negative correlation means variables move in opposite directions.
As one increases, the other decreases.
Examples:
Product price and sales
Exercise and body fat percentage
Stress and sleep quality
Zero Correlation
No consistent relationship exists.
Changes in one variable do not predict changes in the other.
Example:
Shoe size and intelligence.
Strength of Correlation
Correlation Coefficient Interpretation
0.00 – 0.09 Negligible
0.10 – 0.29 Weak
0.30 – 0.49 Moderate
0.50 – 0.69 Strong
0.70 – 1.00 Very Strong
Always use the absolute value when judging strength.
Correlation vs Causation
One of the most important principles in statistics is:
Correlation does not imply causation.
Just because two variables are related does not mean one causes the other.
Example:
Ice cream sales and drowning incidents rise together.
This does not mean ice cream causes drowning.
A third variable, temperature, affects both.
This is known as a lurking or confounding variable.
Scatter Plot
A scatter plot is a graph that displays paired observations.
Each dot represents one observation.
The pattern of dots helps determine:
Direction
Strength
Outliers
Linearity
The closer points are to a straight line, the stronger the relationship.
Types of Correlation
Pearson Correlation
Measures linear relationships between continuous variables.
Most common correlation method.
Examples:
Height and weight
Income and spending
Spearman Rank Correlation
Used when:
Data are ordinal
Data are not normally distributed
Relationship is monotonic
Examples:
Class rankings
Satisfaction ratings
Point-Biserial Correlation
Used when:
One variable is continuous and one variable has only two categories.
Example:
Gender and salary.
Significance Testing in Correlation
The null hypothesis states:
H_0:r=0
There is no relationship.
The alternative hypothesis states:
H_1:r\ne0
A relationship exists.
If:
p ≤ 0.05
Reject H₀.
The correlation is statistically significant.
REGRESSION ANALYSIS
Introduction
Regression is a statistical technique used to examine how one variable affects another and to
make predictions.
Unlike correlation, regression allows us to estimate future outcomes.
For this reason, regression is one of the most important tools in business, economics, finance,
medicine, and social science research.
Purpose of Regression
Regression helps answer questions such as:
How much does studying affect grades?
How much does advertising affect sales?
How much does education affect salary?
Regression not only identifies relationships but also quantifies them.
Variables in Regression
Independent Variable (X)
The predictor variable.
The factor believed to influence another variable.
Examples:
Study hours
Income
Age
Dependent Variable (Y)
The outcome variable.
The variable being predicted.
Examples:
Exam score
Sales
Salary
Simple Linear Regression
Uses one independent variable.
The model is:
Where:
Y = Predicted outcome
a = Intercept
b = Slope
X = Independent variable
Understanding the Intercept
The intercept represents the predicted value of Y when X equals zero.
Example:
Score=50+5X
When X = 0
Score = 50
Thus, 50 is the intercept.
Understanding the Slope
The slope represents the amount of change in Y for every one-unit increase in X.
Example:
Score=50+5X
Slope = 5
This means every additional hour of study increases predicted score by 5 points.
Multiple Regression
Uses two or more independent variables.
Example:
Predicting salary using:
Education
Experience
Age
Model:
Multiple regression is often more realistic because many outcomes are influenced by several
factors.
Residuals
A residual is the difference between the observed value and the predicted value.
Residual=Actual-Predicted
Small residuals indicate good predictions.
Large residuals indicate poor predictions.
Coefficient of Determination (R²)
R² tells us how much variation in the dependent variable is explained by the model.
R^2
Example:
R² = 0.75
Interpretation:
75% of variation in exam scores is explained by study hours.
25% is explained by other factors.
Assumptions of Regression
1. Linearity
2. Independence
3. Homoscedasticity
4. Normality of residuals
Violating these assumptions may reduce the accuracy of predictions.
COMPARISON OF ANOVA, CORRELATION, AND
REGRESSION
Aspect ANOVA Correlation Regression
Main Purpose Compare means Measure relationship Predict outcomes
Main Statistic F-ratio r Regression coefficients
Dependent and independent
Variables Groups Two variables
variables
Strength and
Output Significant difference Prediction equation
direction
Prediction? No No Yes
Compare teaching Study hours and
Example Predict grades from study hours
methods grades
FINAL QUIZ TIP
A common exam trick is asking the difference among the three:
ANOVA = compares group means.
Correlation = measures the strength and direction of relationships.
Regression = predicts and explains outcomes using one or more predictors.
If you remember those three core purposes, you'll already answer many major-quiz questions
correctly.