Unit 3 & 4: Correlation and Regression Analysis
Unit 3: Correlation Analysis
Concept of Correlation
Correlation refers to a statistical technique that measures and describes the relationship
between two or more variables. It tells us whether an increase or decrease in one variable
will lead to an increase or decrease in another variable. The purpose of correlation is not
to establish cause and effect, but rather to identify the strength and direction of
association. In simple terms, correlation answers the question – ‘Are these two variables
moving together, and if yes, how strongly?’
Types of Correlation
1. Positive Correlation:
When both variables move in the same direction. For example, as income increases,
expenditure also increases. This means that the two variables are directly related.
2. Negative Correlation:
When the variables move in opposite directions. For example, as the price of a
commodity increases, its demand decreases. This indicates an inverse relationship
between the variables.
3. Zero Correlation:
When there is no relationship between the variables. For instance, a person’s height and
intelligence are usually unrelated.
Karl Pearson’s Coefficient of Correlation
Karl Pearson developed a method to measure the degree of linear relationship between
two variables, known as Pearson’s coefficient of correlation, represented by ‘r’. This
coefficient indicates both the strength and direction of the relationship. The value of ‘r’
ranges from -1 to +1.
• r = +1 indicates a perfect positive correlation.
• r = -1 indicates a perfect negative correlation.
• r = 0 indicates no correlation.
Formula:
r = Σ[(x - x̄)(y - ȳ)] / √[Σ(x - x̄)² × Σ(y - ȳ)²]
Where:
x and y = individual data values of the two variables
x̄ and ȳ = mean values of x and y
r = correlation coefficient
Karl Pearson’s method assumes that the relationship between the variables is linear and
that the data are quantitative and normally distributed.
Spearman’s Rank Correlation
Spearman’s Rank Correlation Coefficient, represented by ρ (rho), is used when the data
are in ranks rather than actual values or when the relationship is not linear. It measures
how well the relationship between two variables can be described using a monotonic
function.
Formula:
ρ = 1 - [ (6 × Σd²) / (n × (n² - 1)) ]
Where:
d = difference between the ranks of each pair of observations
n = number of observations
Interpretation:
• ρ = +1 → Perfect positive correlation
• ρ = -1 → Perfect negative correlation
• ρ = 0 → No correlation
This method is especially helpful when dealing with qualitative data such as ranks or
preferences, for example ranking students according to performance.
Conclusion
Correlation analysis plays a vital role in understanding relationships between variables in
economics, management, psychology, and other social sciences. It helps in forecasting
and decision-making by revealing how one variable behaves when another changes.
Unit 4: Regression Analysis
Concept of Regression
Regression analysis is a statistical technique used to establish the nature and strength of
the relationship between one dependent variable and one or more independent variables.
While correlation tells us the degree of relationship, regression helps us to predict the
value of one variable based on the value of another.
For example, if we know the relationship between income and expenditure, regression
can help us predict how much a person will spend if their income changes.
Two Regression Equations
When studying two variables (say, X and Y), we can form two regression equations:
1. Regression Equation of Y on X:
Y = a + bX
This equation helps to estimate the value of Y when X is known.
2. Regression Equation of X on Y:
X = a' + b'Y
This equation helps to estimate the value of X when Y is known.
Here, ‘a’ and ‘a′’ are intercepts, and ‘b’ and ‘b′’ are regression coefficients.
Regression Coefficients and Their Properties
Regression coefficients represent the amount of change in the dependent variable for a
one-unit change in the independent variable.
Properties of Regression Coefficients:
1. Both regression coefficients (bxy and byx) have the same sign.
2. If one coefficient is greater than 1, the other must be less than 1.
3. The correlation coefficient ‘r’ is the geometric mean of the two regression coefficients:
r = √(bxy × byx)
4. Regression coefficients are independent of change in origin but not of scale.
5. The line of regression passes through the mean of both variables.
Multiple Regression and Its Applications
Multiple regression is an extension of simple regression where two or more independent
variables are used to predict the value of a single dependent variable. It is used when the
dependent variable is influenced by more than one factor.
For example, the sales of a company may depend on factors like advertising expenditure,
price, and income level of consumers.
The general form of the multiple regression equation is:
Y = a + b₁X₁ + b₂X₂ + b₃X₃ + ... + bₙXₙ
Applications of Multiple Regression:
• In economics: to forecast consumption, investment, or demand.
• In management: to study the effect of price, promotion, and quality on sales.
• In social sciences: to analyze the impact of multiple social or psychological factors on
behavior.
Conclusion
Regression analysis is a powerful statistical tool that goes beyond correlation by
providing a way to predict outcomes and make informed decisions. It helps in
establishing cause-and-effect relationships and understanding how changes in one or
more variables influence another. Together, correlation and regression form the
foundation of data-driven analysis in research, economics, and business decision-making.