Chapter 1
Chapter 1
INTRODUCTION
(a) Economic theory: forms the basis for any econometric work, and
should really be the starting point for econometric analysis.
(c) Statistics: It provides the econometrician with the know-how and tools of
data collection, processing, analysis and presentation of results. Thus statistics
helps to test theories and explain the results.
CORRELATION REGRESSION
Assumes symmetry between X and Y Assumes asymmetry between X and
i.e., there is no distinction as to Y; i.e., distinguishes which variable is
which variable is dependent/causality dependent and which is explanatory.
is not important. causality is important.
– There are basically two types of regression analysis, i.e., simple regression
analysis and multiple regression analysis.
Normally distributed: when the error term is normally distributed, so are the
estimated coefficients.
– Ordinary least squares(OLS) is the most common method used to fit a line to
the data for estimation the regression
– The method of OLS does not minimize the sum of the error term, but
minimizes error/residuals sum of squares
i i 1 2 2 i 3 3i
u 2
(Y B B X B X .... Bk X ki ) 2
– To obtain values of the regression coefficients, the derivatives are taken with
respect to the regression coefficients and set equal to zero.
• From the expressed regression model above, the error term is thus
obtained as:
ei Y 0 1 X 1 2 X 2
2
• Thus, to obtain the OLS estimators, we need to obtain the first order
partial derivatives of (residuals sum of squares (RSS) and equate them
to zero, i.e. optimization.
ei 2
2
0
2
Y 0 1 X 1 2 X 2
2
0
Y 0 1 X 1 2 X 2 0
...⇨
⇨ Y n 0 1 X 1 2 X 2 0
....
Thus,
n 0 1 X 1 2 X 2 Y ........................................................(1)
2 Y 0 1 X 1 2 X 2 . X 1 0
1
2.
0
1 0 1 1 1
2
Y . X X X X X 2
2 2
2 1
Y .X 1 0 X 1 1 X 1 2 X 1 X 2 0
2
Thus,
0 X 1 1 X 1 2 X 1 X 2 Y . X 1 .........................................(2)
2
2 Y 0 1 X 1 2 X 2 . X 2 0
2
2
0
2
Y .X 2 0 X 2 1 X 1 X 2 2 X 2
2
........ Y . X 2 0 X 2 1 X 1 X 2 2 X 2 0
2
0 X 2 1 X 1 X 2 2 X 2 Y . X 2 .......................................(3)
2
0 X 2 1 X 1 X 2 2 X 2 Y .X 2 • ,
X 1
X 1 X1 X 1 X 2 .. 1 Y . X 1
2
Y . X
X 2 X X 2 2 2
2
X2
1
, October 2024
18 Prepared by Urgaia Rissa(PhD) for MBA 28
18 October 2024 Prepared by Urgaia Rissa(PhD) for MBA 29
1.8 The Coefficient of Determination in Multiple Regression Analysis
Y 1 2 X 2 ... k X k u
ESS k 1
F k 1, n k
RSS n k
ESS
k 1 R 2 k 1
TSS
n k n k
RSS 1 R 2
TSS
– Note that ESS/TSS is the definition of R2 and RSS/TSS is equal to (1 – R2).
– It can be expressed in terms of R2 by dividing the numerator and denominator
by TSS, the total sum of squares.
y u2
y 2 2
• The ANOVA table therefore shows the sum of squares (SS), degrees of
freedom (df), mean sum of squares (MSS) and source of variation.
(ESS)
y or x
2 2 2
ESS 2 x 2
MSS reg
df k 1
u 2
RSS u
2
MSS res
(RSS)
df n k
Total (TSS) y 2
n-1
F
MSS reg
MSS res
2021 25 80
2022 30 90
2023 40 100
Using this hypothetical data, we can calculate the terms as shown in table 2 below:
Solution
1
n Yi X i Yi . X i
10 6340 55 90
= 0.1685
n X i X i 10 38500 550
2 2 2
Y 0.2667 0.1685 X
X1 1 3 2 -2 3 5
X2 3 -1 4 6 2 4
SOLUTION
n=6.
Thus, we can write as follows:-
18 October 2024 Prepared by Urgaia Rissa(PhD) for MBA 46
n
X1 2 0 Y 6 12 18 51
X
0
72
22..
X 1 X X 1 X 2 .. 1 Y . X 1 ⇨
2
1 12 52 1
Y . X
X 2 X X 2 2 2 82 2 162
2
X2 18 22
1
51 12 18 6 51 18
72 52.... 22 12 72 22
162 22 82 18 162 82
41,580
4,284
0 11.7857 1 1.2143
6 12 18 3,528 3,528
6 12 18
12 52 22 12 52 22
18 22 82
18 22 82
12 52 22
18 22 82
Interpretation:
0 11.7857, the average or expected value of Y is 11.7857, holding X1 and
X2 unchanged.
1
2 0.2857 , Holding X2 constant, a unit increase in X3, will lead to a 0.2857
decrease in Y.
18 October 2024 Prepared by Urgaia Rissa(PhD) for MBA 48
Finding the OLS estimators using Deviation Method
:
We can also obtain the OLS estimator using the deviation method as follows:
,
x2
x1 x2 .. 1 yx1
1 _ _ _
2
0 Y 1 X 1 2 X 2
x1 x2 x2 2 yx2
,
Where :
X1
_ _
X1
x1 X 1 X 1
n
X2
_ _
X2
x2 X 2 X 2
n
Y2
_ _
Y
y Y Y
n
6 1 3 -2.5 -1 0 1 0 0 2.5 0
10 3 -1 1.5 1 -4 1 16 -4 1.5 -6
9 2 4 0.5 0 1 0 1 0 0 0.5
12 18 28 28 14 51 9
X1 1 2
_
X 12
Note:
n 6
X 2 2 18 / 6 3
_
X
n
x2
x1 x2 .. 1 yx1
1 28
14 1 30
2
..
x1 x2 2 2 2
x yx
14
28 2 9
2 n 1
R 1 1 R
2
n k
6 1
R 1 1 0.6329
2
6 3
R 2 1 0.6119
R 2 0.3881
Interpretation:
Holding all other factors constant, X explains or accounts for 38.8% of changes
in Y, when adjusted for degrees of freedom.
2. Use the t-tables to find the appropriate critical value, which will again have
T-K degrees of freedom.
Note that the test of significance and confidence interval approaches always
give the same answer.
• Using both the test of significance and confidence interval approaches, test
the hypothesis that =1 against a two-sided alternative.
• The decision is that do not reject H0 since test stat lies within non-rejection
region.
Since the test statistic in both cases are greater than the tabulated values, we reject
the null hypothesis at the conventional levels of 1% and 5% significances.
Therefore, we conclude that the model is adequate
18 October 2024 Prepared by Urgaia Rissa(PhD) for MBA 63
Example 2: We assume that unrestricted regression model is given as :
Solution:
yt = 1 + 2x2t + 3x3t + 4x4t + ut s.t. 3+4 = 1