Arch
Arch
, OF
ILLINOIS LIBRARY
AT URBANA-CHA:
BOOKSTACKS
\J> >*-t £->
APR 2 9 1396
AUG 3 1998
[Link]
BEBR
FACULTY WORKING
PAPER NO. 90-1638
Anil K. Bera
M. L. Higgins
y or th
e
March 1990
A. K. Bera
University of Illinois, Champaign, IL 61820
and
M. L. Higgins
University of Wisconsin, Milwaukee, WI 53201
.
ABSTRACT
time series. Such applications of the ARCH model can be found in Weiss
(1984) and papers surveyed in Engle and Bollerslev (1986) . When testing for
conditional heteroskedasticity, the form of the test statistic, and hence the
(NARCH) model proposed by Higgins and Bera (1989b) . Consider the dynamic
y t = x't /3 + e
t
(t = 1.....T) (1.1)
- N(0
<J* t -i 'V
several functional forms for h but emphasizes the linear ARCH model
h Q + + ••• +
t - o Vt-i Vt- P (1 - 2)
for its analytic convenience and ease of interpretation. Other functional
forms, however, have been found to be useful [See Engle and Bollerslev
(1986), Higgins and Bera (1989b), and Nelson (1989)]. For example, the
linear ARCH model (1.2) requires a > and a. > (i = l,...,p) to insure
for which the conditional variance is positive for all parameter values.
computed test for the presence of linear ARCH. Engle (1982) shows that the
2 2
equivalent to T-R , where R is the squared uncentered multiple correlation
~2 -2
coefficient of the regression of e on an intercept and e . (i = 1, . .
. ,p)
and the e 's are the least squares residuals of (1.1). In general, however,
the form of the LM statistic depends on the functional form of the ARCH
process assumed under the alternative hypothesis. Conducting the above test
for ARCH when the true alternative is, for example, the logarithmic model
general view that linear ARCH models do not provide a rich enough class of
(1989, p. 983)]. In this paper we propose a test for ARCH in which the
alternative is the nonlinear ARCH (NARCH) model suggested by Higgins and Bera
variance function
5ll/5
h
t
=
V*
2
>
5
+
Vv/ + --- +
VVp> (1.4)
1
a > 0; 4>. > 0, (i = 1 p); S > 0; £ <f>
= 1
1
i=0
Rearranging (1.4)
— ' *o—T— +
h 1
+ • •
+ *
P s
the linear ARCH model (1.2). The Box-Cox transformation is widely used in
present context, the NARCH model encompasses many of the functional forms
used for ARCH. For example, when 5=1 the model is identical to the linear
Geweke's logarithmic model (1.3). Higgins and Bera (1989b) discuss other
(1986, 1988).
The null hypothesis
yr to be tested is H
o
: i.
1
=...= i =0. When these
p
conditions are imposed, the conditional variance function (1.4) reduces to a
constant and the model becomes the standard normal regression model. It is
can be shown that under H_, the information matrix is singular; thus
coefficient against the alternative that the parameter follows a first order
y
J = x'7 + z 8 + e
t t' r t t
parameters,
K z is an exogenous
& scalar and e is a random disturbance. The
t t
(B
t
- fi) = *<0
t-1
- ~P) + ut M < 1.
where <f>
and 8 are fixed parameters and u is a random disturbance with
2
variance q. Since the unconditional variance of 8 is q/(l-$ ), constancy of
(1977) and base a test on Roy's union- intersection principle. Like Watson
and Engle (1985) , we follow Davies (1977) , and in addition make use of
.
p -values for the test. In Section 2, we briefly review the work of Davies
(1977, 1987) and discuss its application to our testing problem. In Section
2. DAVIES' TEST
the null hypothesis is true, however, it is assumed that the model is free of
(1953) and suggests basing the test on a critical region of the form
function of Z(9) . Davies (1987) extends his results to statistics which are
2
asymptotically x an d provides a much simpler approximation for the
* 2
S(5 ) = T-R
2
where R is the squared multiple correlation coefficient of the regression of
~2
e on an intercept and
5 (i=l,...,p),
8
where e is the least squares residual. The actual test statistic is defined
as
under the null hypothesis. Of course, it will be very difficult to find the
r}(6)
11
- N(0,A),
X n (5) ,
where A =
..., A
p
(5) be
where
-u/2 (p-l ) /2
1/Z
1/2 e u
"
tf(S) = E[r
L
'(&)r (g)]J
7 ?
-
74 (2.2)
l/2
' oPp//2'|(
, 2 P+ l)/2
xp(6)dS
can also be viewed as the correction factor to the standard x 2 p-value due to
1/2
X
7T "|(p+l)/2
1/2 1/2
E[r?'(5)r,(5)] = E[| dS (6)/d6 |]
.
(2.3)
[?72
Combining (2.2) and (2.3), the upper bound of the significance level is given
by
-u/2 (p-l)/2
,1/2
?r(xl > u) + '
E[|3S '
(S)/d6\]dS. (2.4)
P p/2
2 fp72 A
l,2
E[\dS (5)/d5\]dS
J
A
1/2
V = \dS (5)/d6\d8
1/2 1/2
+ |S (U) - S (5 (2.5)
M )|
where L and U are the lower and upper bounds for 5 and 5, , 5~. .... 6 W are
1 2 M
1/2
the turning points of S (5). Therefore, from (2.4), the significance level
-S/2 (p-l)/2
Pr(;/ > S) + V-^— .
(2.6)
P p/2
2 [p72
Although (2.6) is only an approximation, we expect it to perform better than
basing the test on just the first term in (2.6). In the second term, one
2
part is essentially the x density function and the other part, V, reflects
1/2
the variation in S (5) over values of 5 corresponding to different
Here we should note that the set A need not coincide with the
theoretical range for 5; it could be any subset of that range. The only
constraint is that the same set should be used for maximizing S(5) in (2.1)
and in calculating V in (2.5). Also, Davies (1977, p. 253) mentions that for
the the procedure to be useful, S(6) cannot have spurious peaks. To see that
spurious peaks of S(5) is not very likely in our case, let us write S(<5) as
_ 2 g'WCW'WrVg
p
T-R - T ^_
-2
where £ is the vector of e and W includes an unit vector and Box-Cox
-2 -2 -2
transformations of t ., f e . Therefore, this is a standard
t-1 t-/ t-p
Box-Cox regression with transformation only in the non-constant independent
of S(5) under both the null and alternative hypotheses which indicate that
To see the behavior of the test under H and the alternative hypothesis
P ' fi W'W
plim -=- < co, plim —=- - a finite non-null matrix
T—>oo T^co
10
p im
and under H rt that W'£/T = for any value of 8. While under the
t—>«
p im
alternative hypothesis H , W'£ 5* for any 6. Therefore, the test is
consistent. However, we cannot claim that our test has any optimality
property. For a weak optimality property of this kind of test, see Davies
(1977, p. 252).
*iV«
h = r/2.0 ,.2 .0
t p t-p
Let 0' = (<£.,,..., ), i/' = (a ,0') and 9' = (B',v'). The log- likelihood for
1 P
the NARCH regression model can be written, omitting a constant,
£(&) = -\ I log(h ) -
I 2h (3.1)
t
where Che summations are over t. Higgins and Bera (1989b) show chat the
restrictions on j3 , the LM test reduces to [see e.g. Bruesch and Pagan (1980)]
1
LM = d(?)'I(?)" d(?) (3.2)
V 1/1/ V
11
where d(9) and 1(0) are the score function and information matrix with
u uu
respect to the variance parameters and "~" denotes quantities evaluated at
3h
d£
du L 2h
1
du
t
4"
and the hessian of the log- likelihood is
r 2
8h dh
d 1 y
L
1_
e
t __t _t + y
*•
€
t
- 1
1
3
\
)udu' ''
The information matrix with respect to the variance parameters is then given
by
(
2
a £
uu dudu'
2
a i
dudu t-1
>
. E(e ) 3h ati E(e*) ' . ah
i t
a^' 2h du
t
t
C. ah ah 1
t
ilH l
2 du du'
t
«g i
ah
J
-I
2 L du h 3i/'
t
-l
r-2
ah. € 3h 3h aK
LM = £ I y
A du - 1 (3.3)
3i/ a j/ du' -2
V
a
-2
where e is the least squares residual and a is the usual MLE of the
variance of the error in the standard normal linear regression model. Now
-2 -2
define f to be a column vector whose elements are (e /a ) - 1 (t = 1 p)
and let z = ah /du and Z' = (z . ..,z ). The LM statistic (3.3) can then be
1
LM = -•f'Z(Z'Z)" Z'f
2
p
Furthermore, since under the null hypothesis f'f/T = 2 and the
IK-8(**) . T fz(z;z)
,
rt _ T R2.
ah
= 1
8o
13
and
*
ah (e /a ) •
1
t -2 t_ i
= a (i - 1.....P)
d4>. *
i >
S
»
^-i> "
(i = 1.....P)
This limiting case corresponds to the test for ARCH when the alternative is
4. SIMULATION EXPERIMENTS
of the approximation (2.2). We also consider the power of Davies' test and
Engle's ARCH test when the alternative model is in the class of NARCH models
.
14
Lastly, we compare the power of these two tests under a bilinear alternative,
(2.6), for various sample sizes ranging from 25 to 200, 500 random normal
samples were generated and Davies' test for NARCH (D-N) was computed.
The D-N test is based on the alternative hypothesis that the series is
is
where
1/5
2 8
h
t
=
[*
(o ) + ^(y^) (4.2)
Since the parameter space only imposes 5 > 0, an upper bound for 6 must be
chosen. We only present results for < 5 < 2. Below we discuss the
consequences of varying the upper bound. The supremum of S(<5) and the
1/2
turning points of S (5) were found using a grid search with step length
.01. Davies' test provides only an approximate p.- value for the statistic.
significance, then compute the p-value for each sample. When a computed
15
number of times the null hypothesis is rejected and dividing by 500. We then
for D-N indicate that the approximation (2.6) works well. All estimated
The quality of the approximation for D-N is certainly no worse than the
specified nominal significance level. This is the test which results from
2
critical value is used. Figure 1 is a plot of the the x-, density function
and a nonparametric estimate of the density function of D-N based on the 500
samples of size 100 from Table 1. A kernel estimator was used with a window
16
2
Again, this indicates that a critical value based on the x-, density will lead
The supremum search of S(5) was conducted over the interval < 5 < 2.
All quantities in Table 1 were also computed using 5 and 10 as an upper bound
for 6 . The results indicated that the choice of the upper bound does not
the supremum of S(5) cannot decrease when the upper bound of 6 increases, the
likelihood of rejecting the null can get larger as the upper bound for 6
increases
To determine the power of D-N, samples were generated from the model
(4.1) and (4.2). Experiments were conducted with points in the parameter
space at 4> G {.3, .5, .8} x 5 G (. 01, .1,. 3, .5, .8, 1.0,1. 5). To reduce the
computational burden, the step length for both the supremum search of S(6)
1/2
and the computation of the total variation of S (5) was increased to .025.
Again, all experiments were based on 500 replications. We also compute the
empirical power of LM-A for comparison. Results for samples of size 50, 100
The results indicate that D-N will significantly increase the ability to
that is as the alternative moves away from the linear ARCH model, the power
is a gain in power of more than 15%. Equally important, when 6=1, that is
17
when the true model is precisely Engle's linear ARCH model, there is little
if any loss in power from using the D-N test relative to LM-A.
In Figures 2 and 3, we present plots from two random replications under the
has a clear maximum, the graph is somewhat flat. This may be due to the fact
that S is not identified under the null hypothesis. In Figure 3, S(5) has a
maximum very close to the true value .5. The value of 5 for which S(5) is a
It would also be desirable if the D-N test has good power against
other types of nonlinear models. Recently there has been interest in the
where
e - N(0,1)
t
As discussed in Higgins and Bera (1989a), this process has second moments
which are very similar to the ARCH model. In Table 3, we present the
,
18
P e {.1,.3,.5,.8} and samples of size 50, 100 and 150. For comparison, we
When p is only of moderate size, < .5, the power of D-N and LM-A are very
specification.
5. AN APPLICATION
series indicate that an AR(1) process is a adequate model for the conditional
were tested using standard errors and a portmanteau test robust to the
presence of linear ARCH [see Milhaj (1985) and Diebold (1986)]. The AR(1)
models were estimated by least squares and the least squares residuals were
used to compute Engle ' s LM test for linear ARCH and our test for NARCH for
orders 1 through 12. The p-values for each test statistic are reported in
Table 4. Examining the p-values reveal that the two tests can give very
different impressions about the presence of ARCH and nonlinearity . LM-A does
not indicate any ARCH, at conventional levels of significance, for Ff, II, Jy
and Sf; however, D-N finds ARCH significant at the 10% level for at least one
order for each of these series. For Gm and Bp , the two tests are in close
To further illustrate that LM-A may fail to detect nonlinearity when the
conditional heteroskedasticity is not linear, both the linear ARCH and NARCH
models were estimated for the II series. The II series was chosen because
the discrepancy between the two test seems greatest. The smallest p-value of
LM-A is .43, while the p-values for D-N are less than .10 at orders 3, 4, 8,
11 and 12. Table 5 shows maximum likelihood estimates for the linear ARCH(3)
model (L-ARCH) and the NARCH(3) models. Other order models were also
estimated, but these gave the best fit. In spite of LM-A being
variance function may explain why LM-A does not detect conditional
6. CONCLUSIONS
Our Monte Carlo results present evidence that the approximation given by
confidently use D-N. The power studies indicate that D-N can be
significantly more powerful than the LM test for linear ARCH when the
particularly true when the nonlinearity parameter S is quite small. From our
experience in estimating NARCH models with exchange rate data, small values
here, LM-A could not detect heteroskedasticity when the estimated value of 6
was quite high. However, the D-N test was able to pick up this nonlinear
21
REFERENCES
BREUSCH, T. S. and PAGAN, A. R. (1980) The Lagrange multiplier test and its
applications to model specification in econometrics. Rev. of Economic
Studies 47, 239-53.
HIGGINS, M. L. and BERA, A. K. (1989a) A joint test for ARCH and bilinearity
in the regression model. Econometric Rev. 7, 171-81.
MILH0J, A. (1985) The moment structure of ARCH models. Scand. J. Statist. 12,
281-292.
WEISS, A. A. (1984) ARMA models with ARCH errors. J. Time Series Anal. 4,
269-43.
TABLE 1
10% 5% 1%
100 .072 .088 .150 .030 .034 .080 .010 .004 .016
150 .094 .078 .166 .056 .036 .114 .010 .012 .036
200 .102 .104 .196 .058 .044 .126 .020 .018 .038
TABLE 2
i
3 5 8
SAMPLE
SIZE 6 D-N LM-A D-N LM-A D-N LM-A
P
SAMPLE
SIZE .1 .3 .5 .8
ORDER
Ff Gm 11 & Sf Bp
OF
ARCH LM-A D-N LM-A D-N LM-A D-N LM-A D-N LM-A D-N LM-A D-N
1 .47 .10 .01 .00 .85 .24 .37 .46 .41 .32 .01 .02
2 .50 .16 .03 .01 .52 .33 .42 .14 .62 .48 .02 .05
3 .46 .14 .02 .01 .43 .06 .61 .15 .23 .05 .05 .12
4 .63 .30 .03 .01 .50 .08 .64 .06 .30 .08 .09 .21
5 .40 .13 .07 .07 .59 .13 .70 .11 .24 .03 .16 .33
6 .59 .21 .17 .13 .67 .11 .69 .19 .18 .04 .12 .26
7 .38 .11 .06 .05 .53 .11 .78 .17 .21 .05 .18 .36
8 .40 .12 .05 .05 .63 .09 .86 .23 .21 .05 .12 .26
9 .52 .18 .32 .35 .70 .11 .87 .32 .33 .11 .11 .22
10 .59 .24 .35 .34 .69 .18 .91 .44 .43 .17 .13 .14
11 .63 .66 .58 .45 .66 .09 .80 .22 .55 .16 .16 .20
12 .79 .67 .85 .61 .70 .09 .83 .17 .67 .22 .12 .29
TABLE 5
O
u
o
<u
p
ni
e
•H
•P
W
0)
p
•H
CO
C
<u
T3
P.
P
<U
6
P
P<
C
o
55
D
O
o
d
o CO
•
CO
w
<u
&+J
o•
o
0*
r^ >>
&
f^
rA
o 5J
£
to
>-i
<u
T3
c
o 3
in •"N
<-o
v-/
CO
o
** ,
P
i-l
P-.
o .
to CM
W
od
O
o o
M
CM Pu
o
d
oo r^
*~ ^m
£ 2 o o o o
en oo
° t-
o
*™ •-»
£
^ w
1ECKMAN LSJ
INDERY INC. |M|
JUN95
»d To-fW- N. MANCHESTER,
INDIANA 46962