Predicting Graduation Rates in Higher Ed
Predicting Graduation Rates in Higher Ed
Page 1 of 24
A peer-reviewed scholar
journal
Editor: Gene V Glass
College of Education
Arizona State University
Copyright is retained by the first or sole author, who grants right of first
publication to the EDUCATION POLICY ANALYSIS ARCHIVES. EPAA
is a project of the Education Policy Studies Laboratory.
Florence A. Hamrick
Iowa State University
John H. Schuh
Iowa State University
Mack C. Shelley, II
Iowa State University
Citation: Hamrick, F. A., Schuh, J. H., & Shelley, M. C. (2004, May 4). Predicting higher education
graduation rates from institutional characteristics and resource allocation. Education Policy Analysis
Archives, 12, 19. Retrieved [Date] from [Link]
Abstract
This study incorporated institutional characteristics (e.g., Carnegie
type, selectivity) and resource allocations (e.g., instructional
expenditures, student affairs expenditures) into a statistical model
to predict undergraduate graduation rates. Instructional
expenditures, library expenditures, and a number of institutional
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 2 of 24
The conceptual framework guiding this study is to link institutional planning with the
successful retention of undergraduate students to graduation, through implementing a
careful fiscal strategy. While a fiscal strategy, by definition, is to establish “the basis
upon which allocations are to be made” (Brinkman & Morgan, 1997, p. 291), fiscal
strategies often are not integrated into the institutional planning processes that
specify desired goals and outcomes (Peterson, 1999). Retention and graduation rates
are central indicators of success for institutions of higher education, and a variety of
negative consequences for undergraduate students are related to attrition (Tinto,
1987). However, it not clear whether, and, if so, how, institutional resource allocation
decisions are linked to student graduation rates. Our approach to the study of this
important problem in higher education policy is to develop a statistical model that
explores resource allocation decisions as predictors of student graduation rates,
together with other measures of institutional type and selected institutional traits that
are suggested in the research literature and are available in a national database. If
the efficacy of such a model can be demonstrated empirically, leaders of higher
education institutions may be able to make more strategic resource allocation
decisions in pursuit of the goal of improved graduation rates. The results of this study
are intended to help promote data-driven approaches to strategic resource allocation
by institutions of higher education.
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 3 of 24
Various strategies can be used to improve retention rates (e.g., Astin, 1997; Elkins,
Braxton, & James, 2000; McLaughlin, Brozovsky, & McLaughlin, 1998; Murtaugh,
Burns, & Schuster, 1999). In a classic report, Tinto (1987) pointed out that as
students are more likely to be integrated socially and academically in their institutions,
the more likely it is that they would be retained. Berger and Braxton (1998, p. 116)
studied students at a private institution and concluded that “organizational attributes
play an important role not only as a source of social integration, but in the first year
persistence process in general at this institution.” Murtaugh, Burns, and Schuster
(1999) analyzed retention at Oregon State University, and identified several steps
that the university could take to improve retention, including pointing out that out-of-
state students were at greater risk than are in-state students.
In the two reports identified above, students were studied at single institutions and
recommendations, consistent with Tinto’s model, were made to improve the
institution’s retention rates. While such studies can be particularly useful to the
institutions studied, and may have applicability at other institutions, large-scale
studies of multiple institutions that focus on how institutional resource allocations
influence graduation rates are rare. This study was intended to fill that void; more
specifically, it was undertaken to determine how institutional resource allocations
influence graduation rates at over 400 public four-year institutions of higher
education.
This study explored the extent to which institutional characteristics and decisions
about institutional resources could be used to predict undergraduate graduation
rates—a common indicator of undergraduate student success. Our analysis is based
on variables derived primarily from the Integrated Postsecondary Education Data
System (IPEDS) data, obtained from the National Center for Education Statistics
(NCES). Institutions of higher education are required by law to participate in IPEDS
annual surveys conducted by NCES (National Center for Education Statistics, 1998).
Copies of these surveys are available at the following World Wide Web site:
[Link]/ipeds. In addition, institutions may choose to participate in annual
surveys conducted by publications such as U.S. News & World Report magazine; the
results from those surveys are published at the Website [Link]. Variables
from the IPEDS plus a measure of admissions selectivity from U.S. News & World
Report were utilized in the multiple regression statistical model.
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 4 of 24
Most of the data for this study came from the IPEDS relational data base, including
enrollment information, financial information, and graduation rates. The Survey Year
that was chosen for enrollment and financial information was 1998, since that Survey
Year bridged the available years for graduation rates and selectivity rates. Graduation
rates were drawn from 1997, the most current data available at the time the study
was conducted. The IPEDS data set served as the primary source of cases and data
for this study for a number of reasons. First, institutions of higher education receiving
Title IV funding are required by law to participate in annual surveys such as IPEDS
that are conducted by NCES. Second, all but one of the variables of interest was
contained in the IPEDS data. Third, IPEDS data were easily accessible to the
researchers via the World Wide Web.
All 513 accredited public institutions that grant at least a baccalaureate degree were
selected for this study, but a number of institutions containing missing data on key
variables were eliminated from this study, as were several other observations with
“outlier” values on one or more variables that were markedly different from the data
for the remaining observations and that threatened the assumption of normality. As a
consequence, the final sample size comprised n = 444 public institutions with
complete data on all variables of interest. Variables selected from the IPEDS
relational database included enrollment information, financial information, and
graduation rates. Graduation rates for 1997 (the most recent available) were used. All
other institution-level data were from 1998 (the most recent available at the time of
the study). Additionally, 1998 most closely matched the year for which institutional
selectivity data were available (1999). The selectivity rates of undergraduate
admissions were drawn from the annual data published by U.S. News & World
Report.
The variables employed in the study are described in detail in the following section.
We have endeavored to use least squares statistical models to provide a
comprehensive look at the factors that help in understanding the effects that higher
education expenditure patterns and other institutional characteristics have on student
success, measured as undergraduate student graduation rates. The variables
employed in this analysis include: undergraduate graduation rate (the dependent
variable); Carnegie classification; U.S. region; degree of urbanization; presence of a
medical, dental, veterinary, or related program; selectivity; institutional financial aid;
and number of dollars allocated to each of the following categories of expenditures:
student affairs, instruction, library, physical plant, institutional support, academic
support minus library, and total education and general (E & G).1
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 5 of 24
We believe this mix of institutional traits provides a set of perspectives that promise to
facilitate the understanding of what makes for a more successful academic institution,
measured in terms of one of its ultimate products¾its graduates. In these results
there is information that may be of great use to those who plan and administer the
process of higher education. Which is better, for the goal of improving graduation
rates: increase spending by $100 per student headcount for library expenditures, or
increase spending by $10 per student headcount on student affairs? Does the
presence of a medical school improve an institution’s undergraduate graduation rate?
How much does the degree of selectivity of admissions decisions influence the rate at
which students successfully complete their studies? How are these, and other,
considerations related to each other, and what tradeoffs among these alternatives are
important to know about? These are among the questions that are addressed in the
results discussed below.
Results
In subsequent tables, the predictive validity of models overall is evaluated by: the
value of the coefficient of determination (R2), which measures the proportion of total
variation in the dependent variable associated with, or “explained by,” variation in the
complete set of predictor variables; adjusted R2, an index of the proportion of
dependent variable variance explained relative to the mean squared error and the
number of degrees of freedom for model and error, which may assume a negative
value for ill-fit models; and the F-value formed from the ratio of estimated model
variance to estimated error variance, where a larger F-ratio implies a “stronger”
model, and its associated p-value. The validity of the separate predictor variables
included in each model is ascertained from: a partial F statistic and its associated p-
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 6 of 24
value; eta-squared, (eta)2, which is the proportion of the total variability in the
dependent variable accounted for by that independent variable; and by observed
power, or the probability of correctly determining that there is a real effect attributable
to that model component. Larger values of eta-squared indicate stronger model
predictors, but often are modest (less than .10). Larger values of power (maximum of
one) indicate a greater likelihood of that particular predictor having a genuine effect
on the dependent variable.
Table 1
Full Model Multiple Regression Tests of Between-Subjects Effects for
Predicting Graduation Rates
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 7 of 24
The adjusted, or estimated, marginal means for institutions at different levels of the
Carnegie classification scale (CARNEGIE) are presented in Table 2. These results
adjust for region, presence of a medical or related component, whether the institution
is an HBCU, institutional student financial support, urbanization, selectivity, and the
indicated measures of expenditures, as well as the interactions of MEDICAL*URBAN
and REGION*MEDICAL. There is a general, and nearly monotonic, decline in mean
graduation rates as Carnegie classification varies from Research I (the most
prestigious by that measure of external research funding acquired) to Bachelor’s II,
although there is little difference between Research II and Doctoral I mean graduation
rates and little difference in the mean graduation rates for Doctoral II, Master’s I, and
Master’s II institutions.
Table 2
Estimated Marginal Mean Graduation Rates by Carnegie Classification
(CARNEGIE) from Full Model Multiple Regression
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 8 of 24
Note: The marginal means reported here are evaluated at the means of the following
covariates that appeared in the model: URBAN (degree of urbanization) = 3.45,
SELECT (selectivity = percentage of admissions applications accepted/applications
received) = 75.187, SAFEXP (student affairs expenditures per student headcount) =
728.2527, INSTEXP (instructional expenditures per student headcount) = 4282.9243,
LIBEXP (library expenditures per student headcount) = 360.4734, PPLEXP (physical
plant expenditures per student headcount) = 925.9977, INSTIEXP (institutional
support per student headcount = 1156.2228, EGEXP (educational and general
expenditures per student headcount) = 11556.6124, NOTLIB (academic support
minus library expenses, per student headcount) = 707.3338.
Estimated marginal mean graduation rates by region are shown in Table 3. Although
there is no significant effect of regional variation in the model, it is noteworthy that
estimated mean graduation rates are highest in New England (44.086%) and the Mid-
East (41.005%) and lowest in the Plains (34.679%) and Rockies (35.021%). Pairwise
multiple comparisons of regions show no significant differences, consistent with the
finding of no overall effect of region in the full regression model including interactions.
(Note 2)
Table 3
Estimated Marginal Mean Graduation Rates by Region (REGION) from
Full-Model Multiple Regression
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Characterist... Page 9 of 24
Note: The marginal means reported here are evaluated at the means of the following
covariates that appeared in the model: URBAN (degree of urbanization) = 3.45,
SELECT (selectivity = percentage of admissions applications accepted/applications
received) = 75.187, SAFEXP (student affairs expenditures per student headcount) =
728.2527, INSTEXP (instructional expenditures per student headcount) = 4282.9243,
LIBEXP (library expenditures per student headcount) = 360.4734, PPLEXP (physical
plant expenditures per student headcount) = 925.9977, INSTIEXP (institutional
support per student headcount = 1156.2228, EGEXP (educational and general
expenditures per student headcount) = 11556.6124, and NOTLIB (academic support
minus library expenses, per student headcount) = 707.3338.
In the full model including interactions, institutions with a medical, dental, veterinary,
or similar component had a significantly lower estimated mean graduation rate
(37.065%) than did institutions without such a component (38.241%). HBCUs had an
estimated mean graduation rate of 32.877%, significantly less than the 42.429%
result for non-HBCUs. The statistically significant differences in estimated mean
graduation rates among quintiles of institutional financial assistance (IFA) range from
42.740% for the top quintile (level 5) to 33.665% for level 2, with intermediate values
for level 1 (38.223%), level 4 (37.636%), and level 3 (36.001%). The significant
interaction between MEDICAL and REGION is amplified by the range in estimated
mean graduation rates from a low of just 31.708% for institutions with medical
schools or similar components in the Plains to a high of 47.374% for New England
institutions with medical schools or similar components.
The results reported above are based on the full multiple regression model.
Determining how the independent variables employed in the full model play out on
their own is important, because the chief consequence of including a large number of
independent variables in a prediction model is to enhance the likelihood that the
effect of each predictor may be masked (either enhanced or attenuated) by
intercorrelations with other predictors. By examining the individual effects of each
predictor within the overall analysis we can look for inconsistencies that might
confound interpretations based on the full model.
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 10 of 24
Mean graduation rates were 44.369% for New England, 48.626% in the Mid-East,
42.887% in the Great Lakes, 40.074% for the Plains, 40.056% in the Southeast,
36.618% for the Rockies, 32.134% for the Southwest, and 47.712% on the West
Coast.
Urbanization (URBAN) alone does not have any independent relationship with
graduation rates (F = 0.035, p = .808, R2 < .001).
By itself, the fact that an institution is an HBCU has a statistically significant effect on
graduation rates (F = 18.231, p < .001), although the effect size is relatively modest
(R2 = .040). The mean graduation rate for students at a non-HBCU (42.848%) is over
10 percentage points greater than the corresponding result for students attending
HBCUs (31.397%). This comparison is confounded by the fact that HBCUs are not
found at all Carnegie levels for the institutions studied in this analysis, so we also
compared only those HBCU and non-HBCU institutions that share the same Carnegie
rating, to provide a fairer and more nuanced appreciation of the role played by
HBCUs in higher education. This refined analysis again demonstrates a significant
difference in mean graduation rates between HBCU and non-HBCU institutions at
comparable Carnegie levels (F = 9.101, p = .003). However, the magnitude of this
effect (R2 = .027) is less than for comparing HBCUs against all non-HBCU
institutions, and is substantially less than the effect size for other elements of the
model. There is about a 7-percentage-point advantage in mean graduation rates for
students not attending an HBCU (38.440%, compared to 31.397% for students
attending an HBCU).
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 11 of 24
Table 4
Mean Graduation Rates by Carnegie Classification (CARNEGIE),
Unadjusted for Other Predictors
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 12 of 24
support, similarly has a significant (F = 38.437, p < .001), but not very potent (R2
= .080) independent impact on graduation rates. An increase of 10% in mean
institutional support per student headcount ($115.62) results in an increase, on
average, of 0.83 percentage points in graduation rates. The level of student affairs
expenditures (SAFEXP) is a significant independent predictor of graduation rate (F =
29.828, p < .001), with rather modest explanatory power (R2 = .063). On average,
each additional 10% per student headcount spent on student affairs ($72.83) results
in an increase in graduation rates of about 0.89 percentage points. Library
expenditures (LIBEXP) provide a very robust and statistically significant explanation
of graduation rates (F = 230.422, p < .001, R2 = .343). Every 10% per student
headcount increase in library expenditures ($36.05) results, on average, in an
additional 1.77 percentage points of graduation rates. Total education and general
expenditures (EGEXP) has a potent independent impact on graduation rates (F =
186.535, p < .001, R2 = .297). On average, an additional 10% in mean EGEXP
($115.66) is associated with an extra 0.16 percentage point in graduation rates.
Finally, NOTLIB, academic support minus library expenditures per student
headcount, is a reasonably good independent predictor of graduation rates (F =
115.490, p < .001, R2 = .207). Higher values of NOTLIB are significantly more likely
than lower values of NOTLIB to result in higher graduation rates. On average, an
extra $100 of spending on non-library academic support expenditures per student is
associated with a 0.98 percentage point increase in graduation rates.
Based on these results, the best “payoffs” in higher graduation rates from strategically
targeted institutional budgetary enhancements would seem to come from increasing
per student expenditures for instruction (+1.99 percentage points), followed closely by
library (+1.77) and more distantly by physical plant (+1.07) and nonlibrary academic
(+0.98). In a lower tier of impact are student affairs (+0.89) and institutional support
(+0.83). Lagging far behind is education and general (+.16). However, these findings
do not control for the simultaneous effects of changes in each expenditure category
(and the often high correlation of any one budget category with another, leading to
collinearity among the budgetary predictors and attenuated partial regression
coefficients) together with other effects that are captured in the full model. In the full
model, for the same benchmark 10% per student headcount increase in any one
expenditure category, the net effects of greater spending on physical plant (-0.28)
and education and general (-0.36) actually are negative, and the greatest “payoff” is
attributable to enhanced expenditures on library (+0.92) and instruction (+0.80), with
only modest contributions from increased nonlibrary academic (+0.27) expenditures
and very minimal improvements from heightened spending for institutional support
(+0.05) and student affairs (+0.05).
Hierarchical Models
A further check on the validity of our results is provided by analyzing the patterns of
relationships between the predictor variables and graduation rates in hierarchical
stages of model building. Stage 1 estimates graduation rates from three institutional
“demographic” variables (REGION, HBCU, and URBAN) that are historically-
determined traits beyond the control of current higher education decisionmakers. For
Stage 2, to these three predictors are added institutional characteristics that are more
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 13 of 24
Table 5
Summary of Hierarchical Multiple Regression Model Results
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 14 of 24
The results in Table 5 provide evidence of the predictive validity of each stage, or set,
of predictors. The three Stage 1 institutional demographic variables collectively are
significant predictors, accounting overall for 13.3% of the variation in graduation
rates, and both REGION and HBCU are significant individually. The Stage 2
combination of institutional traits with the Stage 1 predictors are significant
collectively, accounting for a combined 52.3% of the variation in graduation rates,
with REGION, HBCU, URBAN, CARNEGIE, IFA5, and SELECT significant
individually. A partial F-test demonstrates that the added institutional characteristic
predictors contribute significantly (F = 9.29, p < .01) to explaining graduation rates
beyond what is accounted for by the Stage 1 variables. Adding the financial variables
in Stage 3 to the previous sets of predictors results in greater explanatory power (R2
= .588), which is a significant improvement over both the Stage 1 (partial F = 8.14; p
< .01) and the Stage 2 (partialF = 8.09, p < .01) sets of predictors. That is to say, the
institutional financial information makes a major contribution to our understanding of
what drives graduation rates beyond what we know from institutional demographics
and other institutional characteristics. Table 5 also shows that the institutional
characteristics variables added in Stage 2 are by themselves (without interactions,
which cannot be estimated separately here because they require the URBAN and
REGION variables in Stage 1) significant predictors of graduation rates (F = 21.493, p
< .001), as are the financial variables added in Stage 3 (F = 38.702, p < .001). In
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 15 of 24
addition, the explanatory power of the financial variables alone (R2 = .383, adj R2
= .373) roughly equals that of the institutional characteristics variables alone (R2
= .394, adj R2 = .376). Each of these additional sets of predictors considerably
outweighs the explanatory power of the institutional demographics from Stage 1 (R2
= .133, adj R2 = .115).
Limitations
Several limitations to this study must be acknowledged. First, the study was framed
with reference to public accountability for resources and student success.
Consequently, data were analyzed from public higher education institutions only.
While this decision allowed us to examine characteristic patterns of these institutions
more closely by focusing the analysis and interpretation, the important private sector
of higher education in the United States nonetheless was omitted from this analysis.
The conclusions and recommendations therefore are applicable only to public
colleges and universities. It is unclear whether or how these findings would apply to
private institutions of higher education.
Second, although this study focuses on student success in terms of graduation rates,
it is important to note that this study reveals little about the qualities of student-level
experiences (Tinto, 1998) that also certainly influence graduation rates. Numerous
other considerations, such as the nature of educational environments, the quality of
student/instructor interactions, and students’ use of available resources, reveal the
more subtle finer points of successful educational experiences. This study addresses
these issues only obliquely, through its focus on the deployment and allocation of
institutional financial resources that enable provision and/or enhancement of the
educational experience.
A related limitation is the inability to disaggregate financial aid data into separate
expenditures on undergraduate and graduate/professional education using the
IPEDS database. Consequently, it is impossible to determine the extent to which
financial aid is awarded to undergraduate or graduate students. Presumably,
institutional financial aid awarded to undergraduate students could be “merit-based,”
meaning that it is used to encourage enrollment by rewarding talent and therefore is
seen as a way of positively connecting students to their college or university (see
Astin, 1993). Graduate student aid could include fee remissions or other forms of aid
that presumably have different purposes, but it is not possible to disaggregate the
IPEDS financial aid data in this manner.
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 16 of 24
Finally, cross-sectional data from one year (1997-98) were used in this analysis. This
study thus provides a snapshot of a single year’s allocations and expenditures across
a large number of institutions. Although revenues and allocations generally remain
constant with the exceptions of incremental adjustments¾a common form of
budgeting (Dickmeyer, 1996; Woodard & von Destinon, 2000)¾a longitudinal design
would be needed to account for multiple-year trends or changes in expenditure
patterns, to test the long-range applicability and stability of this model over a period
greater than one year.
As is clear from the findings above, not all categories of variables affect graduation
rates equally. The institutional demographic variables contributing to a prediction of
higher graduation rates were: higher status within the Carnegie classification system;
the presence of a medical, dental, or veterinary program; a more urbanized location;
and a lower percentage of applicants admitted. The MEDICAL and URBAN variables
combined to produce an interactive effect on graduation rates. However, many of
these variables represent characteristics or conditions over which institutions have
little to no control.
For example, the provision of institutional financial aid was a statistically significant
component of the model and modestly affected graduation rates. However, the
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 17 of 24
relationship was not linear since higher graduation rates were associated with the
lowest and with the two highest quintile measures of financial aid (a marginal mean
graduation rate of 38.026% for the first—that is, lowest—quintile, with per student
headcount support of $54 or less; and 37.354% for the fourth, and 42.521% for the
fifth—highest—quintile, or a range of over $378 per student headcount). Institutions
that can do so may wish to consider investing additional institutional monies in
student financial support, but modest amounts of student financial support for
institutional dollars are not associated with higher graduation rates.
One issue that arose in the course of our data analysis is related to the higher
graduation rates among undergraduates at institutions representing higher Carnegie
classification levels. It is somewhat puzzling that undergraduate students succeeded
at higher rates at research-oriented institutions than at colleges and universities with
prevailing emphases on undergraduate education, as indicated by institutional
mission and espoused purpose. Graduation rate is not the sole outcome indicator of
students’ success; stopping in and out to take coursework that satisfies individual
students’ needs also constitutes a successful educational experience for many
undergraduates. Additionally, however, among input characteristics, more selective
admissions is associated with higher Carnegie ratings, suggesting that academically
better-prepared students are more likely to attend research, rather than
baccalaureate, institutions. It also may be the case that research-oriented institutions
are better positioned financially to offer resource-rich environments that foster
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 18 of 24
Institutional planners wishing to implement insights from this research are not likely to
have infusions of new monies with which to do so. It may be decided instead to load
dollars disproportionately into strategically defined categories, but this represents a
balancing of resource allocations among several categories; gains and losses affect
other categories as allocations are shifted and redistributed. It is not clear how shifts
and reallocations in some categories will affect student graduation rates, nor whether
there perhaps is a marginal or threshold proportion of funding that, if not realized or
exceeded, is necessary for budgetary categories unrelated to graduation rates.
Further research can pursue these questions and provide more targeted guidance to
institutional planners and to policy and budget analysts. In general, better information
for planners will make them more likely to attain benchmarks through thinking
strategically about obtaining and spending funds. In this context, it is appropriate to
consider that, based on analysis of IPEDS data, economic disparities among
institutions and their students are increasing (Winston, 2000).
Finally, this study can provide useful guidance for interpreting academic work to
various publics, such as legislative bodies or media representatives. It can be unclear
whether or how an institution’s financial decisions are related to desirable outcomes
such as graduation rates. This study can assist, by demonstrating connections
between institutions’ accountability for their stewardship of public resources and the
larger good that is served by strategic allocation of resources to support the goal of
student graduation and other aspects of the institution’s mission. Institutional
decisionmakers may be better able to decide where to make budget cuts and to make
more finely-tuned determinations of the tradeoffs and other consequences of such
budgetary reallocations across areas of university activity (e.g., Kissler, 1997).
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 19 of 24
Additional variables that were not available for the data set employed in this analysis
may be useful in future research. Disaggregating institutional expenditure and
financial aid data into separate undergraduate and graduate components would be
extremely useful for predicting undergraduate graduation rates. Also, it remains to be
seen what differences in ability to predict graduation rates will emerge from any
further revisions in the Carnegie classification system. Furthermore, within the current
Carnegie classification system, it would be informative to include private institutions,
to assess whether these findings are unique to public institutions. We have no direct
measures of socioeconomic status at the institutional level, although future research
may find it productive to employ measures of student eligibility for financial aid such
as percentage of students eligible for Pell grants. In addition, a measure of the extent
to which a campus is residential would be informative, particularly regarding the
allocation of institutional costs for on-campus student support.
Future research may be guided, too, by the reality that many of the significant
predictors in this analysis involved variables that were not directly controllable by
institutional administrators. Institutional location and type are not changed easily, if at
all, and selectivity is difficult to change in the short run particularly in public institutions
owing to legal requirements to admit a wide range of in-state high school graduates.
Nonetheless, our results suggest that controllable variables such as student financial
aid, instructional expenditures, library expenditures, and nonlibrary academic support
expenditures exert major influence over graduation rate outcomes. An elaboration of
these controllable aspects of institutional realities, perhaps fortified by exemplary
case studies, would provide valuable additional perspectives on what institutional
officers and public decisionmakers can do to influence the rate at which students
successfully complete their undergraduate studies.
Notes
The authors wish to thank Professors Don Hossler and George Kuh for their
thoughtful reviews of an earlier draft of this manuscript.
1. The categories listed preceding E&G are included within the E&G total, but E&G
also contains other categories of expenditures (such as auxiliary enterprises) that
were not included in this analysis. Thus, including E&G in our model does not
produce exact collinearities with its constituent variables that are included in the same
model.
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 20 of 24
2. It is important to note that, although the effect of REGION is not significant in this
full model, there are significant differences in estimated mean graduation rates
attributable to REGION (F = 5.134, p < .001, (eta)2 = .080, power = .998) when the
two interactions are removed from the full model. Clearly, the effect of REGION in the
full model containing interactions is attenuated in particular by the interaction with
MEDICAL. In the alternative non-interaction model, URBAN is significant (F = 25.782,
p < .001, (eta)2 = .059, power = .999). There are no other major changes between the
interaction model results shown in Table 1 and the alternative model without
interactions (R2 = .571, adjusted R2 = .541; see Table 5). For the model lacking
interaction effects, the estimated marginal means are also highest for the Mid-East
(43.632%) and New England (38.898%), followed by the Great Lakes (36.995%),
Southeast (36.057%), West Coast (35.400%), Plains (35.232%), Rockies (32.790%),
and Southwest (30.530%).
References
Balderston, F. E. (1995). Managing today’s university (2nd ed.). San Francisco, CA:
Jossey-Bass.
Berger, J. B., & Braxton, J. M. (1998). Revising Tinto’s interactionist theory of student
departure through theory elaboration: Examining the roles of organizational attributes
in the persistence process. Research in Higher Education, 39, 103-119.
Brinkman, P. T., & Morgan, A. W. (1997). Changing fiscal strategies for planning. In
M. W. Peterson, D. D. Dill, L. A. Mets, & Associates, Planning and management for a
changing environment (pp. 288-306). San Francisco, CA: Jossey-Bass.
Clotfelter, C. T. (1996). Buying the best: Cost escalation in elite higher education.
Princeton, NJ: Princeton University Press.
Elkins, S. A., Braxton, J. M., & James, G.W. (2000). Tinto’s separation stage and its
influence on first-semester college student persistence. Research in Higher
Education, 41(2), 251-268.
Hansen, W. L., & Stampen, J. O. (1996). The financial squeeze on higher education
institutions and students: Balancing quality and access in financing higher education.
In D. W. Breneman, L. L. Leslie, and R. E. Anderson (Eds.), ASHE reader on finance
in higher education (pp. 291-302). Needham Heights, MA: Simon & Schuster.
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 21 of 24
Howell, D. C. (2002). Statistical methods for psychology (5th ed.). Pacific Grove, CA:
Duxbury.
Murtaugh, P. A., Burns, L. D., & Schuster, J. (1999). Predicting the retention of
university students. Research in Higher Education, 40, 355-371.
National Center for Education Statistics. (2000). Digest of education statistics, 1999.
Washington, DC: United States Department of Education.
Pascarella, E. T., & Terenzini, P. T. (1998). Studying college students in the 21st
century: Meeting new challenges. The Review of Higher Education, 21, 151-165.
Woodard, Jr., D. B., & von Destinon, M. (2000). Budgeting and financial
management. In M. J. Barr, M. K. Desler, & Associates, The handbook of student
affairs administration (2nd ed.) (pp. 327-346). San Francisco: Jossey-Bass.
Winston, G. (2000). Economic stratification and hierarchy among U.S. colleges and
universities. Williamstown, MA: Williams Project on the Economics of Higher
Education. DP-58. [On-line. Available: [Link]
Winston, G. C., Carbone, J. C., & Lewis, E. G. (1998, March). What’s been
happening to higher education? Facts, trends, and data 1986-7 to 1994-95.
Williamstown, MA: Williams Project on the Economics of Higher Education. DP-47.
[On-line. Available: [Link]
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 22 of 24
John H. Schuh
Department of Educational Leadership and Policy Studies
N243 Lagomarcino Hall
Iowa State University
Email: jschuh@[Link]
Mack C. Shelley, II
Department of Statistics and Department of Educational Leadership and Policy
Studies
323 Snedecor Hall
Iowa State University
Email: mshelley@[Link]
The World Wide Web address for the Education Policy Analysis Archives is
[Link]
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 23 of 24
Gustavo E. Fischman
Arizona State University
fischman@[Link]
Pablo Gentili
Laboratório de Políticas Públicas
Universidade do Estado do Rio de Janeiro
pablo@[Link]
[Link] 5/3/2004
EPAA Vol. 12 No. 19 Hamrick, Schuh & Shelley: Higher Education Institutional Character... Page 24 of 24
[Link] 5/3/2004
The study recommends prioritizing expenditures on areas directly impacting student success, such as instructional, library, and student affairs expenditures. These areas have been identified as having a strong influence on improving graduation rates. Institutions should strategically increase resource allocation in these domains to optimize student outcomes .
Instructional expenditures significantly impact graduation rates; a 10% increase in per student headcount spending results in a 1.99 percentage point increase in graduation rates, indicating a strong correlation . This is the most pronounced effect among various types of expenditures analyzed.
The presence of medical or similar programs within an institution is associated with a lower estimated mean graduation rate, such as 37.065% for institutions with such programs compared to 38.241% for those without . This trend emphasizes how program-specific focuses might impact overall graduation metrics.
Institutions classified as Research I (most prestigious) under the Carnegie classification significantly have higher graduation rates compared to other institutions. There is a nearly monotonic decline in graduation rates as the prestige of the classification decreases, with Bachelor’s II institutions having the lowest graduation rates .
A longitudinal design would allow for the examination of trends and changes in resource allocation over time, improving the reliability and applicability of findings by accounting for temporal shifts in expenditures and institutional policies. This would also enable the identification of enduring causal relationships between resource investments and graduation outcomes, thus providing richer insights for policy decisions .
The broad categorization of expenditures may obscure differences between financial commitments to undergraduate versus graduate programs, limiting the analysis's precision in assessing their specific impacts on undergraduate graduation rates . This aggregation may lead to misleading conclusions about resource impact on different student populations, highlighting the need for disaggregated data in future studies.
The study is limited in its applicability to private institutions because it focuses exclusively on public colleges and universities and does not account for differences in institutional structure or financial aid distribution between public and private institutions. It uses a cross-sectional analysis of data from a single year, which may not reflect longer-term trends that could differ significantly in private institutions .
Institutional resource allocation decisions are hypothesized to be linked to student graduation rates through a statistical model that explores these allocations as predictors of graduation rates. The study suggests that strategic allocation of resources, particularly in instruction and library expenditures, positively affects graduation rates . However, there is a decline in the percentage of budget dedicated to these areas over the past 15 years .
Expenditure on student affairs has a significant, though modest, impact on graduation rates. An additional 10% increase in spending per student headcount ($72.83) contributes to about a 0.89 percentage point increase in graduation rates . This underscores the value of student support services in enhancing academic success.
Although pairwise regional differences in graduation rates were not significant in the regression model, New England and the Mid-East regions exhibited higher mean graduation rates (44.086% and 41.005%, respectively), while the Plains and Rockies showed the lowest (34.679% and 35.021%). The analysis suggests regional contextual factors might indirectly influence graduation outcomes.