The Early Prediction of Mortality in Acute Pancreatitis: A Large Population-Based Study
The Early Prediction of Mortality in Acute Pancreatitis: A Large Population-Based Study
com
Pancreas
Pancreas
c Pleural effusion14 15 (on chest radiography or CT). accuracy. In order to assess model calibration, we compared
c The systemic inflammatory response syndrome (SIRS)
16 17
observed mortality by point score in both the derivation and
defined by the presence of >2 of the following criteria: validation cohorts. In testing the new scoring system on the
– pulse .90 beats/min validation cohort we treated missing data as normal (reference
– respirations .20/min or PaCO2 ,32 mmHg range) values.
To validate the model further, we compared its performance
– temperature .38uC or ,36uC
with that of the APACHE II. We anticipated that a large
– WBC count .12 000 or ,4000 cells/mm3 or .10% number of patients would not have complete data for
immature neutrophils (bands)
calculation of an APACHE II score. Therefore, in generating
c Haemoconcentration (haemoglobin was included as a
APACHE II scores, we treated missing data as normal (reference
continuous variable)18
19
range) values. Comparison of model AUC with the APACHE II
c Atlanta Symposium criteria for organ failure : systolic
was performed using the method described by De Long et al.25
blood pressure, creatinine, partial pressure of arterial oxygen
(PaO2).
20
c Altered mental status : defined as any record of disorienta-
Subgroup analysis
tion, lethargy somnolence, coma or stupor in the medical The ability to identify patients at increased risk of mortality
record. from AP prior to the onset of overt organ failure is of significant
In order to develop a model with widespread applicability, we clinical importance. Patients who present with evidence of
limited potential laboratory and vital sign parameters to those organ failure within the first 24 h of hospitalisation have
with collection rates of >85%. SIRS was collected as a already declared themselves as being at increased risk for
dichotomous composite variable. Physical exam findings and experiencing persistent organ failure and death.26 Numerous
co-morbidities were recorded at admission. Data for laboratory organ failure scoring systems exist for use in critical care settings
tests and vital signs were recorded for the first 24 h admission that measure the extent of organ failure. An important
period including emergency department values. The worst application of a new scoring system in AP is to identify patients
(most extreme) value for vital signs and laboratory data within at risk for mortality prior to the onset of organ failure. We were
the first 24 h of admission were utilised for model development. interested in determining how well the new scoring system
All laboratory and vital sign parameters were included as could predict mortality among patients without evidence of
continuous variables with thresholds determined by early organ failure during the first 24 h of hospitalisation.
Classification and Regression Tree (CART) analysis. Therefore, we performed a subgroup analysis in which we
applied the new prediction rule exclusively to patients without
evidence of early organ failure by Atlanta criteria (creatinine
Model derivation .2.0 mg/dl, systolic blood pressure ,90 mmHg or PaO2
We used CART analysis to identify factors for use in the new ,60 mmHg on arterial blood gas).
clinical prediction rule. CART is a non-parametric, empiric
statistical method21 that has been increasingly utilised for
clinical applications across a number of disease groups22–24 but Statistical analysis
not as yet for clinical prediction in AP. Patients are classified CART analysis was performed using the CART statistical
into two groups at each stage of analysis based on classification software package (CART Professional Extended Edition version
variables. The optimum split point for each variable is 6.0, Salford Systems, California Statistical Software, San Diego,
determined by a statistical search algorithm. Patients are California, USA). Additional statistical analysis was performed
grouped into nodes by cut-off points for classification variables. in SAS statistical software version 9.1 (SAS Institute, Cary,
The process is reiterated for subsequent classification variables. North Carolina, USA). All reported p values are two sided. We
Tree building is carried forward until a pruning process used the Bonferonni method of adjustment for multiple testing
determines the optimum tree size without overfitting the data. when examining differences in mortality between risk groups.
In order to avoid model overtraining, we used 10-fold cross-
validation in tree development. In addition, we specified a 10- RESULTS
fold misclassification cost such that misclassifying a true death Patient characteristics
was 10 times worse than misclassification of a case that In the derivation cohort, there were 17 922 cases of AP
ultimately survived. We used the Gini index as the splitting rule identified from 212 hospitals. Median age was 53 years, and
in tree building. Missing data were incorporated into the tree 50.5% were men. In the validation cohort there were 18 256
building process through use of surrogate splits. cases of AP identified from 177 hospitals. Median age was 53
A new prediction rule was subsequently generated from the years, and 49.4% were men.
parameters identified in the CART analysis. Specifically, a scoring There were a total of 335 (1.9%) deaths in the derivation
system was created in which one point was assigned for the cohort and 234 deaths (1.28%) in the validation cohort. There
presence of each parameter identified in the CART prediction was a significant reduction in overall mortality between
algorithm. We then calculated scores for each case in the derivation 2000–2001 and 2004–2005 (x2 p,0.001). Distributions for
cohort and compared this with their observed outcome. demographic and clinical features between the two study
populations are depicted in table 1. The serum calcium, LDH,
Model validation PaO2 and AST measurements were excluded from further
To validate performance of the new scoring system on a consideration in developing the new scoring system due to their
separate group of patients, we tested its ability to predict in- failure to meet the pre-specified 85% collection rate threshold.
hospital mortality in the validation cohort. We calculated scores
for each case and compared this with observed mortality. From CART analysis
this analysis we calculated the area under the receiver operating Using CART analysis we identified five variables as most
characteristic curve (AUC) as a measure of discrimination efficient in stratifying patients according to risk of mortality:
Pancreas
Hospital demographics
Hospitals 212 177
Teaching hospitals 49.9% 39.7%
Bed size
,100 beds 10% 27%
100–300 beds 58% 50%
.300 beds 32% 23%
Patient demographics and co-morbidity
Acute pancreatitis cases (n) 17922 18256
Median age in years (range) 53 (18–106) 53 (18–108)
Men 50.5% 49.4%
Gallstones 25.4% 23.8%
Alcohol history (dependency or abuse) 22.4% 21.1%
Chronic pancreatitis 7.0% 8.5%
Congestive heart failure 7.04% 6.5%
Chronic kidney disease 5.1% 5.7%
Chronic obstructive pulmonary disease 12.0% 10.4%
Clinical parameters
SIRS present* 48.96% 50.3%
WBC count 6103 (median, IQR) 10.2 (7.5–13.7) 9.9 (7.3–13.3)
Temperature, uC (median IQR) 36.1 (35.6 to 36.7) 36.4 (36.1–37.0)
Pulse, beats/min (median, IQR) 70 (60–100) 85 (70–100)
Respirations per minute (median, IQR) 10 (10–20) 18 (10–20)
Systolic blood pressure, mmHg (median, IQR)* 140 (130–160) 134 (118–160)
Haemoglobin, mg/dl (median, IQR)* 13.8 (12.4–15.1) 13.8 (12.4–15.1)
Blood urea nitrogen, mg/dl (median, IQR)* 15 (10–21) 14 (10–21)
Creatinine, mg/dl (median, IQR)* 0.9 (0.8–1.2) 0.9 (0.8–1.2)
Glucose, mg/dl (median, IQR)* 128 (105–170) 123 (102–163)
Pleural effusion* 4.1% 4.4%
Altered mental status* 7.4% 6.7%
Proportions listed in this table reflect the number of patients with each finding divided by the total number of patients in each
cohort. Vital signs and laboratory test values were the most extreme within the first 24 h of admission.
*Candidate variables entered into CART analysis.
CART, Classification and Regression Tree; IQR, interquartile range; SIRS, systemic inflammatory response syndrome; WBC, white
blood cell.
BUN .25 mg/dl, impaired mental status, SIRS, age .60 years was a significant trend towards higher mortality with increas-
and pleural effusion (BISAP). The CART tree is depicted in fig 1. ing BISAP score (Cochrane–Armitage trend test p,0.001). In
BUN was identified as the most efficient first splitting variable. addition, significant differences existed between risk groups (x2
Age and SIRS further discriminated between high- and low-risk p,0.001 overall, pairwise x2 Bonferroni-adjusted p,0.001).
cases. The remaining parameters (mental status and pleural Below average mortality was observed in patients with ,2
effusion) served to differentiate intermediate risk patients points (,1.0% mortality). Patients with a score of 2 had
further. increased mortality (2%). Mortality continued to rise sharply
with BISAP scores of >3 (5–20%).
Validation of scoring system In both the derivation and validation cohort, the majority of
The five variables from the CART were incorporated into a new patients (,60%) presented with BISAP scores ,2 and were at
scoring system in which the presence of each variable very low risk for mortality (,1.0%). The new scoring system
contributes one point to an overall 5-point score. After was able to identify subgroups of patients (those with scores of
calculating scores for patients in the derivation cohort, the >3) with substantially increased risk of dying in the course of
BISAP score AUC was 0.83 for prediction of in-hospital their hospitalisation.
mortality.
In the validation cohort there were 17 350 (96.8%) cases with APACHE II
complete laboratory and vital sign data for the five parameters There were 405 (2.2%) patients with complete data for
included in the scoring system. There were 213 (1.2%) deaths APACHE II. There were 40 (9.9%) deaths among these patients.
among these patients. After calculating BISAP scores for After imputation, APACHE II scores were calculated for each
patients in the validation cohort, the AUC for prediction of patient as previously described. The median calculated APACHE
in-hospital mortality was 0.82. II score for the 2004–2005 AP population was 7. The receiver
Table 2 depicts observed mortality stratified by BISAP point operating characteristic (ROC) curve for the APACHE II score is
score in both cohorts of patients. Also depicted in table 2 is the shown in fig 2. Calculated AUC was 0.83 (95% CI 0.80 to 0.85).
frequency of patients within each score category. Using the 5- For purposes of comparison, a similar ROC curve was plotted
point scoring system, patients could be reliably classified within for the BISAP score on the 2004–2005 population. The BISAP
24 h of admission into distinct risk groups for mortality. There AUC was 0.82 (95% CI 0.79 to 0.84) in the validation cohort.
Pancreas
Table 2 Observed mortality by BISAP point score in the derivation and validation cohorts
Derivation cohort, n = 17 922 Validation cohort, n = 18 256
BISAP score Number of cases Observed mortality Number of cases Observed mortality
Pancreas
0 4796 0.1%
1 7287 0.4%
2 3307 1.6%
3 916 3.6%
4 176 7.4%
5 21 9.5%
Overall and pairwise x2 p,0.001.
BISAP, blood urea nitrogen, impaired mental status, systemic
inflammatory response syndrome, age and pleural effusion.
Pancreas
strict Atlanta Symposium criteria.19 As a result, milder causes of 20. Tran DD, Cuesta MA. Evaluation of severity in patients with acute pancreatitis.
Am J Gastroenterol 1992;87:604–8.
abdominal pain may have been misclassified as AP. 21. Breiman L. Classification and regression trees. Belmont, California: Wadsworth
Nevertheless, observed mortality in both cohorts of patients International Group, 1984.
was consistent with data from recent studies examining trends 22. Fonarow GC, Adams KF Jr, Abraham WT, et al. Risk stratification for in-hospital
in AP.3 4 46 47 A second limitation was limited information mortality in acutely decompensated heart failure: classification and regression tree
analysis. JAMA 2005;293:572–80.
regarding aetiology, obesity or initial versus recurrent episode 23. Miller PD, Barlas S, Brenneman SK, et al. An approach to identifying osteopenic
of AP, each of which may have prognostic value in AP.30 32 48 49 women at increased short-term risk of fracture. Arch Intern Med 2004;164:1113–20.
In summary, we have derived and validated a prognostic 24. Takahashi O, Cook EF, Nakamura T, et al. Risk stratification for in-hospital mortality
scoring system for use in AP. The BISAP score stratifies patients in spontaneous intracerebral haemorrhage: a Classification and Regression Tree
analysis. QJM 2006;99:743–50.
within the first 24 h of admission according to their risk of in- 25. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or
hospital mortality and was able to identify patients at increased more correlated receiver operating characteristic curves: a nonparametric approach.
risk of mortality prior to the onset of organ failure. The ability Biometrics 1988;44:837–45.
26. Johnson CD, Abu-Hilal M. Persistent organ failure during the first week as a marker
to risk-stratify patients early in their course is a major step to of fatal outcome in acute pancreatitis. Gut 2004;53:1340–4.
improving future management strategies in acute pancreatitis. 27. Knaus WA, Draper EA, Wagner DP, et al. APACHE II: a severity of disease
classification system. Crit Care Med 1985;13:818–29.
Acknowledgements: The authors would like to thank Linda Hyde, Karen Derby and 28. Ueda T, Takeyama Y, Yasuda T, et al. Simple scoring system for the prediction of the
Stephen Kurtz of Cardinal Health for their assistance with data management. In prognosis of severe acute pancreatitis. Surgery 2007;141:51–8.
addition, we would like to thank Dr Earl F Cook of the Harvard School of Public Health 29. Rau BM, Bothe A, Kron M, et al. Role of early multisystem organ failure as major risk
for assistance with study design and data analysis. factor for pancreatic infections and death in severe acute pancreatitis. Clin
Gastroenterol Hepatol 2006;4:1053–61.
Competing interests: None. 30. Papachristou GI, Papachristou DJ, Avula H, et al. Obesity increases the severity of
Ethics approval: The study was approved by the Brigham & Women’s Hospital acute pancreatitis: performance of APACHE-O score and correlation with the
Institutional Review Board. inflammatory response. Pancreatology 2006;6:279–85.
31. Spitzer AL, Barcia AM, Schell MT, et al. Applying Ockham’s razor to pancreatitis
prognostication: a four-variable predictive model. Ann Surg 2006;243:380–8.
REFERENCES 32. Martinez J, Johnson CD, Sanchez-Paya J, et al. Obesity is a definitive risk factor of
1. Fagenholz PJ, Fernandez-del Castillo C, Harris NS, et al. Direct medical costs of severity and mortality in acute pancreatitis: an updated meta-analysis. Pancreatology
acute pancreatitis hospitalizations in the United States. Pancreas 2007;35:302–7. 2006;6:206–9.
2. Fagenholz PJ, Fernandez-del Castillo C, Harris NS, et al. National study of United 33. Mentula P, Kylanpaa ML, Kemppainen E, et al. Early prediction of organ failure by
States emergency department visits for acute pancreatitis, 1993–2003. BMC Emerg combined markers in patients with acute pancreatitis. Br J Surg 2005;92:68–75.
Med 2007;7:1. 34. Gan SI, Romagnuolo J. Admission hematocrit: a simple, useful and early predictor of
3. Fagenholz PJ, Castillo CF, Harris NS, et al. Increasing United States hospital severe pancreatitis. Dig Dis Sci 2004;49:1946–52.
admissions for acute pancreatitis, 1988–2003. Ann Epidemiol 2007;17:491–7. 35. Company L, Saez J, Martinez J, et al. Factors predicting mortality in severe acute
4. Banks PA, Freeman ML. Practice guidelines in acute pancreatitis. Am J Gastroenterol pancreatitis. Pancreatology 2003;3:144–8.
2006;101:2379–400. 36. Halonen KI, Leppaniemi AK, Lundin JE, et al. Predicting fatal outcome in the early
5. Ranson JH, Rifkind KM, Roses DF, et al. Objective early identification of severe acute phase of severe acute pancreatitis by using novel prognostic models. Pancreatology
pancreatitis. Am J Gastroenterol 1974;61:443–51. 2003;3:309–15.
6. Blamey SL, Imrie CW, O’Neill J, et al. Prognostic factors in acute pancreatitis. Gut 37. Blum T, Maisonneuve P, Lowenfels AB, et al. Fatal outcome in acute pancreatitis: its
1984;25:1340–6. occurrence and early prediction. Pancreatology 2001;1:237–41.
7. Ranson JH, Pasternack BS. Statistical methods for quantifying the severity of clinical 38. Losanoff JE, Asparouhov OK, Jones JW. Multiple factor scoring system for risk
acute pancreatitis. J Surg Res 1977;22:79–91. assessment of acute pancreatitis. J Surg Res 2001;101:73–8.
8. Yeung YP, Lam BY, Yip AW. APACHE system is better than Ranson system in the
39. Halonen KI, Leppaniemi AK, Puolakkainen PA, et al. Severe acute pancreatitis:
prediction of severity of acute pancreatitis. Hepatobiliary Pancreat Dis Int 2006;5:294–9.
prognostic factors in 270 consecutive patients. Pancreas 2000;21:266–71.
9. Larvin M, McMahon MJ. APACHE-II score for assessment and monitoring of acute
40. Harrison DA, D’Amico G, Singer M. The Pancreatitis Outcome Prediction (POP)
pancreatitis. Lancet 1989;2:201–5.
Score: a new prognostic index for patients with severe acute pancreatitis. Crit Care
10. Iezzoni LI, Hotchkin EK, Ash AS, et al. MedisGroups data bases. The impact of data
Med 2007;35:1703–8.
collection guidelines on predicting in-hospital mortality. Med Care 1993;31:277–83.
11. Tabak YP, Johannes RS, Silber JH. Using automated clinical data for risk 41. Isenmann R, Rau B, Beger HG. Early severe acute pancreatitis: characteristics of a
adjustment: development and validation of six disease-specific mortality predictive new subgroup. Pancreas 2001;22:274–8.
models for pay-for-performance. Med Care 2007;45:789–805. 42. Fan ST, Choi TK, Lai EC, et al. Prediction of severity of acute pancreatitis: an
12. Iezzoni LI, Moskowitz MA. A clinical assessment of MedisGroups. JAMA alternative approach. Gut 1989;30:1591–5.
1988;260:3159–63. 43. Perez A, Whang EE, Brooks DC, et al. Is severity of necrotizing pancreatitis increased
13. Fine MJ, Auble TE, Yealy DM, et al. A prediction rule to identify low-risk patients in extended necrosis and infected necrosis? Pancreas 2002;25:229–33.
with community-acquired pneumonia. N Engl J Med 1997;336:243–50. 44. Taylor SL, Morgan DL, Denson KD, et al. A comparison of the Ranson, Glasgow, and
14. Heller SJ, Noordhoek E, Tenner SM, et al. Pleural effusion as a predictor of severity APACHE II scoring systems to a multiple organ system score in predicting patient
in acute pancreatitis. Pancreas 1997;15:222–5. outcome in pancreatitis. Am J Surg 2005;189:219–22.
15. Belfar HL, Radecki PD, Friedman AC, et al. Pancreatitis presenting as pleural 45. Robert JH, Frossard JL, Mermillod B, et al. Early prediction of acute pancreatitis:
effusions: computed tomography demonstration of pleural space extension of prospective study comparing computed tomography scans, Ranson, Glascow, Acute
pancreatitis exudate. J Comput Tomogr 1987;11:184–7. Physiology and Chronic Health Evaluation II scores, and various serum markers.
16. Mofidi R, Duff MD, Wigmore SJ, et al. Association between early systemic World J Surg 2002;26:612–9.
inflammatory response, severity of multiorgan dysfunction and death in acute 46. Yadav D, Lowenfels AB. Trends in the epidemiology of the first attack of acute
pancreatitis. Br J Surg 2006;93:738–44. pancreatitis: a systematic review. Pancreas 2006;33:323–30.
17. Buter A, Imrie CW, Carter CR, et al. Dynamic nature of early organ dysfunction 47. Frey CF, Zhou H, Harvey DJ, et al. The incidence and case-fatality rates of acute
determines outcome in acute pancreatitis. Br J Surg 2002;89:298–302. biliary, alcoholic, and idiopathic pancreatitis in California, 1994–2001. Pancreas
18. Brown A, Orav J, Banks PA. Hemoconcentration is an early marker for organ failure 2006;33:336–44.
and necrotizing pancreatitis. Pancreas 2000;20:367–72. 48. Pezzilli R, Billi P, Morselli-Labate AM. Severity of acute pancreatitis: relationship
19. Bradley EL 3rd. A clinically based classification system for acute pancreatitis. with etiology, sex and age. Hepato-gastroenterology 1998;45:1859–64.
Summary of the International Symposium on Acute Pancreatitis, Atlanta, Ga, 49. Lankisch PG, Assmus C, Pflichthofer D, et al. Which etiology causes the most
September 11 through 13, 1992. Arch Surg 1993;128:586–90. severe acute pancreatitis? Int J Pancreatol 1999;26:55–7.
These include:
References This article cites 48 articles, 4 of which can be accessed free at:
[Link]
Email alerting Receive free email alerts when new articles cite this article. Sign up in
service the box at the top right corner of the online article.
Notes