 |
|
Application of the TIMI Risk Score for ST-Elevation MI in the National Registry of Myocardial Infarction 3
David A. Morrow, MD;
Elliott M. Antman, MD;
Lori Parsons, BS;
James A. de Lemos, MD;
Christopher P. Cannon, MD;
Robert P. Giugliano, MD,SM;
Carolyn H. McCabe, BS;
Hal V. Barron, MD;
Eugene Braunwald, MD
JAMA. 2001;286:1356-1359.
ABSTRACT
| |
Context The Thrombolysis in Myocardial Infarction (TIMI) risk score for ST-elevation myocardial infarction (STEMI) is a simple integer score for bedside risk assessment of patients with STEMI. Developed and validated in multiple clinical trials of fibrinolysis, the risk score has not been validated in a community-based population.
Objective To validate the TIMI risk score in a population of STEMI patients reflective of contemporary practice.
Design, Setting, and Participants The risk score was evaluated among 84 029 patients with STEMI from the National Registry of Myocardial Infarction 3 (NRMI 3), which collected data on consecutive patients with myocardial infarction (MI) from 1529 US hospitals between April 1998 and June 2000.
Main Outcome Measures Ability of the TIMI risk score to correctly predict risk of death in terms of model discrimination (c statistic) and calibration (agreement of predicted and observed death rates).
Results Patients in NRMI 3 tended to be older, to be more often female, and to have a history of coronary disease more often than those in the derivation set. Forty-eight percent received reperfusion therapy. The TIMI risk score revealed a significant graded increase in mortality with rising score (range, 1.1%-30.0%; P<.001 for trend). The risk score showed strong prognostic capacity overall (c = 0.74 vs 0.78 in derivation set) and among patients receiving acute reperfusion therapy (c = 0.79). Predictive behavior of the risk score was similar between fibrinolytic-treated patients (n = 23 960; c = 0.79) and primary percutaneous coronary intervention patients (n = 15 348; c = 0.80). In contrast, among patients not receiving reperfusion therapy, the risk score underestimated death rates and offered lower discriminatory capacity (c = 0.65).
Conclusions Sufficiently simple to be practical at the bedside and effective for risk assessment across a spectrum of patients, the TIMI risk score may be useful in triage and treatment of patients with STEMI who are treated with reperfusion therapy.
INTRODUCTION
Effective risk stratification is integral to management of acute coronary syndromes.1 Even among patients with ST-elevation myocardial infarction (STEMI), for whom initial therapeutic options are well-defined, patient risk characteristics impact short- and long-term medical decision making.2-4 Early risk assessment guides triage to alternative levels of hospital care, decisions regarding therapeutic interventions, and application of clinical pathways that direct patient care and use of clinical resources. Despite well-characterized risk predictors,5-7 reliable quantitative estimation of risk is challenging, as patients present with complex risk profiles requiring integration of numerous elements of qualitative and quantitative data. Thus, practical tools that enhance clinicians' ability to rapidly and accurately assess risk are of substantial interest.
The Thrombolysis in Myocardial Infarction (TIMI) risk score for STEMI is a simple integer score that can be used at the bedside for risk stratification of patients at presentation with ST-elevation acute coronary syndromes.8 Derived from 14 114 patients enrolled in the InTIME II (Intravenous nPA for Treatment of Infarcting Myocardium Early) trial, the TIMI risk score is a robust clinical tool for mortality risk prediction in fibrinolytic-eligible patients with STEMI.8 Although it is documented to perform well among patients receiving fibrinolytics in clinical trials,8 the TIMI risk score has not been validated in a general population of patients with STEMI, including those treated with primary coronary revascularization or not receiving any form of acute reperfusion therapy. Since prospective validation in a data set reflective of contemporary practice is important prior to widespread application of any prediction rule, we evaluated the prognostic performance of the TIMI risk score in a heterogeneous population treated in US hospitals for acute myocardial infarction (MI) and entered into the National Registry of Myocardial Infarction 3 (NRMI 3).
METHODS
The third NRMI is a prospective, observational database of demographics, practice patterns, and health outcomes among patients with acute MI.9 Data were collected on consecutive patients with MI from 1529 hospitals between April 1998 and June 2000. All treatment decisions were made at the discretion of the treating physicians. The present analysis included patients with ST elevation or presumed new left bundle-branch block who completed their stay at the admitting hospital and were not in cardiogenic shock at the initial evaluation.
The TIMI risk score for STEMI is a weighted integer score based on 8 clinical risk indicators that can be easily ascertained at presentation (Table 1).8 For each patient, the score is calculated as the arithmetic sum of the points for each risk feature present (range, 0-14). The TIMI risk score was developed using multivariable methods among patients from the InTIME II trial, a phase 3 trial of lanoteplase vs alteplase reperfusion therapy.8 The risk score was derived based on mortality through 30 days after presentation but showed stable prognostic performance across multiple time points, including time to discharge (c = 0.78).8
|
|
|
|
Table 1. Elements of the TIMI Risk Score*
|
|
|
Evaluation of the TIMI risk score was based on NRMI 3 patients with complete baseline data (89%). The prognostic discriminatory capacity of the TIMI risk score was expressed as the c statistic, representing the area under the receiver operating characteristic curve for prediction of in-hospital death.10 Differences in event rates with increasing risk scores were assessed using the  2 test for trend. Model calibration was assessed by construction of plots of predicted vs actual death rates across the entire spectrum of predicted risk. Testing for differences in mortality gradients among groups with different treatment modes was performed using logistic regression analysis with interaction terms. The prognostic contributions of variables not included in the risk score were assessed by stepwise logistic regression. Patients who did not receive any reperfusion therapy were not assessed for the predictor variable of time to reperfusion therapy. Two-tailed P values <.05 were considered significant. Analyses were performed using SAS, version 8.0 (SAS Institute Inc, Cary, NC).
RESULTS
The analysis included 84 029 patients with STEMI. Baseline characteristics are summarized in Table 2. Patients from NRMI 3 tended to be older; were more often female; and tended to have more heart failure, previous MIs, and prior coronary revascularization procedures than patients in the derivation set.8 Among the NRMI 3 validation set, 40 214 patients (48%) were treated with pharmacological or mechanical reperfusion therapy. Those who underwent primary percutaneous coronary intervention (n = 15 348) represented 38% of patients who received reperfusion therapy. Patients treated without reperfusion therapy had more frequent high-risk features and a higher median TIMI risk score (Table 2).
|
|
|
|
Table 2. Baseline Characteristics of the NRMI 3 Validation and InTIME II Derivation Sets*
|
|
|
In-hospital mortality was 12.6% (n = 10 612). Application of the TIMI risk score in the overall population from NRMI 3 revealed a significant, nearly 30-fold graded increase in risk between patients with a score of 0 and those with a score of 8 or higher (range, 1.1%-30.0%; P<.001 for trend). Assessed by the area under the receiver operating characteristic curve, the risk score showed a strong prognostic capacity (c = 0.74) that was comparable with the risk score performance in the InTIME II trial (c = 0.78).8
Stratification of the population into those who were treated with vs without reperfusion therapy revealed substantial differences in risk score discriminatory performance as well as in calibration. The prognostic capacity of the TIMI risk score among patients treated with acute reperfusion therapy (c = 0.79) was unchanged compared with InTIME II and was similar between patients treated with fibrinolytics and those who underwent primary percutaneous coronary interventions (c = 0.79 vs 0.80), with no significant difference in the slope of the risk gradient between the 2 groups (P = .09 for interaction).
Figure 1 shows the behavior of the TIMI risk score in terms of predicting death across the spectrum of expected risk. The observed mortality rates for patients in NRMI 3 receiving reperfusion therapy were strongly concordant with risk estimates derived from InTIME II (r = 0.99; Figure 1), indicating good model calibration. Among patients treated without reperfusion therapy, a significant graded relationship between the TIMI risk score and mortality was also evident (P<.001 for trend; Figure 1). Of note, however, the slope of the risk gradient in this group was less steep owing to a pattern of higher mortality among patients with risk scores in the low and middle range (P<.001 for interaction; c = 0.65). As such, the quantitative mortality estimates from InTIME II underestimated the risk for patients treated without reperfusion therapy except those with the highest predicted death rates.
|
|
|
|
Figure. Prediction of In-Hospital Mortality With TIMI Risk Score for STEMI
STEMI indicates ST-elevation myocardial infarction; NRMI 3, the National Registry of Myocardial Infarction 3. Data for the Intravenous nPA for Treatment of Infarcting Myocardium Early (InTIME II) trial are from Morrow.8
|
|
|
Exploratory analysis was performed to identify additional important predictors in patients treated without reperfusion therapy. Among the variables considered, bleeding risk (active internal bleeding or recent surgery/trauma), uncertainty regarding diagnosis, major organ failure, and chronic renal failure added significantly to the multivariable model including each of the risk score predictors (c = 0.746; P<.001). While history of smoking and prior stroke added further to the model, the improvement in discriminatory capacity was small (c = 0.750).
COMMENT
Results from risk prediction tools developed in carefully selected patients enrolled in clinical trials may not be generalizable to heterogeneous, "real-world" patient populations. This analysis demonstrates the robust prognostic performance of the TIMI risk score in a general population of patients with ST-elevation acute coronary syndromes treated with acute reperfusion therapy in a diverse group of US hospitals. The strong predictive capacity of the risk score was evident among patients treated with either pharmacological or mechanical reperfusion therapy. These observations establish the prognostic efficacy of the TIMI risk score in a large group of patients representative of contemporary clinical practice.
Patients who were not administered reperfusion therapy showed a pattern of higher mortality risk. Although the difference in outcomes may be due in part to the established benefits of reperfusion therapy, we identified several high-risk features not included in the TIMI risk score that are likely related to the decision not to administer reperfusion therapy, and offer additional predictive information. While the quantitative mortality estimates from InTIME II do not apply to these patients, the TIMI risk score may aid in their categorization into groups of low, moderate, and high relative risk. Limited information is available regarding the performance of other validated models stratified by use of reperfusion therapy. Our data suggest that future work should include evaluation of existing and new models in these important subgroups of the overall population with acute MI (Table 3).
|
|
|
|
Table 3. Adjusted Mortality Risk Relationships in NRMI 3 vs InTIME II*
|
|
|
The TIMI risk score was developed with the objective of creating a risk assessment tool that is both effective and convenient for use at patient presentation. With just a few important clinical factors, the risk score captures the majority of prognostic information available from more complex models among patients treated with reperfusion therapy.8 The discriminatory capacity of the model could be increased by inclusion of additional variables or more complex modeling, but at the cost of hindering practical application. Other well-validated models have been derived for the purpose of risk-adjusted analysis of hospital outcomes to direct quality improvement efforts.7, 11 Such models have incorporated data acquired during hospitalization to provide high-discriminatory capacity with respect to long-term outcomes. In contrast, the TIMI risk score is based on clinical information that is available at the time of hospital arrival and, thus, is suitable for early risk stratification at the bedside without the need for a computer. The impact of differences in treatment, along with noninvasive and invasive data accrued during the course of hospitalization, should be considered by clinicians in a continuous process of updating the initial assessment of risk offered by the TIMI risk score.
Sufficiently simple to be practical at the bedside and effective for risk assessment across a heterogeneous spectrum of patients, the TIMI risk score may be clinically useful in the triage and treatment of patients with STEMI who undergo acute reperfusion therapy.
AUTHOR INFORMATION
Author Contributions: Study concept and design: Morrow, Antman, Barron, Braunwald.
Acquisition of data: Barron.
Analysis and interpretation of data: Morrow, Antman, Parsons, de Lemos, Cannon, Giugliano, McCabe, Barron, Braunwald.
Drafting of the manuscript: Morrow.
Critical revision of the manuscript for important intellectual content: Morrow, Antman, Parsons, de Lemos, Cannon, Giugliano, McCabe, Barron, Braunwald.
Statistical expertise: Morrow, Antman, Parsons, Giugliano, Barron.
Obtained funding: Barron.
Administrative, technical, or material support: Barron.
Study supervision: Antman, Cannon, Barron, Braunwald.
Funding/Support: The National Registry of Myocardial Infarction 3 is supported by Genentech Inc.
Financial Disclosure: Drs Antman, Giugliano, and Braunwald and Ms McCabe have received research grant support from Genentech. Dr Cannon serves as a consultant to Asahi Chemical Co and Bio-Technology General Corp; is a member of the speakers bureaus for Centocor and Genentech; and has received honoraria for preparation of educational materials from Centocor.
Reprints not available from the author.
Corresponding Author: David A. Morrow, MD, Cardiovascular Division, Brigham and Women's Hospital, 75 Francis St, Boston, MA 02115 (e-mail: damorrow{at}bics.bwh.harvard.edu).
Author Affiliations: Department of Medicine, Brigham & Women's Hospital, Boston, Mass (Drs Morrow, Antman, Cannon, Giugliano, and Braunwald and Ms McCabe); Ovation Research Group, Seattle, Wash (Ms Parsons); Donald W. Reynolds Cardiovascular Clinical Research Center, University of Texas Southwestern, Dallas (Dr de Lemos); and Department of Medicine, University of California, San Francisco, and Department of Medical Affairs, Genentech Inc, San Francisco (Dr Barron).
REFERENCES
| |
1. Maseri A, Rebuzzi AG, Cianflone D. Need for a composite risk stratification of patients with unstable coronary syndromes tailored to clinical practice. Circulation. 1997;96:4141-4142.
2. Fibrinolytic Therapy Trialists' Collaborative Group. Indications for fibrinolytic therapy in suspected acute myocardial infarction. Lancet. 1994;343:311-322.
FULL TEXT
|
ISI
| PUBMED
3. Becker RC, Burns M, Gore JM, et al. Early assessment and in-hospital management of patients with acute myocardial infarction at increased risk for adverse outcomes. Am Heart J. 1998;135:786-796.
FULL TEXT
|
ISI
| PUBMED
4. Hochman JS, Sleeper LA, Webb JG, et al. Early revascularization in acute myocardial infarction complicated by cardiogenic shock. N Engl J Med. 1999;341:625-634.
FREE FULL TEXT
5. Lee KL, Woodlief LH, Topol EJ, et al. Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction. Circulation. 1995;91:1659-1668.
FREE FULL TEXT
6. Jacobs DR Jr, Kroenke C, Crow R, et al. PREDICT: a simple risk score for clinical severity and long-term prognosis after hospitalization for acute myocardial infarction or unstable angina: the Minnesota Heart Survey. Circulation. 1999;100:599-607.
FREE FULL TEXT
7. Krumholz HM, Chen J, Wang Y, Radford MJ, Chen YT, Marciniak TA. Comparing AMI mortality among hospitals in patients 65 years of age and older. Circulation. 1999;99:2986-2992.
FREE FULL TEXT
8. Morrow DA, Antman EM, Charlesworth A, et al. TIMI risk score for ST-elevation myocardial infarction: a convenient, bedside, clinical score for risk assessment at presentation: an InTIME II trial substudy. Circulation. 2000;102:2031-2037.
FREE FULL TEXT
9. Rogers WJ, Bowlby LJ, Chandra NC, et al. Treatment of myocardial infarction in the United States (1990 to 1993): observations from the National Registry of Myocardial Infarction. Circulation. 1994;90:2103-2114.
FREE FULL TEXT
10. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29-36.
FREE FULL TEXT
11. Tu JV, Austin PC, Walld R, et al. Development and validation of the Ontario acute myocardial infarction mortality prediction rules. J Am Coll Cardiol. 2001;37:992-997.
FREE FULL TEXT
RELATED ARTICLE
September 19, 2001
JAMA. 2001;286(11):1389-1390.
EXTRACT
| FULL TEXT
THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES
|
Response to Letter Regarding Article, "A Regional System to Provide Timely Access to Percutaneous Coronary Intervention for ST-Elevation Myocardial Infarction"
Henry et al.
Circulation 2008;117:e329-e329.
FULL TEXT
N-terminal pro-B-type natriuretic peptide is better than TIMI risk score at predicting death after acute myocardial infarction
Khan et al.
Heart 2008;94:40-43.
ABSTRACT
| FULL TEXT
Growth-differentiation factor-15 improves risk stratification in ST-segment elevation myocardial infarction
Kempf et al.
Eur Heart J 2007;28:2858-2865.
ABSTRACT
| FULL TEXT
Safety and diagnostic accuracy of stress cardiac magnetic resonance imaging vs exercise tolerance testing early after acute ST elevation myocardial infarction
Greenwood et al.
Heart 2007;93:1363-1368.
ABSTRACT
| FULL TEXT
A strategy of using enoxaparin as adjunctive antithrombin therapy reduces death and recurrent myocardial infarction in patients who achieve early ST-segment resolution after fibrinolytic therapy: the ExTRACT-TIMI 25 ECG study
Scirica et al.
Eur Heart J 2007;28:2070-2076.
ABSTRACT
| FULL TEXT
Impact of multivessel disease on reperfusion success and clinical outcomes in patients undergoing primary percutaneous coronary intervention for acute myocardial infarction
Sorajja et al.
Eur Heart J 2007;28:1709-1716.
ABSTRACT
| FULL TEXT
Relationship between circulating endothelial cells and the predicted risk of cardiovascular events in acute coronary syndromes
Boos et al.
Eur Heart J 2007;28:1092-1101.
ABSTRACT
| FULL TEXT
External Validity of Clinical Trials in Acute Myocardial Infarction
Steg et al.
Arch Intern Med 2007;167:68-73.
ABSTRACT
| FULL TEXT
A Multinational Study to Establish the Value of Early Adenosine Technetium-99m Sestamibi Myocardial Perfusion Imaging in Identifying a Low-Risk Group for Early Hospital Discharge After Acute Myocardial Infarction
Mahmarian et al.
J Am Coll Cardiol 2006;48:2448-2457.
ABSTRACT
| FULL TEXT
A new simplified immediate prognostic risk score for patients with acute myocardial infarction
Williams et al.
Emerg. Med. J. 2006;23:186-192.
ABSTRACT
| FULL TEXT
Translating Clinical Research into Clinical Practice: Impact of Using Prediction Rules To Make Decisions
Reilly and Evans
ANN INTERN MED 2006;144:201-209.
ABSTRACT
| FULL TEXT
Simple Risk Stratification at Admission to Identify Patients With Reduced Mortality From Primary Angioplasty
Thune et al.
Circulation 2005;112:2017-2021.
ABSTRACT
| FULL TEXT
The Impact of Preoperative Thrombolysis on Long-Term Survival After Coronary Artery Bypass Grafting
Toumpoulis et al.
Circulation 2005;112:I-351-I-357.
ABSTRACT
| FULL TEXT
Prediction of Mortality After Primary Percutaneous Coronary Intervention for Acute Myocardial Infarction: The CADILLAC Risk Score
Halkin et al.
J Am Coll Cardiol 2005;45:1397-1405.
ABSTRACT
| FULL TEXT
Severity of heart failure, treatments, and outcomes after fibrinolysis in patients with ST-elevation myocardial infarction
Kashani et al.
Eur Heart J 2004;25:1702-1710.
ABSTRACT
| FULL TEXT
Thrombolysis and Adjunctive Therapy in Acute Myocardial Infarction: The Seventh ACCP Conference on Antithrombotic and Thrombolytic Therapy
Menon et al.
Chest 2004;126:549S-575S.
ABSTRACT
| FULL TEXT
Performance of the thrombolysis in myocardial infarction risk index in the National Registry of Myocardial Infarction-3 and -4: A simple index that predicts mortality in ST-segment elevation myocardial infarction
Wiviott et al.
J Am Coll Cardiol 2004;44:783-789.
ABSTRACT
| FULL TEXT
The Risk Score Profile: a novel approach to characterising the risk of populations enrolled in clinical studies
Morrow et al.
Eur Heart J 2004;25:1139-1145.
ABSTRACT
| FULL TEXT
Bootstrap resampling methods: something for nothing?
Grunkemeier and Wu
Ann. Thorac. Surg. 2004;77:1142-1144.
FULL TEXT
Predictors of Hospital Mortality in the Global Registry of Acute Coronary Events
Granger et al.
Arch Intern Med 2003;163:2345-2353.
ABSTRACT
| FULL TEXT
Heart Failure Management: Caregiver Versus Care Plan
Kim and Hunt
Circulation 2003;108:129-131.
FULL TEXT
Validity of a Simple ST-Elevation Acute Myocardial Infarction Risk Index: Are Randomized Trial Prognostic Estimates Generalizable to Elderly Patients? * Response
Das et al.
Circulation 2003;108
:e9-e10.
FULL TEXT
"Watchful waiting"after thrombolysis: It's time for a re-evaluation
O'Neill
J Am Coll Cardiol 2003;42:17-19.
FULL TEXT
OTHER ARTICLES NOTED (Nov 01 to 18 Oct 02)
Evid. Based Nurs. 2003;6:e1-1.
FULL TEXT
Strong predictive value of TIMI risk score analysis for in-hospital and long-term survival of patients with right ventricular infarction
Gumina et al.
Eur Heart J 2002;23:1678-1683.
ABSTRACT
| FULL TEXT
Scores for Post-Myocardial Infarction Risk Stratification in the Community
Singh et al.
Circulation 2002;106:2309-2314.
ABSTRACT
| FULL TEXT
Hospital outcomes in patients presenting with congestive heart failure complicating acute myocardial infarction: A report from the Second National Registry of Myocardial Infarction (NRMI-2)
Wu et al.
J Am Coll Cardiol 2002;40:1389-1394.
ABSTRACT
| FULL TEXT
ADDITIONAL ARTICLES ABSTRACTED IN ACP JOURNAL CLUB
Evid. Based Med. 2002;7:35-35.
FULL TEXT
Improving Care for Elderly Patients With Peptic Ulcer Disease: Should the Focus Be on Drugs or Bugs?
Butler et al.
JAMA 2001;286:2023-2024.
FULL TEXT
|
