This Article  • References  • Full text PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Contact me when this article is cited  Related Content  • Related letter  • Similar articles in JAMA  Social Bookmarking   What's this?

Lisa I. lezzoni, MD, MSc

JAMA. 1997;278(19):1600-1607.

Abstract
Context.
—Risk adjustment is essential before comparing patient outcomes across hospitals. Hospital report cards around the country use different risk adjustment methods.

Objectives.
—To examine the history and current practices of risk adjusting hospital death rates and consider the implications for using risk-adjusted mortality comparisons to assess quality.

Data Sources and Study Selection.
—This article examines severity measures used in states and regions to produce comparisons of risk-adjusted hospital death rates. Detailed results are presented from a study comparing current commercial severity measures using a single database. It included adults admitted for acute myocardial infarction (n=11 880), coronary artery bypass graft surgery (n=7765), pneumonia (n=18016), and stroke (n=9407). Logistic regressions within each condition predicted in-hospital death using severity scores. Odds ratios for in-hospital death were compared across pairs of severity measures. For each hospital, z scores compared actual and expected death rates.

Results.
—The severity measure called Disease Staging had the highest c statistic (which measures how well a severity measure discriminates between patients who lived and those who died) for acute myocardial infarction, 0.86; the measure called All Patient Refined Diagnosis Related Groups had the highest for coronary artery bypass graft surgery, 0.83; and the measure, MedisGroups, had the highest for pneumonia, 0.85 and stroke, 0.87. Different severity measures predicted different probabilities of death for many patients. Severity measures frequently disagreed about which hospitals had particularly low or high z scores. Agreement in identifying low- and high-mortality hospitals between severity-adjusted and unadjusted death rates was often better than agreement between severity measures.

Conclusions.
—Severity does not explain differences in death rates across hospitals. Different severity measures frequently produce different impressions about relative hospital performance. Severity-adjusted mortality rates alone are unlikely to isolate quality differences across hospitals.

Author Affiliations
From the Department of Medicine, Division of General Medicine and Primary Care, the Charles A. Dana Research Institute, and the Harvard-Thorndike Laboratory, Harvard Medical School, and Beth Israel Deaconess Medical Center, Boston, Mass.

Footnotes
Reprints: Lisa I. lezzoni, MD, MSc, Division of General Medicine and Primary Care, Department of Medicine, Beth Israel Deaconess Medical Center, 330 Brookline Ave, East Campus LY-326, Boston, MA 02215.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

RELATED LETTER

Risk Adjustment, Quality Assessment, and Process of Care
David M. Klubert, Colt Courtright, Edwin D. Huff, and Lisa I. Iezzoni
JAMA. 1998;279(12):910-911.
EXTRACT | FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Looking Forward, Looking Back: Assessing Variations in Hospital Resource Use and Outcomes for Elderly Patients With Heart Failure
Ong et al.
Circ Cardiovasc Qual Outcomes 2009;2:548-557.
ABSTRACT | FULL TEXT  

Psychiatric Comorbidity and Mortality After Acute Myocardial Infarction
Abrams et al.
Circ Cardiovasc Qual Outcomes 2009;2:213-220.
ABSTRACT | FULL TEXT  

Characteristics and Outcomes of America's Lowest-Performing Hospitals: An Analysis of Acute Myocardial Infarction Hospital Care in the United States
Popescu et al.
Circ Cardiovasc Qual Outcomes 2009;2:221-227.
ABSTRACT | FULL TEXT  

Expert Consensus vs Empirical Estimation of Injury Severity: Effect on Quality Measurement in Trauma
Glance et al.
Arch Surg 2009;144:326-332.
ABSTRACT | FULL TEXT  

Measuring the quality of hospital care
Wright and Shojania
BMJ 2009;338:b569-b569.
FULL TEXT  

Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals
Mohammed et al.
BMJ 2009;338:b780-b780.
ABSTRACT | FULL TEXT  

Choosing The Best Hospital: The Limitations Of Public Quality Reporting
Rothberg et al.
Health Aff (Millwood) 2008;27:1680-1687.
ABSTRACT | FULL TEXT  

Hospital mortality: when failure is not a good measure of success
Shojania and Forster
CMAJ 2008;179:153-157.
FULL TEXT  

Risk Stratification and Comorbidity
Ferraris et al.
Card Surg Adult 2008;3:199-246.
FULL TEXT  

Case-mix adjustment in non-randomised observational evaluations: the constant risk fallacy
Nicholl
J. Epidemiol. Community Health 2007;61:1010-1013.
ABSTRACT | FULL TEXT  

Comparison of Clinical and Administrative Data Sources for Hospital Coronary Artery Bypass Graft Surgery Report Cards
Shahian et al.
Circulation 2007;115:1518-1527.
ABSTRACT | FULL TEXT  

Patient characteristics and hospital quality for colorectal cancer surgery
Zhang et al.
Int J Qual Health Care 2007;19:11-20.
ABSTRACT | FULL TEXT  

Risk-adjusted morbidity and mortality models to compare the performance of two units after major lung resections
Brunelli et al.
J. Thorac. Cardiovasc. Surg. 2007;133:88-96.
ABSTRACT | FULL TEXT  

Transferring Critically Ill Patients Out of Hospital Improves the Standardized Mortality Ratio: A Simulation Study
Kahn et al.
Chest 2007;131:68-75.
ABSTRACT | FULL TEXT  

Adverse outcomes in Belgian acute hospitals: retrospective analysis of the national hospital discharge dataset
Van den Heede et al.
Int J Qual Health Care 2006;18:211-219.
ABSTRACT | FULL TEXT  

The predictive accuracy of the new york state coronary artery bypass surgery report-card system.
Jha and Epstein
Health Aff (Millwood) 2006;25:844-855.
ABSTRACT | FULL TEXT  

Development of Pediatric Comorbidity Prediction Model
Tai et al.
Arch Pediatr Adolesc Med 2006;160:293-299.
ABSTRACT | FULL TEXT  

Standards for Statistical Models Used for Public Reporting of Health Outcomes: An American Heart Association Scientific Statement From the Quality of Care and Outcomes Research Interdisciplinary Writing Group: Cosponsored by the Council on Epidemiology and Prevention and the Stroke Council Endorsed by the American College of Cardiology Foundation
Krumholz et al.
Circulation 2006;113:456-462.
ABSTRACT | FULL TEXT  

The Italian CABG Outcome Study: short-term outcomes in patients with coronary artery bypass graft surgery
Seccareccia et al.
Eur. J. Cardiothorac. Surg. 2006;29:56-62.
ABSTRACT | FULL TEXT  

The Big Chill: The Deleterious Effects of Public Reporting on Access to Health Care for the Sickest Patients
Turi
J Am Coll Cardiol 2005;45:1766-1768.
FULL TEXT  

Does reporting of coronary artery bypass grafting from administrative databases accurately reflect actual clinical outcomes?
Mack et al.
J. Thorac. Cardiovasc. Surg. 2005;129:1309-1317.
ABSTRACT | FULL TEXT  

Improving the ICU: Part 1
Garland
Chest 2005;127:2151-2164.
ABSTRACT | FULL TEXT  

Daily Assessment of Organ Dysfunction and Survival in Intensive Care Unit Cardiac Surgical Patients
Hekmat et al.
Ann. Thorac. Surg. 2005;79:1555-1562.
ABSTRACT | FULL TEXT  

On the use of administrative databases to support planning activities: a comment
Aelvoet
Eur J Public Health 2005;15:215-215.
FULL TEXT  

The Influence of Public Reporting of Outcome Data on Medical Decision Making by Physicians
Narins et al.
Arch Intern Med 2005;165:83-87.
ABSTRACT | FULL TEXT  

Cardiac Surgery Risk Models: A Position Article
Shahian et al.
Ann. Thorac. Surg. 2004;78:1868-1877.
ABSTRACT | FULL TEXT  

The legacy of Bristol: public disclosure of individual surgeons' results
Keogh et al.
BMJ 2004;329:450-454.
FULL TEXT  

The RACHS-1 risk categories reflect mortality and length of hospital stay in a large German pediatric cardiac surgery population
Boethig et al.
Eur. J. Cardiothorac. Surg. 2004;26:12-17.
ABSTRACT | FULL TEXT  

Prognostic Importance of Comorbidity in a Hospital-Based Cancer Registry
Piccirillo et al.
JAMA 2004;291:2441-2447.
ABSTRACT | FULL TEXT  

How to make a silk purse from a sow's ear--a comprehensive review of strategies to optimise data for corrupt managers and incompetent clinicians
Pitches et al.
BMJ 2003;327:1436-1439.
FULL TEXT  

Defining and classifying clinical indicators for quality improvement
Mainz
Int J Qual Health Care 2003;15:523-530.
ABSTRACT | FULL TEXT  

Children With Special Health Care Needs Enrolled in the State Children's Health Insurance Program (SCHIP): Patient Characteristics and Health Care Needs
Szilagyi et al.
Pediatrics 2003;112:e508-520.
ABSTRACT | FULL TEXT  

The Quality of Medical Care Provided to Vulnerable Community-Dwelling Older Patients
Wenger et al.
ANN INTERN MED 2003;139:740-747.
ABSTRACT | FULL TEXT  

Using Clinical Outcomes to Identify Expert Physical Therapists
Resnik and Hart
ptjournal 2003;83:990-1002.
ABSTRACT | FULL TEXT  

Do hospitals with low mortality rates in coronary artery bypass also perform well in valve replacement?
Goodney et al.
Ann. Thorac. Surg. 2003;76:1131-1137.
ABSTRACT | FULL TEXT  

Length of Stay for Common Pediatric Conditions: Teaching Versus Nonteaching Hospitals
Srivastava and Homer
Pediatrics 2003;112:278-281.
ABSTRACT | FULL TEXT  

Accepting Critically Ill Transfer Patients: Adverse Effect on a Referral Center's Outcome and Benchmark Measures
Rosenberg et al.
ANN INTERN MED 2003;138:882-890.
ABSTRACT | FULL TEXT  

Using routine comparative data to assess the quality of health care: understanding and avoiding common pitfalls
Powell et al.
Qual Saf Health Care 2003;12:122-128.
ABSTRACT | FULL TEXT  

Should Volume Standards for Cardiovascular Surgery Focus Only on High-Risk Patients?
Goodney et al.
Circulation 2003;107:384-387.
ABSTRACT | FULL TEXT  

Epidemiology and Outcomes of Ventilator-Associated Pneumonia in a Large US Database
Rello et al.
Chest 2002;122:2115-2121.
ABSTRACT | FULL TEXT  

Impact of Modifying Risk Adjustment Models on Rankings of Access to Care in the VA Mental Health Report Card
Weissman et al.
Psychiatr. Serv. 2002;53:1153-1158.
ABSTRACT | FULL TEXT  

Outcomes of and Resource Consumption by High-Cost Patients in the Intensive Care Unit
Welton et al.
Am J Crit Care 2002;11:467-473.
ABSTRACT | FULL TEXT  

Measuring Health Care Quality: Comparing and Contrasting the Medical and the Marketing Approaches
Bowers and Kiefe
American Journal of Medical Quality 2002;17:136-144.
ABSTRACT  

Health Care Report Cards: Implications for Vulnerable Patient Groups and the Organizations Providing Them Care
Davies et al.
Journal of Health Politics, Policy and Law 2002;27:379-400.
ABSTRACT  

Lack of Relationship Between the Cleveland Health Quality Choice Project and Decreased Inpatient Mortality in Cleveland
Clough et al.
American Journal of Medical Quality 2002;17:47-55.
ABSTRACT  

Benchmarking in Critical Care : The Road Ahead
Glance and Szalados
Chest 2002;121:326-328.
FULL TEXT  

Cardiac surgery report cards: comprehensive review and statistical critique
Shahian et al.
Ann. Thorac. Surg. 2001;72:2155-2168.
ABSTRACT | FULL TEXT  

Relationship of hospital size, case volume, and cost for coronary artery bypass surgery: Analysis of 12,774 patients operated on in Massachusetts during fiscal years 1995 and 1996
Shahian et al.
J. Thorac. Cardiovasc. Surg. 2001;122:53-64.
ABSTRACT | FULL TEXT  

Public release of performance data and quality improvement: internal responses to external data by US health care providers
Davies
Qual Saf Health Care 2001;10:104-110.
ABSTRACT | FULL TEXT  

Challenges in comparing risk-adjusted bypass surgery mortality results: Results from the Cooperative Cardiovascular Project
Peterson et al.
J Am Coll Cardiol 2000;36:2174-2184.
ABSTRACT | FULL TEXT  

Results of Report Cards for Patients with Congestive Heart Failure Depend on the Method Used To Adjust for Severity
Poses et al.
ANN INTERN MED 2000;133:10-20.
ABSTRACT | FULL TEXT  

The Public Release of Performance Data: What Do We Expect to Gain? A Review of the Evidence
Marshall et al.
JAMA 2000;283:1866-1874.
ABSTRACT | FULL TEXT  

Risk stratification in heart surgery: comparison of six score systems
Geissler et al.
Eur. J. Cardiothorac. Surg. 2000;17:400-406.
ABSTRACT | FULL TEXT  

Public disclosure of performance data: learning from the US experience
Marshall et al.
Qual Saf Health Care 2000;9:53-57.
FULL TEXT  

Mental Disorders and Use of Cardiovascular Procedures After Myocardial Infarction
Druss et al.
JAMA 2000;283:506-511.
ABSTRACT | FULL TEXT  

ANGIOGRAPHIC QUANTIFICATION OF DIFFUSE CORONARY ARTERY DISEASE: RELIABILITY AND PROGNOSTIC VALUE FOR BYPASS OPERATIONS
Graham et al.
J. Thorac. Cardiovasc. Surg. 1999;118:618-627.
ABSTRACT | FULL TEXT  

Enhancing Performance Measurement: NCQA's Road Map for a Health Information Framework
Schneider et al.
JAMA 1999;282:1184-1190.
ABSTRACT | FULL TEXT  

Patient Satisfaction and Administrative Measures as Indicators of the Quality of Mental Health Care
Druss et al.
Psychiatr. Serv. 1999;50:1053-1058.
ABSTRACT | FULL TEXT  

Outcomes Research in Critical Care . Results of the American Thoracic Society Critical Care Assembly Workshop on Outcomes Research
RUBENFELD et al.
Am. J. Respir. Crit. Care Med. 1999;160:358-367.
FULL TEXT  

Comparing AMI Mortality Among Hospitals in Patients 65 Years of Age and Older : Evaluating Methods of Risk Adjustment
Krumholz et al.
Circulation 1999;99:2986-2992.
ABSTRACT | FULL TEXT  

Explaining differences in English hospital death rates using routinely collected data
Jarman et al.
BMJ 1999;318:1515-1520.
ABSTRACT | FULL TEXT  

Health and Economic Outcomes of Antibiotic Resistance in Pseudomonas aeruginosa
Carmeli et al.
Arch Intern Med 1999;159:1127-1132.
ABSTRACT | FULL TEXT  

Research Evidence on the Validity of Risk-Adjusted Mortality Rate as a Measure of Hospital Quality of Care
Thomas and Hofer
Med Care Res Rev 1998;55:371-404.
ABSTRACT  

Atrial Fibrillation: Mortality, Stroke, and Medical Costs
Gross et al.
Arch Intern Med 1998;158:2265-2266.
FULL TEXT  

Risk Adjustment, Quality Assessment, and Process of Care
Klubert et al.
JAMA 1998;279:910-911.
FULL TEXT