You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT JAMA
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 302 No. 21, December 2, 2009 TABLE OF CONTENTS
  JAMA
  •  Online Features
  Clinical Crossroads: Conferences With Patients and Doctors
 This Article
 •Abstract
 •PDF
 •eTable
 •CME Course for This Article
 • Submit Response to Patient's Crossroads
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Contact me when this article is cited
 Related Content
 •Similar articles in JAMA
 Topic Collections
 •Patient-Physician Relationship/ Care
 •Patient-Physician Communication
 •Patient Education/ Health Literacy
 •Patient-Physician Relationship, Other
 •Cardiovascular System
 •Quality of Care
 •Quality of Care, Other
 •Cardiovascular Disease/ Myocardial Infarction
 •Alert me on articles by topic
 Social Bookmarking
  Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit Add to Technorati Add to Twitter What's this?

CLINICIAN'S CORNER
A 37-Year-Old Man Trying to Choose a High-Quality Hospital

Review of Hospital Quality Indicators

Michael D. Howell, MD, MPH, Discussant

JAMA. 2009;302(21):2353-2360.

ABSTRACT

Mr A, a previously healthy 37-year-old man, was diagnosed as having Prinzmetal angina and a hypercoagulable state 3 years ago after an ST-elevation myocardial infarction. Now, his cardiologist is moving and Mr A must select a new physician and health system. Geographic relocation, insurance changes, and other events force millions in the United States to change physicians and hospitals every year. Mr A should begin by choosing a primary care physician, since continuity and coordination of care improves outcomes. Evidence for evaluating specific physicians is less robust, though a variety of sources are available. A broad range of detailed quality information, such as Medicare's Hospital Compare (http://www.hospitalcompare.hhs.gov/), is available for selecting a hospital. However, the relationship of these metrics to patient outcomes is variable, and different Web sites provide meaningfully different rankings and data interpretations. For Mr A in particular, a warfarin management team, the hospital's location, and a cardiologist with whom he feels comfortable and who can communicate with his primary care physician are important factors. Nevertheless, hospital quality information and metrics are an important component of the strategy Mr A should take to solve this challenging problem.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Mr a: his view
 •At the crossroads: questions...
 •Recommendations for mr a
 •Questions and discussion
 •Author information
 •References

DR REYNOLDS: Mr A is a 37-year-old executive who is looking for a new physician and health care system.

In November 2006, Mr A awakened with dull chest heaviness; after about 90 minutes, he called 911 and was brought to a local hospital, where he was diagnosed as having a myocardial infarction by electrocardiogram and enzyme measurement. Emergency cardiac catheterization revealed normal coronary arteries. Twenty-four hours later, he again experienced chest discomfort. Catheterization again showed normal coronary arteries.

Hematologic consultation revealed a slightly elevated dilute Russell viper venom time (dRVVT) test result on 2 occasions. Mr A's hematologist interpreted these results as suggestive of the presence of lupus anticoagulant and suggested anticoagulation with warfarin and, later, retesting of dRVVT values, with consideration of discontinuation of the warfarin if the levels decreased to normal.

Mr A therefore carries diagnoses of Prinzmetal angina and hypercoagulable state.

After discharge, Mr A initially followed up with the cardiologist who cared for him during his inpatient stay at the local hospital. However, Mr A ultimately decided to transfer his care to a larger center a longer distance away, seeking a cardiologist who would provide care with attention to the etiology of his myocardial infarction and who practiced in a "less chaotic" environment. He appreciated his new cardiologist's attention to his medication adverse effects and the system of care that included reminders about getting his international normalized ratio (INR) measured.

In the spring of 2009, Mr A's new cardiologist decided to leave the area and Mr A again found himself looking for the right physician and hospital for his health care.

Mr A's current medications include extended-release diltiazem, 180 mg/d; aspirin, 81 mg/d; nasal steroid spray; and warfarin, adjusted to an INR of 2 to 3.

Mr A lives with his wife and 2 children, 1 of whom has a congenital heart defect; he works and has commercial medical insurance. He does not smoke tobacco or use drugs; his alcohol use is limited.

On physical examination, he was normotensive with a normal cardiovascular examination; an electrocardiogram showed nonspecific ST-T wave changes and stress test results were normal aside from a left ventricular ejection fraction of 47%.


MR A: HIS VIEW
 Jump to Section
 •Top
 •Introduction
 •Mr a: his view
 •At the crossroads: questions...
 •Recommendations for mr a
 •Questions and discussion
 •Author information
 •References

I was a mid-30-year-old who had standard problems. I had a general practitioner that I would go to for an every-5-year physical and various illnesses I would have.

All that changed when I unexpectedly had the heart attack, and at that time I had no cardiologist or anything. Obviously, I called 911 and went to the hospital that they took me to. A cardiologist on staff there was assigned to me.

The cardiologist I’m seeing now has transferred hospitals. As a result, I may technically be, at the moment, without an assigned cardiologist. So I am now at a point where I need to evaluate what it is I’m looking for in a doctor.

First, I have an interest in finding a hospital of a high caliber but that is also close enough that I could be transported there. [One] of the things that I really appreciated [from my cardiologist's practice was] a registered nurse who was under the cardiologist I was seeing was extraordinarily good about following up to remind me to get my PT [prothrombin] and INR scores. . . . I could easily go 3 or 4 months without realizing I had to take this test. So having her chase me down, just send me an e-mail once in a while, was fantastic.

I do have a primary care physician and I do like him. I’m also looking for a practitioner who is going to dive in a little more than the surface of the studies and try to really understand. But I will admit that I don't have a way to find out who that is other than trying different cardiologists over the years.

If I had to choose whether it was more important to find the right cardiologist or the right hospital, I think my first priority would be finding the right cardiologist because of the unusual nature of my case. But, even as I answer that question, I’m questioning it because hopefully the cardiologists go back and discuss with the whole department and bounce ideas off each other. So a strong department—as well as having strong nursing staff to support them, to follow up with me—would also be important.

In order to make my decision, I have talked to some friends who are doctors and who have some knowledge at this level. I’ve also looked on the Web but, unfortunately, what you wind up finding is the US News & World Report that ranks the top 100 cardiac hospitals, which only has some value. The reports are very superficial and they don't get to the questions I was asking.

The reason I have shrugged off the US News & World Report and other large distribution magazine "top-whatever" lists is that the methodology used is based on how much time the facility is willing to invest in filling out the form and returning it. The reports are also biased toward measurements such as success—number of deaths per admitted patient–type statistics. An excellent hospital may take on much tougher cases, but as a result they are going to have a higher death rate, and that isn't an adequate measurement of quality.

The other thing I do is actually Google some of the doctors' names and see what I can find about them and read their bios that they put up on hospital Web sites. But half of the profiles don't even exist or are empty templates. Others haven't been updated in a decade.

I’m such an unusual case that I often wonder: Do the general findings overall—since most people are going to go in with clogged arteries from lifestyle choices—do those outcomes impact me?

I would be very interested in how to improve this process of looking for a doctor. Getting information and evaluating it is tough. I want to know what the trends in health care quality are and I want to know what information patients can use.


AT THE CROSSROADS: QUESTIONS FOR DR HOWELL
 Jump to Section
 •Top
 •Introduction
 •Mr a: his view
 •At the crossroads: questions...
 •Recommendations for mr a
 •Questions and discussion
 •Author information
 •References

How many individuals in the United States change care among health systems, hospitals, and/or clinicians each year and why? Should a patient choose a primary care physician, a specialist, or a health system? How can consumers/patients learn about the quality of care provided by hospitals, health systems, and physicians? How reliable and accurate is the public information and does it actually measure quality of care? What do you recommend for Mr A?

DR HOWELL: Mr A has a demanding road ahead. With 2 complex medical conditions, through no fault of his own he now finds himself bereft of the physician whom he identifies as primarily managing his care. Nearly all of us, at one time or another, have faced the challenge of finding a new health care system and a new physician, either for ourselves or for a close family member. Even for those of us whose careers lie within health care, it is not an easy task.

Incidence: How Common Is This Problem?

Tens of millions of individuals in the United States change health care plans, hospitals, and/or clinicians every year. Millions are forced to do so because of geographic relocation or loss of employment. About 38.6 million people move annually; of these, about 12.3 million move to a different county and about 1.2 million arrive from outside the United States.1 So, about 14.5 million Americans are likely to change hospitals and physicians every year for this reason alone. Job loss also often brings with it a loss or at least a change of insurance. Since the current recession began in December 2007, the number of unemployed individuals has increased by more than 7 million.2 More than half of those who are unemployed are also without insurance. Another quarter rely on public coverage.3

However, Mr A neither moved nor lost his insurance. Every year, millions of people with stable geography and employment also find themselves in this situation. The Community Tracking Study, a series of surveys of more than 37 000 nonelderly US residents, found that 13% of persons with private insurance changed their usual source of care during a single year. Even among those with stable health plans (like Mr A), 11% changed their usual source of care during the year.4 In a follow-up study 2 years later, the rate of switching was stable at 13%.5 Other large studies have found similar results. More than 14% of California's population had discontinuity in insurance status during 2003,6 and federal employees switch health plans at a rate of 12% per year.7

Conceptual Framework

Quality of Health Care. It is important to understand what Mr A means when he says he is seeking a high-quality hospital and also to recognize that a single, unifying measure of health care quality may not exist. Donabedian's 1966 approach to understanding the quality of medical care8 sounds an important note of caution for Mr A today:

The assessment of quality must rest on a conceptual and operationalized definition of what the "quality of medical care" means. Many problems are present at this fundamental level, for the quality of care is a remarkably difficult notion to define.

Klein et al,9 5 years earlier, had been still more forceful:

We found that a single, comprehensive way of measuring patient care was impossible. . . . In other words, it seems quite likely that there will never be a single comprehensive criterion by which to measure quality of patient care.

Although these concepts continue to confound answers to Mr A's questions, Donabedian defined 3 approaches to measuring quality that remain relevant today: structure, process, and outcome. Applied to Mr A's myocardial infarction, his hospital had structural elements required for high-quality modern cardiac care (eg, having a cardiac catheterization laboratory), they met process criteria for high-quality ST-elevation myocardial infarction care (eg, rapid cardiac catheterization), and the outcome was favorable (he is still able to live an active life). Most publicly available quality data can be thought of in 1 of these 3 categories.

Individuals Embedded in Systems. A major challenge in providing practical information that quantifies quality of care arises because physicians operate embedded in health care systems at many different levels. An individual physician may be part of a group practice, multiple hospitals, and several health plans simultaneously. These organizations, in turn, are embedded in regional and national health care systems. More than 50 years ago, Coleman et al10 showed that these networks are important: physicians' adoption of a new therapy was strongly influenced by their connections to and integration with other physicians. Physicians' practice is also meaningfully influenced by their practice organization,11 health plan,12 hospital,13 region,14 and country.15 So, the practice environment modulates both process and outcome of care provided by individual physicians, and Mr A will have to pay attention to both during his selection process.

Should a Patient Start by Choosing a Primary Care Physician, a Specialist, or a Health Care System?

Mr A should start by choosing a primary care physician embedded in a hospital or health system with markers of high quality. Care by a primary care physician is important in ongoing care, since Mr A is more than the sum of Prinzmetal angina and a (possible) hypercoagulable state. Epidemiologic evidence links higher rates of primary care with better outcomes. Shi16 found that as the number of primary care physicians in a state increased, cardiovascular and cancer death rates decreased and life expectancy improved. A systematic review found that for every additional primary care physician per 10 000 population, mortality rates decreased by an average of 49 per 100 000.17 Other studies have found concordant results for the relationship between primary care physician supply and reductions in breast,18 cervical,19 and colorectal cancer–related20 mortality.

Why might this association exist? Primary care is extraordinarily complex. Providing recommended preventive care for an average primary care physician's panel may require more than 7 hours every day.21 Primary care physicians coordinate a broad array of care; the average primary care physician for Medicare patients works with 229 other physicians in 117 other practices.22 Although specialists are often the usual source of care for many patients,23 they may provide less reliable preventive care than generalists.23-24 Finally, stability of care is associated with improved health outcomes. In a randomized trial of continuity of care, patients randomized to the higher-continuity group had fewer emergent admissions, shorter lengths of stay, and higher satisfaction than those with less continuity among outpatient general medicine physicians.25 A later systematic review found that sustained continuity of care was associated with improved patient satisfaction, fewer hospitalizations and emergency department visits, and better preventive care.26 This is far from saying that Mr A should receive only primary care. Rather, the weight of evidence suggests that for specific diseases and conditions, including cardiac disease,27-28 patients receive better care from specialists operating in their domain of expertise rather than solely from generalists. Mr A should therefore seek coordinated care between his specialists and primary care physician.

How Can Patients Learn About Individual Physicians' Quality of Care?

Unfortunately, Mr A will find little evidence-based guidance to help him choose an individual physician. In general, currently available performance measures do not provide the kind of reliable comparisons among physicians that Mr A might want. On the other hand, he can easily find out whether his physician is board certified from the American Board of Medical Specialties (eTable, a). Although studies are heterogeneous,29 quality of care and patient outcomes are associated with physicians' board certification, licensing test results, and certification scores.30-31 Mr A can also check his physicians' licensure status, public disciplinary history, and sometimes other factors by querying his state medical board (at individual state Web sites or aggregated by Administrators in Medicine eTable, b).

In certain locales, Mr A can also review practice-level quality measures. The Agency for Healthcare Research and Quality (AHRQ) maintains a compendium of physician-, health plan–, and practice-level scorecards (eTable, c). As of this writing, the compendium includes 209 report cards, of which 35 provide physician- or practice-level information. For example, in Massachusetts, patients can review practice-level information about colorectal cancer screening, diabetes treatment, and other conditions (eTable, p). However, as Mr A himself points out, few of these measures apply to a 37-year-old man with his medical issues. Several other barriers limit these measures' usefulness. First, physicians' practices are embedded in multiple other layers of the health care system, making physician-specific effects hard to tease out and requiring complex statistical analysis.32 Second, validated quality measures do not exist for all specialties.33 Third, patient sample size may be insufficient to identify high- or low-performing physicians, particularly for small practices and for physicians who see a broad range of diagnoses, such as primary care physicians.33-34 In one study, individual physician profiling for diabetes could not distinguish quality from random variation even with complex case-mix adjustment.35 Others have found that physician panel sizes are often too small to support comparative benchmarking.36 Finally, for patients like Mr A with complex, uncommon diseases, the most important attribute of a physician may in fact be diagnostic reasoning and critical thinking. These complex sets of skills are challenging to practice, teach, and measure37-38; they are not well-captured in most existing quality metrics. These limitations may contribute to the fact that most internists believe that current quality measures are inaccurate and inadequately adjusted for patients' characteristics.39 Some physician-level efforts have focused on higher-volume procedures such as coronary artery bypass graft surgery and percutaneous coronary intervention (eTable, m, n, and o). These may be useful to Mr A depending on which state he lives in. Although hotly debated32, 40 and potentially complex to interpret, these reports do provide patients with operator-specific, risk-adjusted mortality outcomes. Finally, patients can post qualitative reviews of their experiences with clinicians,41 although no trials to date assess the relationship of these ratings to outcomes.

How Can Patients Learn About Quality of Care at Specific Hospitals and Health Systems?

A number of sources provide information on hospitals' quality of care. AHRQ's compendium includes 78 health care report cards with hospital information as of this writing (eTable, c). Although most people, like Mr A, would prefer a single, simple quality measure for a hospital (like those often given to consumer purchases, wines, etc), a hospital's quality may vary depending on what care is required. Evaluating quality data differs for a specific procedure vs future general care.

Overall Evaluations of Hospital Quality. Several sources can help Mr A evaluate overall hospital quality. These rely on surveys, analyses of administrative data, or a combination of the 2. The best known, which Mr A himself mentions, is US News & World Report's "America's Best Hospitals."42 This annual report aims to "help direct patients to centers that excel in the most difficult cases," not to identify hospitals that provide the best routine care.43 It integrates structural factors (such as membership in the Council of Teaching Hospitals) with a physician survey (assessing hospitals' reputations) and additional measures derived from sources such as the American Hospital Association Annual Survey and Medicare Provider Analysis and Review (MedPAR). The rankings are associated with clinical outcomes. In a large study of patients with acute myocardial infarction, admission to a top-ranked hospital was associated with a lower mortality rate compared with unranked hospitals. This appeared to be mediated by more reliable processes of care.44 However, although the average top-ranked hospital performs better than the average non–top-ranked hospital, there is considerable overlap. A study assessing top-ranked hospitals' process of care for acute myocardial infarction found that 31% scored below the average hospital in a group of 774 hospitals. Conversely, more than 40% of nonranked hospitals had better performance than the average top-ranked hospital in a cardiovascular composite measure.45 Another study found that top-ranked hospitals had lower average risk-adjusted mortality rates after acute myocardial infarction but again found substantial overlap with unranked hospitals.46 Another well-known "top hospital" list is published by the commercial service HealthGrades.47 Ratings are based on MedPAR data. Similar to the US News rankings, HealthGrades' top-performing 5-star hospitals performed, on average, significantly better than 1-star hospitals for patients with acute myocardial infarction, but more than 90% of 1-star hospitals had a risk-adjusted mortality rate that was not statistically different from that of a 5-star hospital.48 Thomson Reuters' 100 Top Hospitals uses MedPAR, the Medicare Cost Report, and other data to provide a composite ranking that attempts to balance risk-adjusted survival, complications, satisfaction, and financial performance.49 When compared with nonranked hospitals, highly ranked hospitals had lower resource utilization but similar clinical outcomes.44

Patient satisfaction and the experience of care is also a key dimension of quality health care.50 Medicare's Hospital Consumer Assessment of Health Providers and Systems (HCAHPS) assesses communication with physicians and nurses as well as several other factors (eTable, d). Higher HCAHPS results are associated with better quality of care for acute myocardial infarction, congestive heart failure, pneumonia, and surgery.51 Finally, many online services enable patients to rate and review their hospitals and clinicians.41

What If Mr A Wants More Details? Mr A may also be interested in services that do not attempt to roll up hospital quality into a single measure. Four free sites supplying this kind of information are The Joint Commission's Quality Check (eTable, e), the Leapfrog Group (eTable, f), UCompareHealthCare (eTable, g), and the Centers for Medicare & Medicaid Services' (CMS’) Hospital Compare (eTable, d). The Joint Commission's Quality Check provides information about hospital accreditation and several process-of-care measures. On average, accredited hospitals and those with better process measures have better outcomes for cardiovascular care, though the magnitude of association may be small.52-53 The Leapfrog Group, a consortium of employers and purchasers, surveys the practices of more than 1200 hospitals annually.54 Leapfrog provides a selection of structure, process, and outcome measures accessible to patients. However, studies of the validity of Leapfrog measures have been mixed. Hospitals that implemented Leapfrog-recommended practices generally have better processes of care and better outcomes,55 but the Safe Practices Survey component of Leapfrog was not associated with risk-adjusted mortality.56 UCompareHealthCare aggregates process and outcome measures from several sources and provides some risk adjustment.57 While aggregation is promising, I found no external studies of the validity of this site, and a review of my own hospital found important differences between services that we offer (eg, computed tomography scanning) and those reported on the site. Finally, CMS’ Hospital Compare presents hospital-level process measures for a number of diseases, outcome measures for 3 conditions, and patient satisfaction information. Better performance on these measures is associated with a small but significant reduction in risk-adjusted mortality.58

Specific Procedures and Conditions: The Volume-Outcome Hypothesis and Condition-Specific Reports. In general, if Mr A needs care for a specific condition or procedure, he should seek a hospital with substantial experience with that condition. Most data suggest that hospitals with higher volumes have better outcomes for specific procedures and conditions, including some surgeries,59-60 pulmonary embolism,61 respiratory failure,62 some medical intensive care unit admissions,63 correct emergent diagnosis of acute myocardial infarction,64 and mammography.65 Particularly relevant to Mr A, hospitals with high-volume invasive cardiac catheterization procedures appear to have better outcomes.66 There are a few important caveats to this: volume-outcome relationships have not been documented for all procedures,67 these relationships may change over time as quality improvement programs are implemented,68-69 the magnitude of effect is sometimes quite small,70 and the etiology of the relationship is not fully understood.71

Mr A may want to check volume data available online. Leapfrog reports the annual volume of several procedures for each hospital, along with Leapfrog-determined benchmark volumes (eTable, f). Medicare also provides publicly available procedural volume data for Medicare patients (eTable, d). Mr A's state may also provide data. For example, Massachusetts publishes some hospital- and surgeon-specific procedural volumes (eTable, h) and New York publishes hospital-level volume statistics (eTable, i).

Mr A also has access to hospital-specific, risk-adjusted outcome data for a few conditions and procedures. CMS reports hospitals' risk-adjusted mortality rates for patients with acute myocardial infarction, heart failure, and pneumonia compared with the national average (eTable, d). Leapfrog also provides ranked survival predictions for pancreatic resection and esophageal resection72 and incorporates risk-adjusted mortality rates into their ratings for several cardiac procedures. Some states provide hospital-specific, risk-adjusted mortality rates for several procedures and conditions (eTable, j, k, and l). Other states publish hospital-specific, risk-adjusted mortality rates for coronary artery bypass graft surgery and percutaneous coronary intervention (eTable, m, n, and o). Importantly, risk adjustment has inherent limitations,73 and evaluating whether hospitals are outliers is statistically complex.32, 40

Comparing the Approaches. Mr A might ask, "Do these sites all give me the same answer?" Unfortunately, even for common surgical procedures, different sites may provide different ordinal rankings for the same hospitals.74 A recent comparison of several sites found that, even for similar-sized hospitals in a single metropolitan area, these sites provided inconsistent and often conflicting rankings.75


RECOMMENDATIONS FOR MR A
 Jump to Section
 •Top
 •Introduction
 •Mr a: his view
 •At the crossroads: questions...
 •Recommendations for mr a
 •Questions and discussion
 •Author information
 •References

It is frustrating to be unable to provide better evidence-based guidance to Mr A. Nonetheless, decisions have to be made, even under conditions of uncertainty, and not making a decision is its own decision.76 First, I would advise Mr A to become familiar with a consumers' guide to approaching the uncertainties and complexities of the health care system, such as those by AHRQ (eTable, q) or the nonprofit Consumers Union (eTable, r). Second, he should discuss specialist and hospital selection with his primary care physician, with a particular focus on those that are geographically convenient, since this is important to him. At a minimum, he should assess whether his physicians are board-certified and he should review state medical board information, including licensure status and public disciplinary history (eTable, b). He should assess quality measures for the potential hospitals where his future cardiologist might work, seeking hospitals with consistently higher, broad-based quality ratings. Because there are no quality metrics for Mr A's specific combination of issues, he will need to do some additional detective work. The best surrogate measure that he is likely to find—unvalidated though it may be—is volume, and he should feel comfortable asking potential cardiologists, hematologists, and hospitals for an approximation of how many cases of each condition they see per year. He should prepare for the visits, preferably bringing copies of prior records and tests (eTable, q and r). Mr A would like e-mail reminders to help him monitor his warfarin and related laboratory tests; he should discuss these practice-level requirements early on, either over the phone when making appointments or at his first visit. In particular, warfarin is a high-risk medication, and systems with dedicated anticoagulation management programs may have superior outcomes.77 Finally, after he meets his physicians, he should assess his comfort with the encounter. If things went well, he should let his physicians know what works for him, so that future encounters will proceed smoothly. If he is not satisfied, he should discuss his expectations with his physicians so that there is an opportunity to improve. If things do not work out, he might need to seek other physicians.


QUESTIONS AND DISCUSSION
 Jump to Section
 •Top
 •Introduction
 •Mr a: his view
 •At the crossroads: questions...
 •Recommendations for mr a
 •Questions and discussion
 •Author information
 •References

QUESTION: Isn't it the greatest failure of social justice and self-regulation for us to assume that patients should have to shop for high-quality medical care, knowing that the most vulnerable members of our society will be least able to succeed in applying this market-based approach?

DR HOWELL: Right now, a national debate rages over whether health care is a right, a privilege, or something in between. This debate won't be settled in time to help Mr A find a new cardiologist. So, I have tried to focus on the practical questions facing Mr A and millions like him: where can they look, right now, for guidance in trying to find high-quality care. Moreover, although social justice is a fundamental principle laid out in the Charter on Medical Professionalism, so are patient welfare and patient autonomy: not only must we physicians work to improve our practice, but "[p]hysicians must be honest with their patients and empower them to make informed decisions about their treatment."78 Providing transparent, accurate, reliable information about the quality and safety of our work seems to align with these principles. Moreover, improved quality can sometimes narrow disparities.79 On the other hand, poorly designed quality reporting and pay-for-performance programs create a terrible risk of further widening already egregious disparities in health care.80-81

QUESTION: I’m a believer in the Leapfrog-style evaluation system, but in my experience, few of our patients either know to pay attention to them or care about them. Do you know how many patients look at quality data now before choosing a physician, and do you see that increasing in the future?

DR HOWELL: Patients actually report great interest in information about quality of care.82 However, experimental evidence suggests that how quality information is presented materially affects whether patients use it or not.83 In addition, consumer awareness of available quality data may be quite limited. For example, 5 years after the inception of a major guide to coronary artery bypass graft surgery, only 1% to 2% of cardiac surgery patients knew their hospital's or surgeon's rating.84 By 2006, only 7% to 10% of Americans were using quality information to select a physician or hospital.85 Not surprisingly, then, the empirical evidence on effectiveness of public reporting is mixed. Two recent systematic reviews concluded that there is limited evidence that the availability of information about quality affects consumers' choice of health care.83, 86 However, the title of an accompanying editorial ("What Can We Say About the Impact of Public Reporting? Inconsistent Execution Yields Variable Results")87 points out the real subtlety in these data. The weight of evidence suggests that public reporting efforts have prompted hospitals to work on improvement and have had moderate effects on consumers' choices of health plans; in other areas, effects have been mixed or null.87 In my own opinion, there are compelling reasons to believe that this is a problem of implementation rather than theory, but the evidence has not yet borne that out.

QUESTION: As a primary care physician, how should I be using quality data to inform my specialist referrals? We are typically encouraged to refer "in network," but should I be looking geographically for the highest-volume, or highest-quality, specialist?

DR HOWELL: Most existing publicly available hospital and physician performance information has been targeted at patients, not physicians. However, in a survey of Medicare patients who had undergone major surgery, a critical factor in selecting a surgeon or hospital was their referring physician's opinion. Patients used this source of information more than twice as often as recommendations by family or friends and 4 times more frequently than mortality data. Moreover, although they believed that performance data were important, in planning for future surgeries 95% wanted their physician to help them understand and interpret this kind of information.88 Furthermore, patients reported that the physician was the main decision maker about whether to undergo surgery 31% of the time and was an equal decision maker in an additional 42% of cases.89 Little interventional research has addressed how the provision of quality data affects primary care physicians' referral behavior. Previous observational studies have not found evidence that primary care physicians systematically incorporate quality data into referral decisions; rather, personal knowledge of the specialist and the quality of prior feedback were identified as the most important factors in selecting a particular specialist.90 Together, these suggest that a promising opportunity may exist to direct quality and performance information toward referring physicians, in addition to patients.


AUTHOR INFORMATION
 Jump to Section
 •Top
 •Introduction
 •Mr a: his view
 •At the crossroads: questions...
 •Recommendations for mr a
 •Questions and discussion
 •Author information
 •References

Corresponding Author: Michael D. Howell, MD, MPH, Silverman Institute for Health Care Quality and Safety, Beth Israel Deaconess Medical Center, 330 Brookline Ave, Boston, MA 02215 (mhowell{at}bidmc.harvard.edu).

Financial Disclosures: Dr Howell reports that he receives grant support from the Robert Wood Johnson Foundation's Advancing the Science of Continuous Quality Improvement and Physician Faculty Scholars Program.

Additional Contributions: We thank the patient for sharing his story and for providing permission to publish it.

This conference took place at the Surgical Grand Rounds at Beth Israel Deaconess Medical Center, Boston, Massachusetts, on March 25, 2009.

Clinical Crossroads at Beth Israel Deaconess Medical Center is produced and edited by Risa B. Burns, MD, series editor; Tom Delbanco, MD, Howard Libman, MD, Eileen E. Reynolds, MD, Amy N. Ship, MD, and Anjala V. Tess, MD.

Author Affiliations: Dr Howell is Director of Critical Care Quality, Silverman Institute for Health Care Quality and Safety, Associate Director of Medical Critical Care, Division of Pulmonary, Critical Care, and Sleep Medicine, Beth Israel Deaconess Medical Center, and Instructor in Medicine, Harvard Medical School, Boston, Massachusetts.


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Mr a: his view
 •At the crossroads: questions...
 •Recommendations for mr a
 •Questions and discussion
 •Author information
 •References

1. US Census Bureau. Detailed tables—geographical mobility: 2006 to 2007. http://www.census.gov/population/www/socdemo/migrate.html. Accessed March 23, 2009.
2. Bureau of Labor Statistics. Employment situation summary: May 2009. http://www.bls.gov/news.release/empsit.nr0.htm. Accessed June 21, 2009.
3. Families USA. Unemployed and Uninsured in America. 2009. http://www.familiesusa.org/assets/pdfs/unemployed-and-uninsured.pdf. Accessed March 23, 2009.
4. Cunningham PJ, Kohn L. Health plan switching: choice or circumstance? Health Aff (Millwood). 2000;19(3):158-164. PUBMED
5. Reed MC. Why people change their health care providers. Data Bull (Cent Stud Health Syst Change). May 2000;(16):1-2. PUBMED
6. Lavarreda SA, Gatchell M, Ponce N, Brown ER, Chia YJ. Switching health insurance and its effects on access to physician services. Med Care. 2008;46(10):1055-1063. FULL TEXT | WEB OF SCIENCE | PUBMED
7. Atherly A, Florence C, Thorpe KE. Health plan switching among members of the Federal Employees Health Benefits Program. Inquiry. 2005;42(3):255-265. WEB OF SCIENCE | PUBMED
8. Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q. 1966;44(3)(suppl):166-206. FULL TEXT | PUBMED
9. Klein MW, Malone MF, Bennis WG, Berkowitz NH. Problems of measuring patient-care in the outpatient department. J Health Hum Behav. 1961;2(2):138-144. FULL TEXT | WEB OF SCIENCE
10. Coleman J, Katz E, Menzel H. The diffusion of an innovation among physicians. Sociometry. 1957;20(4):253-270. FULL TEXT | WEB OF SCIENCE
11. Ketcham JD, Baker LC, MacIsaac D. Physician practice size and variations in treatments and outcomes: evidence from Medicare patients with AMI. Health Aff (Millwood). 2007;26(1):195-205. FREE FULL TEXT
12. Gosden T, Forland F, Kristiansen IS; et al. Capitation, salary, fee-for-service and mixed systems of payment: effects on the behaviour of primary care physicians. Cochrane Database Syst Rev. 2000;(3):CD002215. PUBMED
13. de Jong JD, Westert GP, Lagoe R, Groenewegen PP. Variation in hospital length of stay: do physicians adapt their length of stay decisions to what is usual in the hospital where they work? Health Serv Res. 2006;41(2):374-394. FULL TEXT | WEB OF SCIENCE | PUBMED
14. Stukel TA, Lucas FL, Wennberg DE. Long-term outcomes of regional variations in intensity of invasive vs medical management of Medicare patients with acute myocardial infarction. JAMA. 2005;293(11):1329-1337. FREE FULL TEXT
15. Kellum JA, Uchino S. International differences in the treatment of sepsis: are they justified? JAMA. 2009;301(23):2496-2497. FREE FULL TEXT
16. Shi L. Primary care, specialty care, and life chances. Int J Health Serv. 1994;24(3):431-458. WEB OF SCIENCE | PUBMED
17. Macinko J, Starfield B, Shi L. Quantifying the health benefits of primary care physician supply in the United States. Int J Health Serv. 2007;37(1):111-126. FULL TEXT | WEB OF SCIENCE | PUBMED
18. Gorey KM, Luginaah IN, Holowaty EJ, Fung KY, Hamm C. Associations of physician supplies with breast cancer stage at diagnosis and survival in Ontario, 1988 to 2006. Cancer. 2009;115(15):3563-3570. FULL TEXT | WEB OF SCIENCE | PUBMED
19. Campbell RJ, Ramirez AM, Perez K, Roetzheim RG. Cervical cancer rates and the supply of primary care physicians in Florida. Fam Med. 2003;35(1):60-64. WEB OF SCIENCE | PUBMED
20. Roetzheim RG, Gonzalez EC, Ramirez A, Campbell R, van Durme DJ. Primary care physician supply and colorectal cancer. J Fam Pract. 2001;50(12):1027-1031. WEB OF SCIENCE | PUBMED
21. Yarnall KS, Pollak KI, Ostbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health. 2003;93(4):635-641. FREE FULL TEXT
22. Pham HH, O’Malley AS, Bach PB, Saiontz-Martinez C, Schrag D. Primary care physicians' links to other physicians through Medicare patients: the scope of care coordination. Ann Intern Med. 2009;150(4):236-242. FREE FULL TEXT
23. Rosenblatt RA, Hart LG, Baldwin LM, Chan L, Schneeweiss R. The generalist role of specialty physicians: is there a hidden system of primary care? JAMA. 1998;279(17):1364-1370. FREE FULL TEXT
24. O’Malley AS, Forrest CB, Feng S, Mandelblatt J. Disparities despite coverage: gaps in colorectal cancer screening among Medicare beneficiaries. Arch Intern Med. 2005;165(18):2129-2135. FREE FULL TEXT
25. Wasson JH, Sauvigne AE, Mogielnicki RP; et al. Continuity of outpatient medical care in elderly men: a randomized trial. JAMA. 1984;252(17):2413-2417. FREE FULL TEXT
26. Cabana MD, Jee SH. Does continuity of care improve patient outcomes? J Fam Pract. 2004;53(12):974-980. WEB OF SCIENCE | PUBMED
27. Ezekowitz JA, van Walraven C, McAlister FA, Armstrong PW, Kaul P. Impact of specialist follow-up in outpatients with congestive heart failure. CMAJ. 2005;172(2):189-194. FREE FULL TEXT
28. Reis SE, Holubkov R, Edmundowicz D; et al. Treatment of patients admitted to the hospital with congestive heart failure: specialty-related disparities in practice patterns and outcomes. J Am Coll Cardiol. 1997;30(3):733-738. ABSTRACT
29. Sharp LK, Bashook PG, Lipsky MS, Horowitz SD, Miller SH. Specialty board certification and clinical outcomes: the missing link. Acad Med. 2002;77(6):534-542. WEB OF SCIENCE | PUBMED
30. Holmboe ES, Wang Y, Meehan TP; et al. Association between maintenance of certification examination scores and quality of care for Medicare beneficiaries. Arch Intern Med. 2008;168(13):1396-1403. FREE FULL TEXT
31. Chen J, Rathore SS, Wang Y, Radford MJ, Krumholz HM. Physician board certification and the care and outcomes of elderly patients with acute myocardial infarction. J Gen Intern Med. 2006;21(3):238-244. FULL TEXT | WEB OF SCIENCE | PUBMED
32. Shahian DM, Torchiana DF, Shemin RJ, Rawn JD, Normand SL. Massachusetts cardiac surgery report card: implications of statistical methodology. Ann Thorac Surg. 2005;80(6):2106-2113. FREE FULL TEXT
33. Landon BE, Normand SL, Blumenthal D, Daley J. Physician clinical performance assessment: prospects and barriers. JAMA. 2003;290(9):1183-1189. FREE FULL TEXT
34. Landon BE, Normand SL. Performance measurement in the small office practice: challenges and potential solutions. Ann Intern Med. 2008;148(5):353-357. FREE FULL TEXT
35. Hofer TP, Hayward RA, Greenfield S, Wagner EH, Kaplan SH, Manning WG. The unreliability of individual physician "report cards" for assessing the costs and quality of care of a chronic disease. JAMA. 1999;281(22):2098-2105. FREE FULL TEXT
36. Scholle SH, Roski J, Adams JL; et al. Benchmarking physician performance: reliability of individual and composite measures. Am J Manag Care. 2008;14(12):833-838. PUBMED
37. Kostopoulou O, Delaney BC, Munro CW. Diagnostic difficulty and error in primary care—a systematic review. Fam Pract. 2008;25(6):400-413. FREE FULL TEXT
38. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005;165(13):1493-1499. FREE FULL TEXT
39. Casalino LP, Alexander GC, Jin L, Konetzka RT. General internists' views on pay-for-performance and public reporting of quality scores: a national survey. Health Aff (Millwood). 2007;26(2):492-499. FREE FULL TEXT
40. Shahian DM, Normand SL, Torchiana DF; et al. Cardiac surgery report cards: comprehensive review and statistical critique. Ann Thorac Surg. 2001;72(6):2155-2168. FREE FULL TEXT
41. Roan S. Doctor ratings: is your healthcare hot or not? Los Angeles Times. May 19, 2008. http://articles.latimes.com/2008/may/19/health/he-docratings19. Accessed June 29, 2009.
42. America's best hospitals. US News World Rep. 2008;145(2):74, 76, 78. PUBMED
43. Comarow A. US News's "Best Hospitals" clashes with other ratings: is that bad? November 14, 2008. http://health.usnews.com/blogs/comarow-on-quality/2008/11/14/us-newss-best-hospitals-clashes-with-other-ratings-is-that-bad.html. Accessed June 28, 2009.
44. Chen J, Radford MJ, Wang Y, Marciniak TA, Krumholz HM. Do "America's best hospitals" perform better for acute myocardial infarction? N Engl J Med. 1999;340(4):286-292. FREE FULL TEXT
45. Williams SC, Koss RG, Morton DJ, Loeb JM. Performance of top-ranked heart care hospitals on evidence-based process measures. Circulation. 2006;114(6):558-564. FREE FULL TEXT
46. Wang OJ, Wang Y, Lichtman JH, Bradley EH, Normand SL, Krumholz HM. "America's best hospitals" in the treatment of acute myocardial infarction. Arch Intern Med. 2007;167(13):1345-1351. FREE FULL TEXT
47. HealthGrades. The Third Annual HealthGrades America's 50 Best Hospitals Report. 2009. http://www.healthgrades.com/media/DMS/pdf/Americas50BestHospitalsReport2009.pdf. Accessed June 8, 2009.
48. Krumholz HM, Rathore SS, Chen J, Wang Y, Radford MJ. Evaluation of a consumer-oriented internet health care report card: the risk of quality ratings based on mortality data. JAMA. 2002;287(10):1277-1287. FREE FULL TEXT
49. Thomson Reuters. 100 Top Hospitals: National Benchmarks 2008 Study. http://img.en25.com/Web/ThomsonReuters/PRO-6520%20100%20Top%20Abstract_0309_FINAL1.pdf. Accessed June 28, 2009.
50. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001.
51. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008;359(18):1921-1931. FREE FULL TEXT
52. Bradley EH, Herrin J, Elbel B; et al. Hospital quality for acute myocardial infarction: correlation among process measures and relationship with short-term mortality. JAMA. 2006;296(1):72-78. FREE FULL TEXT
53. Chen J, Rathore SS, Radford MJ, Krumholz HM. JCAHO accreditation and quality of care for acute myocardial infarction. Health Aff (Millwood). 2003;22(2):243-254. FREE FULL TEXT
54. Leapfrog Group. Leapfrog Hospital Survey Results 2008. http://www.leapfroggroup.org/media/file/leapfrogreportfinal.pdf. Accessed June 28, 2009.
55. Jha AK, Orav EJ, Ridgway AB, Zheng J, Epstein AM. Does the Leapfrog program help identify high-quality hospitals? Jt Comm J Qual Patient Saf. 2008;34(6):318-325. PUBMED
56. Kernisan LP, Lee SJ, Boscardin WJ, Landefeld CS, Dudley RA. Association between hospital-reported Leapfrog Safe Practices Scores and inpatient mortality. JAMA. 2009;301(13):1341-1348. FREE FULL TEXT
57. UCompareHealthCare. Methodology. http://www.ucomparehealthcare.com/about_us/methodology.html. Accessed June 28, 2009.
58. Werner RM, Bradlow ET. Relationship between Medicare's hospital compare performance measures and mortality rates. JAMA. 2006;296(22):2694-2702. FREE FULL TEXT
59. Birkmeyer JD, Siewers AE, Finlayson EV; et al. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346(15):1128-1137. FREE FULL TEXT
60. Gruen RL, Pitt V, Green S, Parkhill A, Campbell D, Jolley D. The effect of provider case volume on cancer mortality: systematic review and meta-analysis. CA Cancer J Clin. 2009;59(3):192-211. FREE FULL TEXT
61. Aujesky D, Mor MK, Geng M, Fine MJ, Renaud B, Ibrahim SA. Hospital volume and patient outcomes in pulmonary embolism. CMAJ. 2008;178(1):27-33. FREE FULL TEXT
62. Kahn JM, Goss CH, Heagerty PJ, Kramer AA, O’Brien CR, Rubenfeld GD. Hospital volume and the outcomes of mechanical ventilation. N Engl J Med. 2006;355(1):41-50. FREE FULL TEXT
63. Durairaj L, Torner JC, Chrischilles EA, Vaughan Sarrazin MS, Yankey J, Rosenthal GE. Hospital volume-outcome relationships among medical admissions to ICUs. Chest. 2005;128(3):1682-1689. FREE FULL TEXT
64. Schull MJ, Vermeulen MJ, Stukel TA. The risk of missed diagnosis of acute myocardial infarction associated with emergency department volume. Ann Emerg Med. 2006;48(6):647-655. FULL TEXT | WEB OF SCIENCE | PUBMED
65. Esserman L, Cowley H, Eberle C; et al. Improving the accuracy of mammography: volume and outcome relationships. J Natl Cancer Inst. 2002;94(5):369-375. FREE FULL TEXT
66. Kimmel SE, Berlin JA, Laskey WK. The relationship between coronary angioplasty procedure volume and major complications. JAMA. 1995;274(14):1137-1142. FREE FULL TEXT
67. Khuri SF, Daley J, Henderson W; et al. Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program. Ann Surg. 1999;230(3):414-429. FULL TEXT | WEB OF SCIENCE | PUBMED
68. Peterson ED, Coombs LP, DeLong ER, Haan CK, Ferguson TB. Procedural volume as a marker of quality for CABG surgery. JAMA. 2004;291(2):195-201. FREE FULL TEXT
69. Song HK, Diggs BS, Slater MS, Guyton SW, Ungerleider RM, Welke KF. Improved quality and cost-effectiveness of coronary artery bypass grafting in the United States from 1988 to 2005. J Thorac Cardiovasc Surg. 2009;137(1):65-69. FREE FULL TEXT
70. Halm EA, Lee C, Chassin MR. Is volume related to outcome in health care? a systematic review and methodologic critique of the literature. Ann Intern Med. 2002;137(6):511-520. FREE FULL TEXT
71. Christian CK, Gustafson ML, Betensky RA, Daley J, Zinner MJ. The volume-outcome relationship: don't believe everything you see. World J Surg. 2005;29(10):1241-1244. FULL TEXT | WEB OF SCIENCE | PUBMED
72. Staiger DO, Dimick JB, Baser O, Fan Z, Birkmeyer JD. Empirically derived composite measures of surgical performance. Med Care. 2009;47(2):226-233. FULL TEXT | WEB OF SCIENCE | PUBMED
73. Iezzoni LI. The risks of risk adjustment. JAMA. 1997;278(19):1600-1607. FREE FULL TEXT
74. Leonardi MJ, McGory ML, Ko CY. Publicly available hospital comparison Web sites: determination of useful, valid, and appropriate information for comparing surgical quality. Arch Surg. 2007;142(9):863-868. FREE FULL TEXT
75. Rothberg MB, Benjamin EM, Lindenauer PK. Public reporting of hospital quality: recommendations to benefit patients and hospitals [published online ahead of print June 9, 2009]. J Hosp Med. doi:10.1002/jhm.481. PUBMED
76. Hunink MG, Glasziou PP, Siegel JE; et al. Proactive decision making. In: Decision Making in Health and Medicine: Integrating Evidence and Values. Cambridge, England: Cambridge University Press; 2001:364-380.
77. Chiquette E, Amato MG, Bussey HI. Comparison of an anticoagulation clinic with usual medical care: anticoagulation control, patient outcomes, and health care costs. Arch Intern Med. 1998;158(15):1641-1647. FREE FULL TEXT
78. American Board of Internal Medicine; American College of Physicians–American Society of Internal Medicine; European Federation of Internal Medicine. Medical professionalism in the new millennium: a physician charter. Ann Intern Med. 2002;136(3):243-246. FREE FULL TEXT
79. Trivedi AN, Zaslavsky AM, Schneider EC, Ayanian JZ. Trends in the quality of care and racial disparities in Medicare managed care. N Engl J Med. 2005;353(7):692-700. FREE FULL TEXT
80. Casalino LP, Elster A, Eisenberg A, Lewis E, Montgomery J, Ramos D. Will pay-for-performance and quality reporting affect health care disparities? Health Aff (Millwood). 2007;26(3):w405-w414. FREE FULL TEXT
81. Trivedi AN, Zaslavsky AM, Schneider EC, Ayanian JZ. Relationship between quality of care and racial disparities in Medicare health plans. JAMA. 2006;296(16):1998-2004. FREE FULL TEXT
82. Sofaer S, Crofton C, Goldstein E, Hoy E, Crabb J. What do consumers want to know about the quality of care in hospitals? Health Serv Res. 2005;40(6 pt 2):2018-2036. FULL TEXT | WEB OF SCIENCE | PUBMED
83. Faber M, Bosch M, Wollersheim H, Leatherman S, Grol R. Public reporting in health care: how do consumers use quality-of-care information? a systematic review. Med Care. 2009;47(1):1-8. FULL TEXT | WEB OF SCIENCE | PUBMED
84. Schneider EC, Epstein AM. Use of public performance reports: a survey of patients undergoing cardiac surgery. JAMA. 1998;279(20):1638-1642. FREE FULL TEXT
85. Kaiser Family Foundation/Agency for Healthcare Research and Quality. 2006 Update on Consumers' Views of Patient Safety and Quality Information. http://www.kff.org/kaiserpolls/upload/7560.pdf. Accessed October 6, 2009.
86. Fung CH, Lim YW, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148(2):111-123. FREE FULL TEXT
87. Hibbard JH. What can we say about the impact of public reporting? inconsistent execution yields variable results. Ann Intern Med. 2008;148(2):160-161. FREE FULL TEXT
88. Schwartz LM, Woloshin S, Birkmeyer JD. How do elderly patients decide where to go for major surgery? telephone interview survey. BMJ. 2005;331(7520):821. FREE FULL TEXT
89. Wilson CT, Woloshin S, Schwartz LM. Choosing where to have major surgery: who makes the decision? Arch Surg. 2007;142(3):242-246. FREE FULL TEXT
90. Forrest CB, Nutting PA, Starfield B, von Schrader S. Family physicians' referral decisions: results from the ASPN referral study. J Fam Pract. 2002;51(3):215-222. WEB OF SCIENCE | PUBMED

Clinical Crossroads Section Editor: Margaret A. Winker, MD, Deputy Editor.



Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter     What's this?





HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | CME | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 2009 American Medical Association. All Rights Reserved.