Use of standardized patients to assess between-physician variations in resource utilization

P. J. McLeod, R. M. Tamblyn, D. Gayton, R. Grad, L. Snell, L. Berkson and M. Abrahamowicz
Department of Medicine, McGill University, Montreal, Quebec.

CONTEXT: As medical costs are increasingly being scrutinized, there is heightened interest in defining variations in physician behavior in clinical settings. OBJECTIVE: To evaluate if standardized patient (SP) technology is a reliable and feasible method of studying interphysician variations in test ordering, referral requests, prescribing behavior, and visit costs. DESIGN: The study was conducted with blinded SP visits to family medicine and internal medicine residents, university-affiliated family physicians, and community-based family physicians. Resource utilization and visit costs were assessed using test requisitions, consult requests, and prescriptions that were collected by the SPs. SETTING: Physicians' offices in ambulatory care, hospital-based clinics and in the community. PARTICIPANTS: Four persons (aged 57-77 years) trained to simulate having osteoarthritis of the hip. In one simulation, the patient had gastropathy due to nonsteroidal anti-inflammatory drug use, and in the other, the patient sought therapy for hip discomfort. MAIN OUTCOME MEASURES: Reliability of cost estimates of physician services, tests, consultations, prescriptions, and total visits and test-ordering behavior for nonsteroidal anti-inflammatory gastropathy. RESULTS: Overall, 112 (63%) of the physicians who were sent invitations to the study agreed to participate. Of 312 total SP visits conducted over a 1-year period, unblinding due to SP detection occurred on 36 occasions (11.5%). Reliable cost estimates of physician services, tests, and consultations, and moderately reliable estimates of total visit costs, were obtained with 4 visits per practicing physician and with 2 visits per resident. There were extreme variations in total visit costs generated by the study physicians. A small number of physicians had a major impact on this variability. CONCLUSION: Standardized patient technology provides a reliable, feasible method to assess variations in resource utilization between physicians.

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

The effect of patients' sex on physicians' recommendations for total knee arthroplasty
Borkhoff et al.
CMAJ 2008;178:681-687.
ABSTRACT | FULL TEXT  

Cardiologists Use Pulmonary Artery Catheter Information to Make Homogenous Treatment Decisions
Jain et al.
J Intensive Care Med 2007;22:251-256.
ABSTRACT  

Assessment of Clinical Skills Using Simulator Technologies
Srinivasan et al.
Acad. Psychiatry 2006;30:505-515.
ABSTRACT | FULL TEXT  

Assessing the ACGME Competencies in Psychiatry Training Programs
Swick et al.
Acad. Psychiatry 2006;30:330-351.
ABSTRACT | FULL TEXT  

Patient-Centered Communication and Diagnostic Testing
Epstein et al.
Ann Fam Med 2005;3:415-421.
ABSTRACT | FULL TEXT  

Cultural Competence Policies and Other Predictors of Asthma Care Quality for Medicaid-Insured Children
Lieu et al.
Pediatrics 2004;114:e102-e110.
ABSTRACT | FULL TEXT  

Defining and Assessing Professional Competence
Epstein and Hundert
JAMA 2002;287:226-235.
ABSTRACT | FULL TEXT  

Primary Care and Emergency Department Decision Making
McNulty et al.
Arch Pediatr Adolesc Med 2001;155:1266-1270.
ABSTRACT | FULL TEXT  

Simulation in Medical Education: A Review
Lane et al.
Simulation Gaming 2001;32:297-314.
ABSTRACT  

Comparison of Vignettes, Standardized Patients, and Chart Abstraction: A Prospective Validation Study of 3 Methods for Measuring Quality
Peabody et al.
JAMA 2000;283:1715-1722.
ABSTRACT | FULL TEXT