This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on Web of Science (81)  • Contact me when this article is cited  Related Content  • Related letter  • Related article  • Similar articles in JAMA  Topic Collections  • Patient-Physician Relationship/ Care  • Treatment Adherence  • Alert me on articles by topic  Social Bookmarking   What's this?

Results From the VA Cooperative Study on Computerized Reminders

John G. Demakis, MD; Charles Beauchamp, MD, PhD; William L. Cull, PhD; Robbin Denwood, RN, MSN, MBA; Seth A. Eisen, MD, MSc; Richard Lofgren, MD, MPH; Kristen Nichol, MD, MPH; James Woolliscroft, MD; William G. Henderson, PhD; for the Department of Veterans Affairs Cooperative Study Group on Computer Reminders in Ambulatory Care

JAMA. 2000;284:1411-1416.

Context  Computerized systems to remind physicians to provide appropriate care have not been widely evaluated in large numbers of patients in multiple clinical settings.

Objective  To examine whether a computerized reminder system operating in multiple Veterans Affairs (VA) ambulatory care clinics improves resident physician compliance with standards of ambulatory care.

Design, Setting, and Participants  A total of 275 resident physicians at 12 VA medical centers were randomly assigned in firms or half-day clinic blocks to either a reminder group (n = 132) or a control group (n = 143). During a 17-month study period (January 31, 1995–June 30, 1996), the residents cared for 12,989 unique patients for whom at least 1 of the studied standards of care (SOC) was applicable.

Main Outcome Measures  Compliance with 13 SOC, tracked using hospital databases and encounter forms completed by residents, compared between residents in the reminder group vs those in the control group.

Results  Measuring compliance as the proportion of patients in compliance with all applicable SOC by their last visit during the study period, the reminder group had statistically significantly higher rates of compliance than the control group for all standards combined (58.8% vs 53.5%; odds ratio [OR], 1.24; 95% confidence interval [CI], 1.08-1.42; P = .002) and for 5 of the 13 standards examined individually. Measuring compliance as the proportion of all visits for which care was indicated in which residents provided proper care, the reminder group also had statistically significantly higher rates of compliance than the control group for all standards combined (17.9% vs 12.2%; OR, 1.57; 95% CI, 1.45-1.71; P<.001) and for 9 of the 13 standards examined individually. The benefit of reminders, however, declined throughout the course of the study, even though the reminders remained active.

Conclusions  Our data indicate that reminder systems installed at multiple sites can improve residents' compliance to multiple SOC. The benefits of such systems, however, appear to deteriorate over time. Future research needs to explore methods to better sustain the benefits of reminders.

Author Affiliations: VA Health Services Research and Development Service, Washington, DC (Dr Demakis); Department of Ambulatory Care, Durham VAMC, Durham, NC (Dr Beauchamp); Hines VA Cooperative Studies Program Coordinating Center, Hines, Ill (Drs Cull and Henderson and Ms Denwood); Department of Rheumatology, St Louis VAMC, St Louis, Mo (Dr Eisen); Department of General Internal Medicine, Medical College of Wisconsin, Milwaukee (Dr Lofgren); Department of Internal Medicine, Minneapolis VAMC, Minneapolis, Minn (Dr Nichol); and Department of General Medicine, University of Michigan, Ann Arbor (Dr Woolliscroft).

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

RELATED LETTER

Effectiveness of Computerized Reminders in Ambulatory Care
Robert C. Burack, Phyllis A. Gimotty, John G. Demakis, William L. Cull, Robbin Denwood, and William G. Henderson
JAMA. 2000;284(22):2872-2873.
EXTRACT | FULL TEXT  

RELATED ARTICLE

September 20, 2000
JAMA. 2000;284(11):1451-1452.
EXTRACT | FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Quality of Lipid Management in Outpatient Care: A National Study Using Electronic Health Records
Gill and Yingxia Chen
American Journal of Medical Quality 2008;23:375-381.
ABSTRACT  

"Smart Forms" in an Electronic Medical Record: Documentation-based Clinical Decision Support to Improve Disease Management
Schnipper et al.
J. Am. Med. Inform. Assoc. 2008;15:513-523.
ABSTRACT | FULL TEXT  

A Randomized Trial of Electronic Clinical Reminders to Improve Medication Laboratory Monitoring
Matheny et al.
J. Am. Med. Inform. Assoc. 2008;15:424-429.
ABSTRACT | FULL TEXT  

A framework for tobacco control: lessons learnt from Veterans Health Administration
Sherman
BMJ 2008;336:1016-1019.
FULL TEXT  

Prompting Clinicians about Preventive Care Measures: A Systematic Review of Randomized Controlled Trials
Dexheimer et al.
J. Am. Med. Inform. Assoc. 2008;15:311-320.
ABSTRACT | FULL TEXT  

Impact of Clinical Reminder Redesign on Learnability, Efficiency, Usability, and Workload for Ambulatory Clinic Nurses
Saleem et al.
J. Am. Med. Inform. Assoc. 2007;14:632-640.
ABSTRACT | FULL TEXT  

Clinical Reminders Attached to Echocardiography Reports of Patients With Reduced Left Ventricular Ejection Fraction Increase Use of {beta}-Blockers: A Randomized Trial
Heidenreich et al.
Circulation 2007;115:2829-2834.
ABSTRACT | FULL TEXT  

The Effect of an Interactive Visual Reminder in an Anesthesia Information Management System on Timeliness of Prophylactic Antibiotic Administration
Wax et al.
Anesth. Analg. 2007;104:1462-1466.
ABSTRACT | FULL TEXT  

Toward an Effective Strategy for the Diffusion and Use of Clinical Information Systems
Davidson and Heineke
J. Am. Med. Inform. Assoc. 2007;14:361-367.
ABSTRACT | FULL TEXT  

Informatics Systems to Promote Improved Care for Chronic Illness: A Literature Review
Dorr et al.
J. Am. Med. Inform. Assoc. 2007;14:156-163.
ABSTRACT | FULL TEXT  

Effect of a Nurse-Directed Diabetes Disease Management Program on Urgent Care/Emergency Room Visits and Hospitalizations in a Minority Population
Davidson et al.
Diabetes Care 2007;30:224-227.
ABSTRACT | FULL TEXT  

Use of a Personal Digital Assistant for Managing Antibiotic Prescribing for Outpatient Respiratory Tract Infections in Rural Communities
Rubin et al.
J. Am. Med. Inform. Assoc. 2006;13:627-634.
ABSTRACT | FULL TEXT  

The Quality Of Chronic Disease Care In U.S. Community Health Centers
Hicks et al.
Health Aff (Millwood) 2006;25:1712-1723.
ABSTRACT | FULL TEXT  

Use of a Glucose Algorithm to Direct Diabetes Therapy Improves A1C Outcomes and Defines an Approach to Assess Provider Behavior.
Miller et al.
The Diabetes Educator 2006;32:533-545.
ABSTRACT | FULL TEXT  

The impact of prescribing safety alerts for elderly persons in an electronic medical record: an interrupted time series evaluation.
Smith et al.
Arch Intern Med 2006;166:1098-1104.
ABSTRACT | FULL TEXT  

Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care
Chaudhry et al.
ANN INTERN MED 2006;144:742-752.
ABSTRACT | FULL TEXT  

Quality of Outpatient Care for Diabetes Mellitus in a National Electronic Health Record Network
Gill et al.
American Journal of Medical Quality 2006;21:13-17.
ABSTRACT  

Costs and Cost Effectiveness of a Health Care Provider-Directed Intervention to Promote Colorectal Cancer Screening Among Veterans
Wolf et al.
JCO 2005;23:8877-8883.
ABSTRACT | FULL TEXT  

A trial of education, prompts, and opinion leaders to improve prescription of lipid modifying therapy by primary care physicians for patients with ischemic heart disease
Bloomfield et al.
Qual Saf Health Care 2005;14:258-263.
ABSTRACT | FULL TEXT  

An Empirical Assessment of High-Performing Medical Groups: Results from a National Study
Shortell et al.
Med Care Res Rev 2005;62:407-434.
ABSTRACT  

A Randomized Trial of Electronic Clinical Reminders to Improve Quality of Care for Diabetes and Coronary Artery Disease
Sequist et al.
J. Am. Med. Inform. Assoc. 2005;12:431-437.
ABSTRACT | FULL TEXT  

Exploring Barriers and Facilitators to the Use of Computerized Clinical Reminders
Saleem et al.
J. Am. Med. Inform. Assoc. 2005;12:438-447.
ABSTRACT | FULL TEXT  

Health Information Technology and Physician-Patient Interactions: Impact of Computers on Communication during Outpatient Primary Care Visits
Hsu et al.
J. Am. Med. Inform. Assoc. 2005;12:474-480.
ABSTRACT | FULL TEXT  

Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient Outcomes: A Systematic Review
Garg et al.
JAMA 2005;293:1223-1238.
ABSTRACT | FULL TEXT  

Health Care Provider-Directed Intervention to Increase Colorectal Cancer Screening Among Veterans: Results of a Randomized Controlled Trial
Ferreira et al.
JCO 2005;23:1548-1554.
ABSTRACT | FULL TEXT  

Diabetes Care Quality in the Veterans Affairs Health Care System and Commercial Managed Care: The TRIAD Study
Kerr et al.
ANN INTERN MED 2004;141:272-281.
ABSTRACT | FULL TEXT  

Early Adoption of Human Immunodeficiency Virus Quality Improvement in Veterans Affairs Medical Centers: Use of Organizational Surveys to Measure Readiness to Change and Adapt Interventions to Local Priorities
Anaya et al.
American Journal of Medical Quality 2004;19:137-144.
ABSTRACT  

Human Factors Barriers to the Effective Use of Ten HIV Clinical Reminders
Patterson et al.
J Am Med Inform Assoc 2004;11:50-59.
ABSTRACT | FULL TEXT  

Future History: Medical Informatics in Geriatrics
Nebeker et al.
Journals of Gerontology Series A: Biological Sciences and Medical Sciences 2003;58:M820-825.
ABSTRACT | FULL TEXT  

Effect of Nurse-Directed Diabetes Care in a Minority Population
Davidson
Diabetes Care 2003;26:2281-2287.
ABSTRACT | FULL TEXT  

Electronic Technology: A Spark to Revitalize Primary Care?
Bodenheimer and Grumbach
JAMA 2003;290:259-264.
ABSTRACT | FULL TEXT  

The Case for "Outsourcing" Diabetes Care
Davidson
Diabetes Care 2003;26:1608-1612.
FULL TEXT  

External Incentives, Information Technology, and Organized Processes to Improve Health Care Quality for Patients With Chronic Diseases
Casalino et al.
JAMA 2003;289:434-441.
ABSTRACT | FULL TEXT  

Impact of a Program to Improve Adherence to Diabetes Guidelines by Primary Care Physicians
Kirkman et al.
Diabetes Care 2002;25:1946-1951.
ABSTRACT | FULL TEXT  

Does National Regulatory Mandate of Provider Order Entry Portend Greater Benefit Than Risk for Health Care Delivery?: The 2001 ACMI Debate
Overhage et al.
J. Am. Med. Inform. Assoc. 2002;9:199-208.
ABSTRACT | FULL TEXT  

Clinical Inertia
Phillips et al.
ANN INTERN MED 2001;135:825-834.
ABSTRACT | FULL TEXT  

Community Health Worker Performance in the Management of Multiple Childhood Illnesses: Siaya District, Kenya, 1997-2001
Kelly et al.
AJPH 2001;91:1617-1624.
ABSTRACT | FULL TEXT  

Effectiveness of Computerized Reminders in Ambulatory Care
Burack et al.
JAMA 2000;284:2872-2873.
FULL TEXT