This Article  • References  • Full text PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Contact me when this article is cited  Related Content  • Similar articles in JAMA  Social Bookmarking   What's this?

A Systematic Review of the Effect of Continuing Medical Education Strategies

David A. Davis, MD; Mary Ann Thomson, BHSc; Andrew D. Oxman, MD; R. Brian Haynes, MD, PhD

JAMA. 1995;274(9):700-705.

Abstract
Objective.
—To review the literature relating to the effectiveness of education strategies designed to change physician performance and health care outcomes.

Data Sources.
—We searched MEDLINE, ERIC, NTIS, the Research and Development Resource Base in Continuing Medical Education, and other relevant data sources from 1975 to 1994, using continuing medical education (CME) and related terms as keywords. We manually searched journals and the bibliographies of other review articles and called on the opinions of recognized experts.

Study Selection.
—We reviewed studies that met the following criteria: randomized controlled trials of education strategies or interventions that objectively assessed physician performance and/or health care outcomes. These intervention strategies included (alone and in combination) educational materials, formal CME activities, outreach visits such as academic detailing, opinion leaders, patient-mediated strategies, audit with feedback, and reminders. Studies were selected only if more than 50% of the subjects were either practicing physicians or medical residents.

Data Extraction.
—We extracted the specialty of the physicians targeted by the interventions and the clinical domain and setting of the trial. We also determined the details of the educational intervention, the extent to which needs or barriers to change had been ascertained prior to the intervention, and the main outcome measure(s).

Data Synthesis.
—We found 99 trials, containing 160 interventions, that met our criteria. Almost two thirds of the interventions (101 of 160) displayed an improvement in at least one major outcome measure: 70% demonstrated a change in physician performance, and 48% of interventions aimed at health care outcomes produced a positive change. Effective change strategies included reminders, patient-mediated interventions, outreach visits, opinion leaders, and multifaceted activities. Audit with feedback and educational materials were less effective, and formal CME conferences or activities, without enabling or practice-reinforcing strategies, had relatively little impact.

Conclusion.
—Widely used CME delivery methods such as conferences have little direct impact on improving professional practice. More effective methods such as systematic practice-based interventions and outreach visits are seldom used by CME providers.

(JAMA. 1995;274:700-705)

Author Affiliations
From the Faculty of Medicine, University of Toronto (Ontario) (Dr Davis); the Faculty of Health Sciences, McMaster University, Hamilton, Ontario (Ms Thomson and Dr Haynes); and the National Institute of Public Health, Oslo, Norway (Dr Oxman).

Footnotes
Corresponding author: Office of Continuing Education, Faculty of Medicine, University of Toronto, 150 College St, Toronto, Ontario, Canada M5S 1A8 (Dr Davis).

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Disseminating best-evidence health-care to Indigenous health-care settings and programs in Australia: identifying the gaps
Clifford et al.
HEALTH PROMOT INT 2009;24:404-415.
ABSTRACT | FULL TEXT  

Implementation of the Canadian C-Spine Rule: prospective 12 centre cluster randomised trial
Stiell et al.
BMJ 2009;339:b4146-b4146.
ABSTRACT | FULL TEXT  

Getting clinical trial results into practice: design, implementation, and process evaluation of the ALLHAT Dissemination Project
Bartholomew et al.
Clin Trials 2009;6:329-343.
ABSTRACT  

Prescriber Fidelity to a Medication Management Evidence-Based Practice in the Treatment of Schizophrenia
Howard et al.
Psychiatr. Serv. 2009;60:929-935.
ABSTRACT | FULL TEXT  

Experience with academic detailing services for quality improvement in primary care practice
May et al.
Qual Saf Health Care 2009;18:225-231.
ABSTRACT | FULL TEXT  

Resistance Is Futile: But It Is Slowing the Pace of EHR Adoption Nonetheless
Ford et al.
J. Am. Med. Inform. Assoc. 2009;16:274-281.
ABSTRACT | FULL TEXT  

Education, hospital staff and the confused older patient
Teodorczuk et al.
Age Ageing 2009;38:252-253.
FULL TEXT  

The American College of Chest Physicians Evidence-Based Educational Guidelines for Continuing Medical Education Interventions: A Critical Review of Evidence-Based Educational Guidelines
Norman
Chest 2009;135:834-837.
ABSTRACT | FULL TEXT  

Continuing Medical Education Effect on Physician Knowledge: Effectiveness of Continuing Medical Education: American College of Chest Physicians Evidence-Based Educational Guidelines
Bordage et al.
Chest 2009;135:29S-36S.
ABSTRACT | FULL TEXT  

Continuing Medical Education Effect on Physician Knowledge Application and Psychomotor Skills: Effectiveness of Continuing Medical Education: American College of Chest Physicians Evidence-Based Educational Guidelines
O'Neil and Addrizzo-Harris
Chest 2009;135:37S-41S.
ABSTRACT | FULL TEXT  

Continuing Medical Education Effect on Practice Performance: Effectiveness of Continuing Medical Education: American College of Chest Physicians Evidence-Based Educational Guidelines
Davis and Galbraith
Chest 2009;135:42S-48S.
ABSTRACT | FULL TEXT  

Continuing Medical Education Effect on Clinical Outcomes: Effectiveness of Continuing Medical Education: American College of Chest Physicians Evidence-Based Educational Guidelines
Mazmanian et al.
Chest 2009;135:49S-55S.
ABSTRACT | FULL TEXT  

Education Techniques for Lifelong Learning: Lifelong Learning in the 21st Century and Beyond1
Collins
RadioGraphics 2009;29:613-622.
ABSTRACT | FULL TEXT  

The 2007 National Asthma Education and Prevention Program Asthma Guidelines: Accelerating Their Implementation and Facilitating Their Impact on Children With Asthma
Gupta and Weiss
Pediatrics 2009;123:S193-S198.
ABSTRACT | FULL TEXT  

Detection of Intimate Partner Violence in a General Medicine Practice
Soglin et al.
J Interpers Violence 2009;24:338-348.
ABSTRACT  

CPD and recertification: improving patient outcomes through focused learning
Bamrah and Bhugra
Adv. Psychiatr. Treat. 2009;15:2-6.
ABSTRACT | FULL TEXT  

A model to evaluate quality and effectiveness of disease management
Lemmens et al.
Qual Saf Health Care 2008;17:447-453.
ABSTRACT | FULL TEXT  

Why do patients choose self-care dialysis?
McLaughlin et al.
Nephrol Dial Transplant 2008;23:3972-3976.
ABSTRACT | FULL TEXT  

Quality of Inpatient Care for Asthma: Challenges and Opportunities
Kattan
Pediatrics 2008;122:1369-1370.
FULL TEXT  

Evaluating Online Continuing Medical Education Seminars: Evidence for Improving Clinical Practices
Weston et al.
American Journal of Medical Quality 2008;23:475-483.
ABSTRACT  

A Randomized Controlled Trial to Improve Lymph Node Assessment in Stage II Colon Cancer
Wright et al.
Arch Surg 2008;143:1050-1055.
ABSTRACT | FULL TEXT  

Exploring Dental Students' Perceptions of Cultural Competence and Social Responsibility
Rubin et al.
J Dent Educ 2008;72:1114-1121.
ABSTRACT | FULL TEXT  

Palliative Care Intervention for Choice and Use of Opioids in the Last Hours of Life
Bailey et al.
Journals of Gerontology Series A: Biological Sciences and Medical Sciences 2008;63:974-978.
ABSTRACT | FULL TEXT  

Evidence-based medicine as viewed by key decision-makers of health plans in southern Brazil
Tiburi
Health Serv Manage Res 2008;21:185-191.
ABSTRACT | FULL TEXT  

Planning and Implementing a Systems-Based Patient Safety Curriculum in Medical Education
Thompson et al.
American Journal of Medical Quality 2008;23:271-278.
ABSTRACT  

Lessons from Implementing a Combined Workflow-Informatics System for Diabetes Management
Zai et al.
J. Am. Med. Inform. Assoc. 2008;15:524-533.
ABSTRACT | FULL TEXT  

The Bright Futures Training Intervention Project: Implementing Systems to Support Preventive and Developmental Services in Practice
Lannon et al.
Pediatrics 2008;122:e163-e171.
ABSTRACT | FULL TEXT  

Exploring the black box of change in improving test-ordering routines
van Bokhoven et al.
Fam Pract 2008;0:cmn022v1-cmn022.
ABSTRACT | FULL TEXT  

Barriers to good sickness certification -- an interview study with Swedish general practitioners
Swartling et al.
Scand J Public Health 2008;36:408-414.
ABSTRACT  

Physician Responses to a Community-Level Trial Promoting Judicious Antibiotic Use
Stille et al.
Ann Fam Med 2008;6:206-212.
ABSTRACT | FULL TEXT  

Associations of Conference Attendance With Internal Medicine In-Training Examination Scores
McDonald et al.
Mayo Clin Proc. 2008;83:449-453.
ABSTRACT | FULL TEXT  

Cardiorespiratory Arrests and Rapid Response Teams in Pediatrics--Reply
Sharek and Roth
JAMA 2008;299:1424-1424.
FULL TEXT  

Lifelong learning at work
Teunissen and Dornan
BMJ 2008;336:667-669.
FULL TEXT  

Improving Alcohol and Tobacco History Taking by Junior Medical Officers
Proude et al.
Alcohol Alcohol 2008;0:agm182v1-agm182.
ABSTRACT | FULL TEXT  

Themed Review: Clinical Interventions to Promote Physical Activity in Youth
Meriwether et al.
AMERICAN JOURNAL OF LIFESTYLE MEDICINE 2008;2:7-25.
ABSTRACT  

Impact of a Multidisciplinary Approach to Guideline Implementation in Diabetic Ketoacidosis
Volkova et al.
American Journal of Medical Quality 2008;23:47-55.
ABSTRACT  

Improving Pediatric Practice Immunization Rates Through Distance-Based Quality Improvement: A Feasibility Trial from PROS
Slora et al.
CLIN PEDIATR 2008;47:25-36.
ABSTRACT  

Continuing Veterinary Medical Education Needs and Delivery Preferences of Alberta Veterinarians
Delver
jvme 2008;35:129-137.
ABSTRACT | FULL TEXT  

Impact of a 16-Community Trial to Promote Judicious Antibiotic Use in Massachusetts
Finkelstein et al.
Pediatrics 2008;121:e15-e23.
ABSTRACT | FULL TEXT  

Barriers and facilitators to the implementation of the collaborative method: reflections from a single site
Newton et al.
Qual Saf Health Care 2007;16:409-414.
ABSTRACT | FULL TEXT  

Impact of short evidence summaries in discharge letters on adherence of practitioners to discharge medication. A cluster-randomised controlled trial
Kunz et al.
Qual Saf Health Care 2007;16:456-461.
ABSTRACT | FULL TEXT  

Does Faculty Development Enhance Teaching Effectiveness?
Hendricson et al.
J Dent Educ 2007;71:1513-1533.
ABSTRACT | FULL TEXT  

Self-Reported Performance Improvement Strategies of Highly Successful Veterans Health Administration Facilities
Craig et al.
American Journal of Medical Quality 2007;22:438-444.
ABSTRACT  

Effect of a Rapid Response Team on Hospital-wide Mortality and Code Rates Outside the ICU in a Children's Hospital
Sharek et al.
JAMA 2007;298:2267-2274.
ABSTRACT | FULL TEXT  

Improving Asthma Care Through Recertification: A Cluster Randomized Trial
Simpkins et al.
Arch Intern Med 2007;167:2240-2248.
ABSTRACT | FULL TEXT  

Foundation programme assessment tools in psychiatry
Naeem et al.
Psychiatr. Bull. 2007;31:427-430.
FULL TEXT  

Specialty Differences in Prescribing Inhaled Corticosteroids for Children
Cabana et al.
CLIN PEDIATR 2007;46:698-705.
ABSTRACT  

Improvement in Provider Immunization Knowledge and Behaviors Following a Peer Education Intervention
Boom et al.
CLIN PEDIATR 2007;46:706-717.
ABSTRACT  

Implementing guidelines: what works
Livesey and Noon
EDUCATION AND PRACTICE 2007;92:ep129-ep134.
FULL TEXT  

Outreach visits to improve dementia care in general practice: a qualitative study
Dalsgaard et al.
Int J Qual Health Care 2007;19:267-273.
ABSTRACT | FULL TEXT  

Translating learning into practice: Lessons from the practice-based small group learning program
Armson et al.
cfp 2007;53:1477-1485.
ABSTRACT | FULL TEXT  

Evidence-Based Medicine, Part 1. An Introduction to Creating an Answerable Question and Searching the Evidence
Virgilio et al.
JAOA: Journal of the American Osteopathic Association 2007;107:295-297.
ABSTRACT | FULL TEXT  

Invited commentary.
Brennan
ptjournal 2007;87:1036-1037.
FULL TEXT  

Personal development plans and self-directed learning for healthcare professionals: are they evidence based?
Jennings
Postgrad. Med. J. 2007;83:518-524.
ABSTRACT | FULL TEXT  

Pediatric Obesity Management: Variation by Specialty and Awareness of Guidelines
Rhodes et al.
CLIN PEDIATR 2007;46:491-504.
ABSTRACT  

Does the Dental School Work Environment Promote Successful Academic Careers?
Trotman et al.
J Dent Educ 2007;71:713-725.
ABSTRACT | FULL TEXT  

Slow Progressive Acceptance of Intravenous Thrombolysis for Patients With Stroke by Rural Primary Care Physicians
Leira et al.
Arch Neurol 2007;64:518-521.
ABSTRACT | FULL TEXT  

What Is the Future of Electronic Learning in Radiology?
Flanders
RadioGraphics 2007;27:559-561.
FULL TEXT  

Multifaceted implementation of stroke prevention guidelines in primary care: cluster-randomised evaluation of clinical and cost effectiveness
Wright et al.
Qual Saf Health Care 2007;16:51-59.
ABSTRACT | FULL TEXT  

Effects of a comprehensive health assessment programme for Australian adults with intellectual disability: a cluster randomized trial
Lennox et al.
Int J Epidemiol 2007;36:139-146.
ABSTRACT | FULL TEXT  

Assessment of Clinical Skills Using Simulator Technologies
Srinivasan et al.
Acad. Psychiatry 2006;30:505-515.
ABSTRACT | FULL TEXT  

The impact of conducting a regional palliative care clinical study
Currow et al.
Palliat Med 2006;20:735-743.
ABSTRACT  

Vaccine Risk/Benefit Communication: Effect of an Educational Package for Public Health Nurses
Davis et al.
Health Educ Behav 2006;33:787-801.
ABSTRACT  

Will Financial Incentives Stimulate Quality Improvement? Reactions From Frontline Physicians
Teleki et al.
American Journal of Medical Quality 2006;21:367-374.
ABSTRACT  

Effectiveness of a guideline for venous thromboembolism prophylaxis in elderly post-acute care patients: a multicenter study with systematic ultrasonographic examination.
Sellier et al.
Arch Intern Med 2006;166:2065-2071.
ABSTRACT | FULL TEXT  

Systematic review of educational interventions in palliative care for primary care physicians
Alvarez and Agra
Palliat Med 2006;20:673-683.
ABSTRACT  

Adherence to mental health guidelines by Dutch occupational physicians
Rebergen et al.
Occup Med (Lond) 2006;56:461-468.
ABSTRACT | FULL TEXT  

An educational intervention to improve physician reporting of adverse drug reactions: a cluster-randomized controlled trial.
Figueiras et al.
JAMA 2006;296:1086-1093.
ABSTRACT | FULL TEXT  

The impact of quality assurance programming: a comparison of two canadian dental hygienist programs.
Asadoorian and Locker
J Dent Educ 2006;70:965-971.
ABSTRACT | FULL TEXT  

Optimizing Outcomes in Psychopharmacology Continuing Medical Education (CME): Measuring Learning and Attitudes That May Predict Knowledge Translation into Clinical Practice
Stahl et al.
Focus 2006;4:487.
ABSTRACT | FULL TEXT  

Impact of Continuing Education Interventions on Clinical Outcomes of Patients With Neck Pain Who Received Physical Therapy
Brennan et al.
ptjournal 2006;86:1251-1262.
ABSTRACT | FULL TEXT  

Improving Pediatric Prevention via the Internet: A Randomized, Controlled Trial
Christakis et al.
Pediatrics 2006;118:1157-1166.
ABSTRACT | FULL TEXT  

What Interventions Should Pharmacists Employ to Impact Health Practitioners' Prescribing Practices?
Grindrod et al.
The Annals of Pharmacotherapy 2006;40:1546-1557.
ABSTRACT | FULL TEXT  

Effects of Nurse Management on the Quality of Heart Failure Care in Minority Communities: A Randomized Trial
Sisk et al.
ANN INTERN MED 2006;145:273-283.
ABSTRACT | FULL TEXT  

Intimate Partner Violence Resource Materials: Assessment of Information Distribution
Edwardsen and Morse
J Interpers Violence 2006;21:971-981.
ABSTRACT  

PRISM-E: Comparison of Integrated Care and Enhanced Specialty Referral Models in Depression Outcomes
Krahn et al.
Psychiatr. Serv. 2006;57:946-953.
ABSTRACT | FULL TEXT  

Use of a Glucose Algorithm to Direct Diabetes Therapy Improves A1C Outcomes and Defines an Approach to Assess Provider Behavior.
Miller et al.
The Diabetes Educator 2006;32:533-545.
ABSTRACT | FULL TEXT  

The medicolegal importance of enhancing timeliness of documentation when using an anesthesia information system and the response to automated feedback in an academic practice.
Vigoda and Lubarsky
Anesth. Analg. 2006;103:131-136.
ABSTRACT | FULL TEXT  

A randomized clinical trial of clinician feedback to improve quality of care for inner-city children with asthma.
Kattan et al.
Pediatrics 2006;117:e1095-e1103.
ABSTRACT | FULL TEXT  

North american dental students' perspectives about their clinical education.
Henzi et al.
J Dent Educ 2006;70:361-377.
ABSTRACT | FULL TEXT  

Effectiveness of Centers for Disease Control and Prevention Recommendations for Outcomes of Acute Otitis Media
Bauchner et al.
Pediatrics 2006;117:1009-1017.
ABSTRACT | FULL TEXT  

Effectiveness of Academic Detailing on Breast Cancer Screening among Primary Care Physicians in an Underserved Community
Gorin et al.
J Am Board Fam Med 2006;19:110-121.
ABSTRACT | FULL TEXT  

Improving Ambulatory Prescribing Safety with a Handheld Decision Support System: A Randomized Controlled Trial
Berner et al.
J. Am. Med. Inform. Assoc. 2006;13:171-179.
ABSTRACT | FULL TEXT  

What the surgeon of tomorrow needs to know about evidence-based surgery.
Maier
Arch Surg 2006;141:317-323.
FULL TEXT  

Current Status of Medical Grand Rounds in Departments of Medicine at US Medical Schools
Mueller et al.
Mayo Clin Proc. 2006;81:313-321.
ABSTRACT | FULL TEXT  

Internet-Based Continuing Medical Education--Reply
Fordis et al.
JAMA 2006;295:758-759.
FULL TEXT  

Effects of educational outreach visits on prescribing of benzodiazepines and antipsychotic drugs to elderly patients in primary health care in southern Sweden
Midlov et al.
Fam Pract 2006;23:60-64.
ABSTRACT | FULL TEXT  

Predicting the Adoption of Electronic Health Records by Physicians: When Will Health Care be Paperless?
Ford et al.
J. Am. Med. Inform. Assoc. 2006;13:106-112.
ABSTRACT | FULL TEXT  

Development and Application of Clinical Prediction Rules to Improve Decision Making in Physical Therapist Practice
Childs and Cleland
ptjournal 2006;86:122-131.
FULL TEXT  

Determination of Professional Competency in a Rapidly Changing Environment
Wann
J Am Coll Cardiol 2005;46:1996-1998.
ABSTRACT | FULL TEXT  

Clinical Guidelines and Policies: Can they Improve Emergency Department Pain Management?
Ducharme
J Law Med Ethics 2005;33:783-790.