This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on Web of Science (658)  • Contact me when this article is cited  Related Content  • Related letter  • Similar articles in JAMA  Topic Collections  • Medical Practice  • Medical Education  • Review  • Alert me on articles by topic  Social Bookmarking   What's this?

Do Conferences, Workshops, Rounds, and Other Traditional Continuing Education Activities Change Physician Behavior or Health Care Outcomes?

Dave Davis, MD; Mary Ann Thomson O'Brien, MSc; Nick Freemantle, PhD; Fredric M. Wolf, PhD; Paul Mazmanian, PhD; Anne Taylor-Vaisey, MLS

JAMA. 1999;282:867-874.

Context  Although physicians report spending a considerable amount of time in continuing medical education (CME) activities, studies have shown a sizable difference between real and ideal performance, suggesting a lack of effect of formal CME.

Objective  To review, collate, and interpret the effect of formal CME interventions on physician performance and health care outcomes.

Data Sources  Sources included searches of the complete Research and Development Resource Base in Continuing Medical Education and the Specialised Register of the Cochrane Effective Practice and Organisation of Care Group, supplemented by searches of MEDLINE from 1993 to January 1999.

Study Selection  Studies were included in the analyses if they were randomized controlled trials of formal didactic and/or interactive CME interventions (conferences, courses, rounds, meetings, symposia, lectures, and other formats) in which at least 50% of the participants were practicing physicians. Fourteen of 64 studies identified met these criteria and were included in the analyses. Articles were reviewed independently by 3 of the authors.

Data Extraction  Determinations were made about the nature of the CME intervention (didactic, interactive, or mixed), its occurrence as a 1-time or sequenced event, and other information about its educational content and format. Two of 3 reviewers independently applied all inclusion/exclusion criteria. Data were then subjected to meta-analytic techniques.

Data Synthesis  The 14 studies generated 17 interventions fitting our criteria. Nine generated positive changes in professional practice, and 3 of 4 interventions altered health care outcomes in 1 or more measures. In 7 studies, sufficient data were available for effect sizes to be calculated; overall, no significant effect of these educational methods was detected (standardized effect size, 0.34; 95% confidence interval [CI], -0.22 to 0.97). However, interactive and mixed educational sessions were associated with a significant effect on practice (standardized effect size, 0.67; 95% CI, 0.01-1.45).

Conclusions  Our data show some evidence that interactive CME sessions that enhance participant activity and provide the opportunity to practice skills can effect change in professional practice and, on occasion, health care outcomes. Based on a small number of well-conducted trials, didactic sessions do not appear to be effective in changing physician performance.

Author Affiliations: Continuing Education and the Centre for Research in Education, University of Toronto, Faculty of Medicine, Toronto, Ontario (Dr Davis and Ms Taylor-Vaisey); School of Rehabilitation Science, McMaster University, and Social and Public Health Services, Region of Hamilton-Wentworth, Hamilton, Ontario (Ms O'Brien); Medicines Evaluation Group, Centre for Health Economics, University of York, York, England (Dr Freemantle); Department of Medical Education, University of Washington, Seattle (Dr Wolf); and Medical College of Virginia Campus, Virginia Commonwealth University, Richmond (Dr Mazmanian).

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

RELATED LETTER

Educating Authors and Reviewers of Economic Evaluations of Health Care
Afschin Gandjour, Tom Jefferson, Vittorio Demicheli, and Luke Vale
JAMA. 2002;288(8):959.
EXTRACT | FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Smoking As a Vital Sign: Prompts to Ask and Assess Increase Cessation Counseling
McCullough et al.
J Am Board Fam Med 2009;22:625-632.
ABSTRACT | FULL TEXT  

Improving colon cancer screening rates in primary care: a pilot study emphasising the role of the medical assistant
Baker et al.
Qual Saf Health Care 2009;18:355-359.
ABSTRACT | FULL TEXT  

Utilisation of laboratory services by health workers in a district hospital in Malawi
Mepham et al.
J. Clin. Pathol. 2009;62:935-938.
ABSTRACT | FULL TEXT  

Improved Clinical Outcome After Acute Myocardial Infarction in Hospitals Participating in a Swedish Quality Improvement Initiative
Carlhed et al.
Circ Cardiovasc Qual Outcomes 2009;2:458-464.
ABSTRACT | FULL TEXT  

Strategies to Promote Evidence-Based Practice in Pediatric Physical Therapy: A Formative Evaluation Pilot Project
Schreiber et al.
ptjournal 2009;89:918-933.
ABSTRACT | FULL TEXT  

Delayed Pediatric Office Follow-up of Newborns After Birth Hospitalization
Profit et al.
Pediatrics 2009;124:548-554.
ABSTRACT | FULL TEXT  

Virtual Reality Skills Training for Health Care Professionals in Alcohol Screening and Brief Intervention
Fleming et al.
J Am Board Fam Med 2009;22:387-398.
ABSTRACT | FULL TEXT  

Implementing Evidence-Based Practices for People With Schizophrenia
Drake et al.
Schizophr Bull 2009;35:704-713.
ABSTRACT | FULL TEXT  

Assessing and Managing All Aspects of Migraine: Migraine Attacks, Migraine-Related Functional Impairment, Common Comorbidities, and Quality of Life
Buse et al.
Mayo Clin Proc. 2009;84:422-435.
ABSTRACT | FULL TEXT  

Knowledge transfer principles as applied to sport concussion education
Provvidenza and Johnston
Br. J. Sports. Med. 2009;43:i68-i75.
ABSTRACT | FULL TEXT  

Medication errors in critical care: risk factors, prevention and disclosure
Camire et al.
CMAJ 2009;180:936-943.
FULL TEXT  

Continuing Medical Education Effect on Physician Knowledge: Effectiveness of Continuing Medical Education: American College of Chest Physicians Evidence-Based Educational Guidelines
Bordage et al.
Chest 2009;135:29S-36S.
ABSTRACT | FULL TEXT  

Education Techniques for Lifelong Learning: Lifelong Learning in the 21st Century and Beyond1
Collins
RadioGraphics 2009;29:613-622.
ABSTRACT | FULL TEXT  

ACMQ Launches Its New Comprehensive Textbook on Medical Quality Management
Varkey and Diamond
American Journal of Medical Quality 2009;24:77-78.
 

CPD and recertification: improving patient outcomes through focused learning
Bamrah and Bhugra
Adv. Psychiatr. Treat. 2009;15:2-6.
ABSTRACT | FULL TEXT  

Perspectives on Continuing Education in the Health Professions: Improving Health Care Through Lifelong Learning
Leach and Fletcher
Chest 2008;134:1299-1303.
ABSTRACT | FULL TEXT  

A Randomized Controlled Trial to Improve Lymph Node Assessment in Stage II Colon Cancer
Wright et al.
Arch Surg 2008;143:1050-1055.
ABSTRACT | FULL TEXT  

The Effect of a Quality Improvement Collaborative to Improve Antimicrobial Prophylaxis in Surgical Patients: A Randomized Trial
Kritchevsky et al.
ANN INTERN MED 2008;149:472-480.
ABSTRACT | FULL TEXT  

Outcomes Assessment of Dental Hygiene Clinical Teaching Workshops
Wallace and Infante
J Dent Educ 2008;72:1169-1176.
ABSTRACT | FULL TEXT  

Internet-Based Learning in the Health Professions: A Meta-analysis
Cook et al.
JAMA 2008;300:1181-1196.
ABSTRACT | FULL TEXT  

What do medical students experience as moral problems during their obstetric and gynaecology clerkship?
Olthuis and Dukel
J. Med. Ethics 2008;34:e2-e2.
ABSTRACT | FULL TEXT  

Development of a Core Competency Model for the Master of Public Health Degree
Calhoun et al.
AJPH 2008;98:1598-1607.
ABSTRACT | FULL TEXT  

Developing and introducing evidence based clinical practice guidelines for serious illness in Kenya
Irimu et al.
Arch. Dis. Child. 2008;93:799-804.
FULL TEXT  

Rethinking continuing medical education
Pisacane
BMJ 2008;337:a973-a973.
FULL TEXT  

Pharma and CME: View from the US
Fletcher
BMJ 2008;337:a1023-a1023.
FULL TEXT  

The Bright Futures Training Intervention Project: Implementing Systems to Support Preventive and Developmental Services in Practice
Lannon et al.
Pediatrics 2008;122:e163-e171.
ABSTRACT | FULL TEXT  

Effects on readiness to change of an educational intervention on depressive disorders for general physicians in primary care based on a modified Prochaska model--a randomized controlled study
Shirazi et al.
Fam Pract 2008;25:98-104.
ABSTRACT | FULL TEXT  

Associations of Conference Attendance With Internal Medicine In-Training Examination Scores
McDonald et al.
Mayo Clin Proc. 2008;83:449-453.
ABSTRACT | FULL TEXT  

Hospital Treatment of Patients With Ischemic Stroke or Transient Ischemic Attack Using the "Get With The Guidelines" Program
LaBresh et al.
Arch Intern Med 2008;168:411-417.
ABSTRACT | FULL TEXT  

Physician perceptions of managed care strategies, and impact of these on their clinical performance, in the South African private health sector
Pillay
Health Serv Manage Res 2008;21:1-13.
ABSTRACT | FULL TEXT  

Does Faculty Development Enhance Teaching Effectiveness?
Hendricson et al.
J Dent Educ 2007;71:1513-1533.
ABSTRACT | FULL TEXT  

Effect of a Rapid Response Team on Hospital-wide Mortality and Code Rates Outside the ICU in a Children's Hospital
Sharek et al.
JAMA 2007;298:2267-2274.
ABSTRACT | FULL TEXT  

Improving Asthma Care Through Recertification: A Cluster Randomized Trial
Simpkins et al.
Arch Intern Med 2007;167:2240-2248.
ABSTRACT | FULL TEXT  

Accreditation Council for Graduate Medical Education Competencies: Practice-Based Learning and Systems-Based Practice
Moskowitz and Nash
American Journal of Medical Quality 2007;22:351-382.
 

Improvement in Provider Immunization Knowledge and Behaviors Following a Peer Education Intervention
Boom et al.
CLIN PEDIATR 2007;46:706-717.
ABSTRACT  

Are Patient Decision Aids the Best Way to Improve Clinical Decision Making? Report of the IPDAS Symposium
Holmes-Rovner et al.
Med Decis Making 2007;27:599-608.
ABSTRACT  

Translating learning into practice: Lessons from the practice-based small group learning program
Armson et al.
cfp 2007;53:1477-1485.
ABSTRACT | FULL TEXT  

Improving Communication Between Doctors and Breast Cancer Patients
Stewart et al.
Ann Fam Med 2007;5:387-394.
ABSTRACT | FULL TEXT  

Teaching Evidence-Based Practice
Mullen et al.
Research on Social Work Practice 2007;17:574-582.
ABSTRACT  

Invited commentary.
Brennan
ptjournal 2007;87:1036-1037.
FULL TEXT  

Author Response
Austin and Graber
ptjournal 2007;87:1038-1038.
FULL TEXT  

Medical Home for Children With Hearing Loss: Physician Perspectives and Practices
Dorros et al.
Pediatrics 2007;120:288-294.
ABSTRACT | FULL TEXT  

Disease Management Intervention on Quality and Outcomes of Dementia Care
Vickrey et al.
ANN INTERN MED 2007;147:69-69.
FULL TEXT  

Pediatric Obesity Management: Variation by Specialty and Awareness of Guidelines
Rhodes et al.
CLIN PEDIATR 2007;46:491-504.
ABSTRACT  

Does the Dental School Work Environment Promote Successful Academic Careers?
Trotman et al.
J Dent Educ 2007;71:713-725.
ABSTRACT | FULL TEXT  

Challenges in Improving the Quality of Osteoporosis Care for Long-term Glucocorticoid Users: A Prospective Randomized Trial
Curtis et al.
Arch Intern Med 2007;167:591-596.
ABSTRACT | FULL TEXT  

Effectiveness of CancerGuides(R): A Study of an Integrative Cancer Care Training Program for Health Professionals
Staples et al.
Integr Cancer Ther 2007;6:14-24.
ABSTRACT  

Vaccine Risk/Benefit Communication: Effect of an Educational Package for Public Health Nurses
Davis et al.
Health Educ Behav 2006;33:787-801.
ABSTRACT  

Barriers to the Integration of Psychosocial Factors in Medicine: Results of a National Survey of Physicians
Astin et al.
J Am Board Fam Med 2006;19:557-565.
ABSTRACT | FULL TEXT  

Changing Physician Practice Behavior to Measure and Improve Clinical Outcomes
Schuster et al.
American Journal of Medical Quality 2006;21:394-400.
ABSTRACT  

Uncertainty in a world of regulation
Coles
Adv. Psychiatr. Treat. 2006;12:397-401.
ABSTRACT | FULL TEXT  

Systematic review of educational interventions in palliative care for primary care physicians
Alvarez and Agra
Palliat Med 2006;20:673-683.
ABSTRACT  

An educational intervention to improve physician reporting of adverse drug reactions: a cluster-randomized controlled trial.
Figueiras et al.
JAMA 2006;296:1086-1093.
ABSTRACT | FULL TEXT  

Optimizing Outcomes in Psychopharmacology Continuing Medical Education (CME): Measuring Learning and Attitudes That May Predict Knowledge Translation into Clinical Practice
Stahl et al.
Focus 2006;4:487.
ABSTRACT | FULL TEXT  

Impact of Continuing Education Interventions on Clinical Outcomes of Patients With Neck Pain Who Received Physical Therapy
Brennan et al.
ptjournal 2006;86:1251-1262.
ABSTRACT | FULL TEXT  

What Interventions Should Pharmacists Employ to Impact Health Practitioners' Prescribing Practices?
Grindrod et al.
The Annals of Pharmacotherapy 2006;40:1546-1557.
ABSTRACT | FULL TEXT  

Intimate Partner Violence Resource Materials: Assessment of Information Distribution
Edwardsen and Morse
J Interpers Violence 2006;21:971-981.
ABSTRACT  

National survey of psychotherapy training in psychiatry, psychology, and social work.
Weissman et al.
Arch Gen Psychiatry 2006;63:925-934.
ABSTRACT | FULL TEXT  

The medicolegal importance of enhancing timeliness of documentation when using an anesthesia information system and the response to automated feedback in an academic practice.
Vigoda and Lubarsky
Anesth. Analg. 2006;103:131-136.
ABSTRACT | FULL TEXT  

Education Techniques for Lifelong Learning: A Novel Standard-Compliant Audience Response System for Medical Education.
Streeter and Rybicki
RadioGraphics 2006;26:1243-1249.
ABSTRACT | FULL TEXT  

Pediatric resident education in palliative care: a needs assessment.
Kolarik et al.
Pediatrics 2006;117:1949-1954.
ABSTRACT | FULL TEXT  

Impact of physician asthma care education on patient outcomes.
Cabana et al.
Pediatrics 2006;117:2149-2157.
ABSTRACT | FULL TEXT  

North american dental students' perspectives about their clinical education.
Henzi et al.
J Dent Educ 2006;70:361-377.
ABSTRACT | FULL TEXT  

The Logic Behind a Multimethod Intervention to Improve Adherence to Clinical Practice Guidelines in a Nationwide Network of Primary Care Practices
Feifer et al.
Eval Health Prof 2006;29:65-88.
ABSTRACT  

Supervision of Students May Protect Academic Physicians from Cognitive Bias: A Study of Decision Making and Multiple Treatment Alternatives in Medicine
Roswarski and Murray
Med Decis Making 2006;26:154-161.
ABSTRACT  

Sufficiency and Stability of Evidence for Public Health Interventions Using Cumulative Meta-Analysis
Muellerleile and Mullen
AJPH 2006;96:515-522.
ABSTRACT | FULL TEXT  

Current Status of Medical Grand Rounds in Departments of Medicine at US Medical Schools
Mueller et al.
Mayo Clin Proc. 2006;81:313-321.
ABSTRACT | FULL TEXT  

Performance analysis of interactive multimodal CME retraining on attitude toward and application of OPCAB
Albert et al.
J. Thorac. Cardiovasc. Surg. 2006;131:154-162.
ABSTRACT | FULL TEXT  

Prevalence of Meperidine Use in Older Surgical Patients
Kornitzer et al.
Arch Surg 2006;141:76-81.
ABSTRACT | FULL TEXT  

Development and Application of Clinical Prediction Rules to Improve Decision Making in Physical Therapist Practice
Childs and Cleland
ptjournal 2006;86:122-131.
FULL TEXT  

Home Schooling
Edmunds
Ann. Thorac. Surg. 2005;80:1985-1987.
FULL TEXT  

Comparison of the Instructional Efficacy of Internet-Based CME With Live Interactive CME Workshops: A Randomized Controlled Trial
Fordis et al.
JAMA 2005;294:1043-1051.
ABSTRACT | FULL TEXT  

American Osteopathic Association Commitment to Quality and Lifelong Learning
Tunanidas and Burkhart
JAOA: Journal of the American Osteopathic Association 2005;105:404-407.
ABSTRACT | FULL TEXT  

Preferred Antibiotics for Treatment of Acute Otitis Media: Comparison of Practicing Pediatricians, General Practitioners, and Otolaryngologists
Pichichero
CLIN PEDIATR 2005;44:575-578.
ABSTRACT  

Delivery of Clinical Preventive Services in Family Medicine Offices
Crabtree et al.
Ann Fam Med 2005;3:430-435.
ABSTRACT | FULL TEXT  

Mandatory Continuing Education in Physical Therapy: Survey of Physical Therapists in States With and States Without a Mandate
Landers et al.
ptjournal 2005;85:861-871.
ABSTRACT | FULL TEXT  

Assessment of an intervention to train teaching hospital care providers in quality management
Francois et al.
Qual Saf Health Care 2005;14:234-239.
ABSTRACT | FULL TEXT  

Improving the ICU: Part 2
Garland
Chest 2005;127:2165-2179.
ABSTRACT | FULL TEXT  

How Much Does It Cost to Change the Behavior of Health Professionals? A Mathematical Model and an Application to Academic Detailing
Gandjour and Lauterbach
Med Decis Making 2005;25:341-347.
ABSTRACT  

Approaching Difficult Communication Tasks in Oncology
Back et al.
CA Cancer J Clin 2005;55:164-177.
ABSTRACT | FULL TEXT  

Primary Care Practice-Based Research Networks: Working at the Interface Between Research and Quality Improvement
Mold and Peterson
Ann Fam Med 2005;3:S12-S20.
ABSTRACT | FULL TEXT  

Improving compliance with hospital antibiotic guidelines: a time-series intervention analysis
Mol et al.
J Antimicrob Chemother 2005;55:550-557.
ABSTRACT | FULL TEXT  

Closing the Quality Chasm in Health Care: The Role of Critical Reading
Rivara and Stapleton
Arch Pediatr Adolesc Med 2005;159:394-395.
FULL TEXT  

Which GP deals better with depressed patients in primary care in Kastamonu, Turkey: the impacts of 'interest in psychiatry' and 'continuous medical education'
Yaman
Fam Pract 2005;22:223-223.
FULL TEXT  

The New Paradigm of Continuing Education in Surgery
Sachdeva
Arch Surg 2005;140:264-269.
ABSTRACT | FULL TEXT  

Training Young Pediatricians as Leaders for the 21st Century
Leslie et al.
Pediatrics 2005;115:765-773.
ABSTRACT | FULL TEXT  

Clinical and communication skills
Kidd et al.
BMJ 2005;330:374-375.
FULL TEXT  

The use of 'academic detailing' to promote tobacco-use cessation counseling in dental offices
ALBERT et al.
Journal of the American Dental Association 2004;135:1700-1706.
ABSTRACT | FULL TEXT  

Better Prescribing Project: a randomized controlled trial of the impact of case-based educational modules and personal prescribing feedback on prescribing for hypertension in primary care
Herbert et al.
Fam Pract 2004;21:575-581.
ABSTRACT | FULL TEXT  

Distance Communication Transfer of HIV Prevention Interventions to Service Providers
Kelly et al.
Science 2004;305:1953-1955.
ABSTRACT | FULL TEXT  

Crossing the Quality Chasm in Breast Cancer Care
Silliman
JCO 2004;22:3654-3656.
FULL TEXT  

A Multisite Randomized Trial of the Effects of Physician Education and Organizational Change in Chronic-Asthma Care: Health Outcomes of the Pediatric Asthma Care Patient Outcomes Research Team II Study
Lozano et al.
Arch Pediatr Adolesc Med 2004;158:875-883.
ABSTRACT | FULL TEXT  

Tobacco Dependence Curricula in Undergraduate Osteopathic Medical Education
Montalto et al.
JAOA: Journal of the American Osteopathic Association 2004;104:317-323.
ABSTRACT | FULL TEXT  

Preliminary Report on the Use of High-Fidelity Simulation in the Training of Study Coordinators Conducting a Clinical Research Protocol
Taekman et al.
Anesth. Analg. 2004;99:521-527.
ABSTRACT | FULL TEXT  

Closing the Gap Between Guidelines and Practice: Ensuring Safe and Healthy Beginnings
Lannon and Stark
Pediatrics 2004;114:494-496.
FULL TEXT  

A Three-Part Intervention To Change the Use of Hormone Replacement Therapy in Response to New Evidence
Roumie et al.
ANN INTERN MED 2004;141:118-125.
ABSTRACT | FULL TEXT