This Article  • Full text  • PDF  • eTables  • CME Course for This Article  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on ISI (12)  • Contact me when this article is cited  Related Content  • Related letters  • Related article  • Similar articles in JAMA  Topic Collections  • Informatics/ Internet in Medicine  • Internet  • Medical Practice  • Medical Education  • Quality of Care  • Evidence-Based Medicine  • Review  • Alert me on articles by topic  Social Bookmarking   What's this?

A Meta-analysis

David A. Cook, MD, MHPE; Anthony J. Levinson, MD, MSc; Sarah Garside, MD, PhD; Denise M. Dupras, MD, PhD; Patricia J. Erwin, MLS; Victor M. Montori, MD, MSc

JAMA. 2008;300(10):1181-1196.

Context  The increasing use of Internet-based learning in health professions education may be informed by a timely, comprehensive synthesis of evidence of effectiveness.

Objectives  To summarize the effect of Internet-based instruction for health professions learners compared with no intervention and with non-Internet interventions.

Data Sources  Systematic search of MEDLINE, Scopus, CINAHL, EMBASE, ERIC, TimeLit, Web of Science, Dissertation Abstracts, and the University of Toronto Research and Development Resource Base from 1990 through 2007.

Study Selection  Studies in any language quantifying the association of Internet-based instruction and educational outcomes for practicing and student physicians, nurses, pharmacists, dentists, and other health care professionals compared with a no-intervention or non-Internet control group or a preintervention assessment.

Data Extraction  Two reviewers independently evaluated study quality and abstracted information including characteristics of learners, learning setting, and intervention (including level of interactivity, practice exercises, online discussion, and duration).

Data Synthesis  There were 201 eligible studies. Heterogeneity in results across studies was large (I²  79%) in all analyses. Effect sizes were pooled using a random effects model. The pooled effect size in comparison to no intervention favored Internet-based interventions and was 1.00 (95% confidence interval [CI], 0.90-1.10; P < .001; n = 126 studies) for knowledge outcomes, 0.85 (95% CI, 0.49-1.20; P < .001; n = 16) for skills, and 0.82 (95% CI, 0.63-1.02; P < .001; n = 32) for learner behaviors and patient effects. Compared with non-Internet formats, the pooled effect sizes (positive numbers favoring Internet) were 0.10 (95% CI, –0.12 to 0.32; P = .37; n = 43) for satisfaction, 0.12 (95% CI, 0.003 to 0.24; P = .045; n = 63) for knowledge, 0.09 (95% CI, –0.26 to 0.44; P = .61; n = 12) for skills, and 0.51 (95% CI, –0.24 to 1.25; P = .18; n = 6) for behaviors or patient effects. No important treatment-subgroup interactions were identified.

Conclusions  Internet-based learning is associated with large positive effects compared with no intervention. In contrast, effects compared with non-Internet instructional methods are heterogeneous and generally small, suggesting effectiveness similar to traditional methods. Future research should directly compare different Internet-based interventions.

Author Affiliations: College of Medicine (Drs Cook, Dupras, and Montori and Ms Erwin), Office of Education Research (Dr Cook), and Knowledge and Encounter Research Unit (Dr Montori), Mayo Clinic, Rochester, Minnesota, and McMaster University, Hamilton, Ontario (Drs Levinson and Garside).

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati     What's this?

RELATED LETTERS

Internet-Based Education for Health Professionals
Geoff Wong
JAMA. 2009;301(6):598-599.
EXTRACT | FULL TEXT  

Internet-Based Education for Health Professionals
Rita Banzi, Ivan Moschetti, and Lorenzo Moja
JAMA. 2009;301(6):599.
EXTRACT | FULL TEXT  

RELATED ARTICLE

Internet-Based Education for Health Professionals
Geoff Wong
JAMA. 2009;301(6):598-599.
EXTRACT | FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

ACGME competencies in neurology: Web-based objective simulated computerized clinical encounters
Kash et al.
Neurology 2009;72:893-898.
ABSTRACT | FULL TEXT  

The American College of Chest Physicians Evidence-Based Educational Guidelines for Continuing Medical Education Interventions: A Critical Review of Evidence-Based Educational Guidelines
Norman
Chest 2009;135:834-837.
ABSTRACT | FULL TEXT  

The Challenges of Developing Online Learning
CIVIDINO
The Journal of Rheumatology 2009;36:470-471.
FULL TEXT  

Internet-Based Education for Health Professionals
Banzi et al.
JAMA 2009;301:599-599.
FULL TEXT  

Internet-Based Education for Health Professionals
Wong
JAMA 2009;301:598-599.
FULL TEXT  

All you need to read in the other general journals
BMJ 2008;337:a1661-a1661.
FULL TEXT