This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on Web of Science (60)  • Contact me when this article is cited  Related Content  • Related letter  • Similar articles in JAMA  Topic Collections  • Journalology/ Peer Review/ Authorship  • Alert me on articles by topic  Social Bookmarking   What's this?

Islands in Search of Continents?

Michael Clarke, DPhil; Iain Chalmers, MSc

JAMA. 1998;280:280-282.

Context.— Several journals have adopted the Consolidated Standards of Reporting Trials (CONSORT) recommendations to make assessment of the quality of randomized controlled trials (RCTs) easier. One of these recommendations is that the trial's results be discussed in light of the totality of the available evidence.

Objective.— To assess the extent to which reports of RCTs published in 5 general medical journals have discussed new results in light of all available evidence.

Design.— Assessment of the discussion sections in all 26 reports of RCTs published during May 1997 in Annals of Internal Medicine, BMJ, JAMA, The Lancet, and The New England Journal of Medicine.

Main Outcome Measure.— The inclusion or mention of a systematic review in the discussion section of each article.

Results.— In only 2 articles were the RCT's results discussed in the context of an updated systematic review of earlier trials. In a further 4 articles, references were made to relevant systematic reviews, but no attempts were made to integrate the results of the new trials in updated versions of these reviews. One article was probably the first published trial to address the question studied. The remaining 19 articles included no evidence that any systematic attempt had been made to set the reported trial's results in the context of previous trials.

Conclusion.— There is little evidence that journals have adequately implemented the CONSORT recommendation that results of an RCT be discussed in light of the totality of the available evidence.

From the Clinical Trial Service Unit, Oxford University (Dr Clarke), and the United Kingdom Cochrane Centre (Drs Clarke and Chalmers), Oxford, England.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

RELATED LETTER

Quality of Evidence for Treatment of Prostate Cancer
Mike Clarke and Timothy J. Wilt
JAMA. 2000;284(14):1785-1786.
EXTRACT | FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Getting a better grip on research: the comfort of opinion
Maskrey et al.
InnovAiT 2009;2:679-686.
ABSTRACT | FULL TEXT  

Interpreting Trial Results in Light of Conflicting Evidence: A Bayesian Analysis of Adjuvant Chemotherapy for Non-Small-Cell Lung Cancer
Miksad et al.
JCO 2009;27:2245-2252.
ABSTRACT | FULL TEXT  

Improving the Clarity and Transparency of Reporting Health Research: a Shared Obligation and Responsibility
Needleman et al.
JDR 2008;87:894-895.
FULL TEXT  

Evaluation of networks of randomized trials
Salanti et al.
Stat Methods Med Res 2008;17:279-301.
ABSTRACT  

Why promote the findings of single research studies?
Wilson et al.
BMJ 2008;336:722-722.
FULL TEXT  

Systematically Retrieving Research: A Case Study Evaluating Seven Databases
Taylor et al.
Research on Social Work Practice 2007;17:697-706.
ABSTRACT  

Reports of clinical trials should begin and end with up-to-date systematic reviews of other relevant evidence: a status report
Clarke et al.
JRSM 2007;100:187-190.
ABSTRACT | FULL TEXT  

One relative risk versus two odds ratios: implications for meta-analyses involving paired and unpaired binary data
Zou
Clin Trials 2007;4:25-31.
ABSTRACT  

Randomized controlled trials of aprotinin in cardiac surgery: could clinical equipoise have stopped the bleeding?
Fergusson et al.
Clin Trials 2005;2:218-232.
ABSTRACT  

Introduction to Cumulative Meta-analysis in Dentistry: Lessons Learned from Undertaking a Cumulative Meta-analysis in Periodontology
Moles et al.
JDR 2005;84:345-349.
ABSTRACT | FULL TEXT  

From knowledge to practice in chronic cardiovascular disease: a long and winding road
Majumdar et al.
J Am Coll Cardiol 2004;43:1738-1742.
ABSTRACT | FULL TEXT  

The Hidden Research Paper
Horton
JAMA 2002;287:2775-2778.
ABSTRACT | FULL TEXT  

Discussion Sections in Reports of Controlled Trials Published in General Medical Journals
Clarke et al.
JAMA 2002;287:2799-2801.
ABSTRACT | FULL TEXT  

A Brief History of Research Synthesis
Chalmers et al.
Eval Health Prof 2002;25:12-37.
ABSTRACT  

Reporting the clinical importance of randomized controlled trials
Moher et al.
CMAJ 2002;166:711-712.
FULL TEXT  

Revisiting the Cochrane Collaboration
Clarke and Langhorne
BMJ 2001;323:821-821.
FULL TEXT  

Commentary: Toward systematic reviews in epidemiology
Bracken
Int J Epidemiol 2001;30:954-957.
FULL TEXT  

Use of the CONSORT Statement and Quality of Reports of Randomized Trials: A Comparative Before-and-After Evaluation
Moher et al.
JAMA 2001;285:1992-1995.
ABSTRACT | FULL TEXT  

The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman et al.
ANN INTERN MED 2001;134:663-694.
ABSTRACT | FULL TEXT  

Scientific and Ethical Issues in Equivalence Trials
Djulbegovic and Clarke
JAMA 2001;285:1206-1208.
FULL TEXT  

Lessons for search strategies from a systematic review, in The Cochrane Library, of nutritional supplementation trials in patients after hip fracture
Avenell et al.
Am. J. Clin. Nutr. 2001;73:505-510.
ABSTRACT | FULL TEXT  

Quality of Evidence for Treatment of Prostate Cancer
Clarke and Wilt
JAMA 2000;284:1785-1786.
FULL TEXT  

Evidence-based medicine: a commentary on common criticisms
Straus and McAlister
CMAJ 2000;163:837-841.
ABSTRACT | FULL TEXT  

Electronic Trial Banks: A Complementary Method for Reporting Randomized Trials
Sim et al.
Med Decis Making 2000;20:440-450.
ABSTRACT  

Evaluating "payback" on biomedical research
Chalmers et al.
BMJ 2000;321:566-566.
FULL TEXT  

Helping Physicians To Keep Abreast of the Medical Literature: Medical and Philosophical Commentaries, 1773-1795
Chalmers and Trohler
ANN INTERN MED 2000;133:238-243.
FULL TEXT  

Structuring the discussion of scientific papers
Jefferson et al.
BMJ 1999;319:580-580.
FULL TEXT  

Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman
ANN INTERN MED 1999;130:995-1004.
ABSTRACT | FULL TEXT  

Standing Statistics Right Side Up
Davidoff
ANN INTERN MED 1999;130:1019-1021.
FULL TEXT  

The CONSORT Statement: Will It Lead to Improved Reporting of Clinical Trials in Ophthalmology?
Hawkins
Arch Ophthalmol 1999;117:677-680.
FULL TEXT  

Unbiased, relevant, and reliable assessments in health care
Chalmers
BMJ 1998;317:1167-1168.
FULL TEXT  

Peer Review in Prague
Rennie
JAMA 1998;280:214-215.
FULL TEXT