This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on ISI (18)  • Contact me when this article is cited  Related Content  • Related article  • Similar articles in JAMA

Richard Horton, FRCP

JAMA. 2002;287:2843-2847.

Context  Letters to the editor are an important means for ensuring accountability of authors and editors. They form a part of the postpublication peer review process. I studied the critical footprint made in the medical literature by 3 randomized trials (Hypertension Optimal Treatment [HOT], Captopril Prevention Project [CAPPP], and Swedish Trial in Old Patients with Hypertension 2 [STOP-2]) published in The Lancet and investigated the extent to which that footprint was preserved in shaping clinical knowledge.

Methods  Qualitative appraisal of the criticism of each trial, taken from published letters. Agreed weaknesses and unanswered criticisms were identified from the authors' reply. I searched MEDLINE for practice guidelines published after the trial report and sought evidence for incorporation of criticism into these guidelines.

Results  From the time of publication to October 2000, HOT was cited in 9 of 36 practice guidelines; CAPPP, in 6 of 36; and STOP-2, not at all. HOT received 14 published criticisms, 5 comments, and 3 questions, of which 15 were responded to. Only 1 criticism, lack of power, was referred to in 1 guideline. CAPPP received 14 criticisms, 9 comments, and 3 questions, of which 8 were responded to. Only 1 criticism, imbalances between groups, was referred to in 1 guideline. STOP-2 received 12 criticisms, 9 comments, and 3 questions, of which only 6 were responded to.

Conclusions  More than half of all criticism made in correspondence went unanswered by authors. Important weaknesses in trials were ignored in subsequently published practice guidelines. Failure to recognize the critical footprint of primary research weakens the validity of guidelines and distorts clinical knowledge.

Author Affiliation: Dr Horton is Editor of The Lancet, London, England.

RELATED ARTICLE

June 5, 2002
JAMA. 2002;287(21):2875-2876.
EXTRACT | FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

The ups and downs of peer review
Benos et al.
Adv. Physiol. Educ. 2007;31:145-152.
ABSTRACT | FULL TEXT  

RE: "CANCER INCIDENCE AMONG PESTICIDE APPLICATORS EXPOSED TO ALACHLOR IN THE AGRICULTURAL HEALTH STUDY"
Poole et al.
Am J Epidemiol 2005;161:101-102.
FULL TEXT