 |
|
Randomized Trials Stopped Early for Benefit
A Systematic Review
Victor M. Montori, MD, MSc;
P. J. Devereaux, MD;
Neill K. J. Adhikari, MD;
Karen E. A. Burns, MD;
Christoph H. Eggert, MD;
Matthias Briel, MD;
Christina Lacchetti, MHSc;
Teresa W. Leung, BHSc;
Elizabeth Darling, RM, BHSc;
Dianne M. Bryant, PhD;
Heiner C. Bucher, MD, MPH;
Holger J. Schünemann, MD, PhD;
Maureen O. Meade, MD, MSc;
Deborah J. Cook, MD, MSc;
Patricia J. Erwin, MLS;
Amit Sood, MD;
Richa Sood, MD;
Benjamin Lo, MD;
Carly A. Thompson, BHSc;
Qi Zhou, PhD;
Edward Mills, PhD;
Gordon H. Guyatt, MD, MSc
JAMA. 2005;294:2203-2209.
Context Randomized clinical trials (RCTs) that stop earlier than planned because of apparent benefit often receive great attention and affect clinical practice. Their prevalence, the magnitude and plausibility of their treatment effects, and the extent to which they report information about how investigators decided to stop early are, however, unknown.
Objective To evaluate the epidemiology and reporting quality of RCTs involving interventions stopped early for benefit.
Data Sources Systematic review up to November 2004 of MEDLINE, EMBASE, Current Contents, and full-text journal content databases to identify RCTs stopped early for benefit.
Study Selection Randomized clinical trials of any intervention reported as having stopped early because of results favoring the intervention. There were no exclusion criteria.
Data Extraction Twelve reviewers working independently and in duplicate abstracted data on content area and type of intervention tested, reporting of funding, type of end point driving study termination, treatment effect, length of follow-up, estimated sample size and total sample studied, role of a data and safety monitoring board in stopping the study, number of interim analyses planned and conducted, and existence and type of monitoring methods, statistical boundaries, and adjustment procedures for interim analyses and early stopping.
Data Synthesis Of 143 RCTs stopped early for benefit, the majority (92) were published in 5 high-impact medical journals. Typically, these were industry-funded drug trials in cardiology, cancer, and human immunodeficiency virus/AIDS. The proportion of all RCTs published in high-impact journals that were stopped early for benefit increased from 0.5% in 1990-1994 to 1.2% in 2000-2004 (P<.001 for trend). On average, RCTs recruited 63% (SD, 25%) of the planned sample and stopped after a median of 13 (interquartile range [IQR], 3-25) months of follow-up, 1 interim analysis, and when a median of 66 (IQR, 23-195) patients had experienced the end point driving study termination (event). The median risk ratio among truncated RCTs was 0.53 (IQR, 0.28-0.66). One hundred thirty-five (94%) of the 143 RCTs did not report at least 1 of the following: the planned sample size (n = 28), the interim analysis after which the trial was stopped (n = 45), whether a stopping rule informed the decision (n = 48), or an adjusted analysis accounting for interim monitoring and truncation (n = 129). Trials with fewer events yielded greater treatment effects (odds ratio, 28; 95% confidence interval, 11-73).
Conclusions RCTs stopped early for benefit are becoming more common, often fail to adequately report relevant information about the decision to stop early, and show implausibly large treatment effects, particularly when the number of events is small. These findings suggest clinicians should view the results of such trials with skepticism.
Author Affiliations: Department of Clinical Epidemiology and Biostatistics (Drs Montori, Devereaux, Adhikari, Burns, Bryant, Schünemann, Meade, Cook, Zhou, Mills, and Guyatt and Ms Lacchetti and Darling), Bachelor of Health Sciences Programme (Mss Leung and Thompson), and Department of Medicine (Drs Devereaux, Mead, Cook, Lo, and Guyatt), McMaster University, Hamilton, Ontario; Department of Medicine, Mayo Clinic College of Medicine, Rochester, Minn (Drs Montori, Eggert, A. Sood, and R. Sood and Ms Erwin); Interdepartmental Division of Critical Care, University of Toronto, Toronto, Ontario (Drs Adhikari and Burns); Basel Institute for Clinical Epidemiology, University Hospital, Basel, Switzerland (Drs Briel and Bucher); and Departments of Medicine and Social and Preventive Medicine, University at Buffalo, Buffalo, NY and Division of Clinical Research Development and INFORMAtion Translation, Italian National Cancer Institute Regina Elena, Rome, Italy (Dr Schünemann).
RELATED ARTICLES
When (Not) to Stop a Clinical Trial for Benefit
Stuart J. Pocock
JAMA. 2005;294(17):2228-2230.
EXTRACT
| FULL TEXT
Randomized Controlled Trials
Janet M. Torpy, Cassio Lynm, and Richard M. Glass
JAMA. 2005;294(17):2262.
EXTRACT
| FULL TEXT
THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES
|
Reply: Ethical recruitment of patients for PGS trial
Ankum et al.
Hum Reprod 2008;23:1472-1473.
FULL TEXT
Randomized Trials in Hemodialysis Patients: Time to Step Up to the Plate
Tonelli
JAMA 2008;299:2205-2207.
FULL TEXT
Selective serotonin reuptake inhibitors for unipolar depression: a systematic review of classic long-term randomized controlled trials
Deshauer et al.
CMAJ 2008;178:1293-1301.
ABSTRACT
| FULL TEXT
What is "quality of evidence" and why is it important to clinicians?
Guyatt et al.
BMJ 2008;336:995-998.
FULL TEXT
When Should Data and Safety Monitoring Committees Share Interim Results in Cardiovascular Trials?
Borer et al.
JAMA 2008;299:1710-1712.
FULL TEXT
Stopping a trial early in oncology: for patients or for industry?
Trotta et al.
Ann Oncol 2008;0:mdn042v4-mdn042.
ABSTRACT
| FULL TEXT
Randomized Trials in Oncology Stopped Early for Benefit
Wilcox et al.
JCO 2008;26:18-19.
FULL TEXT
Putting evidence into context: some advice for guideline writers
Dartnell et al.
Evid. Based Nurs. 2008;11:6-8.
FULL TEXT
IVF with preimplantation genetic screening, a promising new treatment with unexpectedly negative health outcomes: the Hippocratic role of Data Monitoring Committees
Ankum et al.
Hum Reprod 2008;23:1-3.
ABSTRACT
| FULL TEXT
Sodium Bicarbonate is Associated with an Increased Incidence of Contrast Nephropathy: A Retrospective Cohort Study of 7977 Patients at Mayo Clinic
From et al.
CJASN 2008;3:10-18.
ABSTRACT
| FULL TEXT
Cooling for Neonatal Hypoxic Ischemic Encephalopathy: Do We Have the Answer?
Kirpalani et al.
Pediatrics 2007;120:1126-1130.
FULL TEXT
Putting evidence into context: some advice for guideline writers
Dartnell et al.
Evid. Based Med. 2007;12:130-132.
FULL TEXT
Low-Dose Steroids in ARDS
Fremont and Rice
Chest 2007;132:1095-1095.
FULL TEXT
An Update on the Diagnosis of Adrenal Insufficiency and the Use of Corticotherapy in Critical Illness
Thomas and Fraser
The Annals of Pharmacotherapy 2007;41:1456-1465.
ABSTRACT
| FULL TEXT
Ethical Issues in Stopping Randomized Trials Early Because of Apparent Benefit
Mueller et al.
ANN INTERN MED 2007;146:878-881.
ABSTRACT
| FULL TEXT
Stopping at Nothing? Some Dilemmas of Data Monitoring in Clinical Trials
Goodman
ANN INTERN MED 2007;146:882-887.
ABSTRACT
| FULL TEXT
Combination Therapy for Uncomplicated Falciparum Malaria in Ugandan Children: A Randomized Trial
Dorsey et al.
JAMA 2007;297:2210-2219.
ABSTRACT
| FULL TEXT
Rescue Angioplasty or Repeat Fibrinolysis After Failed Fibrinolytic Therapy for ST-Segment Myocardial Infarction: A Meta-Analysis of Randomized Trials
Wijeysundera et al.
J Am Coll Cardiol 2007;49:422-430.
ABSTRACT
| FULL TEXT
Response to Letter Regarding Article, "Aspirin Use and Outcomes in a Community-Based Cohort of 7352 Patients Discharged After First Hospitalization for Heart Failure"
McAlister et al.
Circulation 2007;115:e55-e55.
FULL TEXT
Current controversies in data monitoring for clinical trials
Pocock
Clin Trials 2006;3:513-521.
ABSTRACT
A public health perspective on research ethics
Buchanan and Miller
J. Med. Ethics 2006;32:729-733.
ABSTRACT
| FULL TEXT
Preoperative intensive inspiratory muscle training to prevent postoperative pulmonary complications in high-risk patients undergoing CABG surgery: a randomized clinical trial.
Hulzebos et al.
JAMA 2006;296:1851-1857.
ABSTRACT
| FULL TEXT
Clinical trial design issues: at least 10 things you should look for in clinical trials.
Glasser and Howard
J Clin Pharmacol 2006;46:1106-1115.
ABSTRACT
| FULL TEXT
Survival with aromatase inhibitors and inactivators versus standard hormonal therapy in advanced breast cancer: meta-analysis.
Mauri et al.
JNCI J Natl Cancer Inst 2006;98:1285-1291.
ABSTRACT
| FULL TEXT
Have ALLHAT, ANBP2, ASCOT-BPLA, and So Forth Improved Our Knowledge About Better Hypertension Care?
Sawicki and McGauran
Hypertension 2006;48:1-7.
FULL TEXT
Intensive insulin therapy in the medical ICU.
Hammer et al.
NEJM 2006;354:2069-2071.
FULL TEXT
Clinical Trials in the Wake of Vioxx: Requiring Statistically Extreme Evidence of Benefit to Ensure the Safety of New Drugs
Roth-Cline
Circulation 2006;113:2253-2259.
FULL TEXT
Update in critical care 2005.
Milbrandt et al.
Am. J. Respir. Crit. Care Med. 2006;173:833-841.
FULL TEXT
The cost of life: should it matter to doctors?
Gianni
Ann Oncol 2006;17:357-358.
FULL TEXT
More drug trials end early hiding potential problems
BMJ 2005;331:1390-1390.
FULL TEXT
What's new in the other general journals
Tonks
BMJ 2005;331:1105-1106.
FULL TEXT
When (Not) to Stop a Clinical Trial for Benefit
Pocock
JAMA 2005;294:2228-2230.
FULL TEXT
|
