This Article  • References  • Full text PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Contact me when this article is cited  Related Content  • Similar articles in JAMA  Social Bookmarking   What's this?

Follow-up of Applications Submitted to Two Institutional Review Boards

Kay Dickersin, PhD; Yuan-I Min, MPH, MHS; Curtis L Meinert, PhD

JAMA. 1992;267(3):374-378.

Abstract
Objective.
—To investigate factors associated with the publication of research findings, in particular, the association between "significant" results and publication.

Design.
—Follow-up study.

Setting.
—Studies approved in 1980 or prior to 1980 by the two institutional review boards that serve The Johns Hopkins Health Institutions—one that serves the School of Medicine and Hospital and the other that serves the School of Hygiene and Public Health.

Population.
—A total of 737 studies were followed up.

Results.
—Of the studies for which analyses had been reported as having been performed at the time of interview, 81% from the School of Medicine and Hospital and 66% from the School of Hygiene and Public Health had been published. Publication was not associated with sample size, presence of a comparison group, or type of study (eg, observational study vs clinical trial). External funding and multiple data collection sites were positively associated with publication. There was evidence of publication bias in that for both institutional review boards there was an association between results reported to be significant and publication (adjusted odds ratio, 2.54; 95% confidence interval, 1.63 to 3.94). Contrary to popular opinion, publication bias originates primarily with investigators, not journal editors: only six of the 124 studies not published were reported to have been rejected for publication.

Conclusion.
—There is a statistically significant association between significant results and publication.

(JAMA. 1992;267:374-378)

Author Affiliations
From the Department of Ophthalmology, University of Maryland School of Medicine, Baltimore (Dr Dickersin) and the Department of Epidemiology, The Johns Hopkins University School of Hygiene and Public Health, Baltimore, Md (Ms Min and Dr Meinert).

Footnotes
Reprint requests to Department of Ophthalmology, University of Maryland School of Medicine, 419 W Redwood St, Suite 460, Baltimore, MD 21201 (Dr Dickersin).

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Outcome Reporting in Industry-Sponsored Trials of Gabapentin for Off-Label Use
Vedula et al.
NEJM 2009;361:1963-1971.
ABSTRACT | FULL TEXT  

Evaluation of the Potential Excess of Statistically Significant Findings in Published Genetic Association Studies: Application to Alzheimer's Disease
Kavvoura et al.
Am J Epidemiol 2008;168:855-865.
ABSTRACT | FULL TEXT  

Interpreting Results of Clinical Trials: A Conceptual Framework
Singh et al.
CJASN 2008;3:1246-1252.
FULL TEXT  

Clinical research projects at a German medical faculty: follow-up from ethical approval to publication and citation by others
Blumle et al.
J. Med. Ethics 2008;34:e20-e20.
ABSTRACT | FULL TEXT  

Reporting Bias in Diagnostic and Prognostic Studies: Time for Action
Rifai et al.
Clin. Chem. 2008;54:1101-1103.
FULL TEXT  

Status of healthcare studies submitted to UK research ethics committees for approval in 2004-5
Arshad and Arkwright
J. Med. Ethics 2008;34:393-395.
ABSTRACT | FULL TEXT  

Publication Bias in Orthopaedic Research: An Analysis of Scientific Factors Associated with Publication in The Journal of Bone and Joint Surgery (American Volume)
Okike et al.
JBJS 2008;90:595-601.
ABSTRACT | FULL TEXT  

Systematic Review and Meta-analysis: When One Study Is Just not Enough
Garg et al.
CJASN 2008;3:253-260.
FULL TEXT  

Hormesis and precaution: the twain shall meet
Ricci and MacDonald
Hum Exp Toxicol 2007;26:877-889.
ABSTRACT  

Meta-analysis of studies of passive smoking and lung cancer: effects of study type and continent
Taylor et al.
Int J Epidemiol 2007;36:1048-1059.
ABSTRACT | FULL TEXT  

Eligibility Criteria of Randomized Controlled Trials--Reply
Fowler and Van Spall
JAMA 2007;298:39-40.
FULL TEXT  

An exploratory test for an excess of significant findings
Ioannidis and Trikalinos
Clin Trials 2007;4:245-253.
ABSTRACT  

Creating an Academic Career in Respiratory Medicine: Take-Home Messages From a Unique Symposium
Eikje and Barron
Chest 2007;131:1967-1969.
FULL TEXT  

Commercially Funded and United States-Based Research Is More Likely to Be Published; Good-Quality Studies with Negative Outcomes Are Not
Lynch et al.
JBJS 2007;89:1010-1018.
ABSTRACT | FULL TEXT  

Oral presentation bias: a retrospective cohort study
Decullier and Chapuis
J. Epidemiol. Community Health 2007;61:190-193.
ABSTRACT | FULL TEXT  

Clinical trial registration at Tobacco Control
Bero
Tobacco Control 2006;15:417-418.
FULL TEXT  

Critical appraisal and positive outcome bias in case reports published in brazilian dental journals.
Oliveira and Leles
J Dent Educ 2006;70:869-874.
ABSTRACT | FULL TEXT  

Bias in Clinical Intervention Research
Gluud
Am J Epidemiol 2006;163:493-501.
ABSTRACT | FULL TEXT  

Systematic reviews of meta-analyses: applications and limitations
Delgado-Rodriguez
J. Epidemiol. Community Health 2006;60:90-92.
FULL TEXT  

Negative Results and Impact Factor: A Lesson From Neonatology
Littner et al.
Arch Pediatr Adolesc Med 2005;159:1036-1037.
ABSTRACT | FULL TEXT  

Assessment of publication bias in meta-analyses of cardiovascular diseases
Palma and Delgado-Rodriguez
J. Epidemiol. Community Health 2005;59:864-869.
ABSTRACT | FULL TEXT  

Fate of biomedical research protocols and publication bias in France: retrospective cohort study
Decullier et al.
BMJ 2005;331:19.
ABSTRACT | FULL TEXT  

Meeting our Ethical Obligations in Medical Publishing: Responsibilities of Editors, Authors, and Readers of Peer-Reviewed Journals
Albert et al.
Arch Ophthalmol 2005;123:684-686.
FULL TEXT  

Evaluation of New Treatments in Radiation Oncology: Are They Better Than Standard Treatments?
Soares et al.
JAMA 2005;293:970-978.
ABSTRACT | FULL TEXT  

Consistency in gene-Alzheimer's disease association studies
Llorca et al.
J. Epidemiol. Community Health 2005;59:83-85.
FULL TEXT  

Task force 2: Investigator participation in clinical research
Califf et al.
J Am Coll Cardiol 2004;44:1729-1736.
FULL TEXT  

Task Force 2: Investigator Participation in Clinical Research
Califf et al.
Circulation 2004;110:2517-2524.
FULL TEXT  

Factors Influencing the Publication of Randomized Controlled Trials in Child Health Research
Hartling et al.
Arch Pediatr Adolesc Med 2004;158:983-987.
ABSTRACT | FULL TEXT  

Breaching the Contract: The Ethics of Nonpublication of Research Studies
Dowd
Arch Pediatr Adolesc Med 2004;158:1014-1015.
FULL TEXT  

Registering CIHR-funded randomized controlled trials: a global public good
Moher and Bernstein
CMAJ 2004;171:750-751.
FULL TEXT  

Challenges for Evidence-Based Physical Therapy: Accessing and Interpreting High-Quality Evidence on Therapy
Maher et al.
ptjournal 2004;84:644-654.
ABSTRACT | FULL TEXT  

Subsequent Publication of Orally Presented Original Studies within 5 Years after 1995 RSNA Scientific Assembly
Arrive et al.
Radiology 2004;232:101-106.
ABSTRACT | FULL TEXT  

The Decreasing Prevalence of Reversible Dementias: An Updated Meta-analysis
Clarfield
Arch Intern Med 2003;163:2219-2229.
ABSTRACT | FULL TEXT  

Factors Associated With Failure to Publish Large Randomized Trials Presented at an Oncology Meeting
Krzyzanowska et al.
JAMA 2003;290:495-501.
ABSTRACT | FULL TEXT  

Appraising Systematic Reviews and Meta-analyses
Bigby and Williams
Arch Dermatol 2003;139:795-798.
ABSTRACT | FULL TEXT  

Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin et al.
BMJ 2003;326:1167-1170.
ABSTRACT | FULL TEXT  

Interpreting Negative Results: Postpartum Interview Position Not Associated With Improved Outcomes
Mabry et al.
Arch Pediatr Adolesc Med 2003;157:333-335.
FULL TEXT  

Treatment of Systemic Hypertension in Patients With Pulmonary Disease: COPD and Asthma
Dart et al.
Chest 2003;123:222-243.
ABSTRACT | FULL TEXT  

Interventions to Enhance Patient Adherence to Medication Prescriptions: Scientific Review
McDonald et al.
JAMA 2002;288:2868-2879.
ABSTRACT | FULL TEXT  

Meta-Analyses of Therapies for Postmenopausal Osteoporosis * I. Systematic Reviews of Randomized Trials in Osteoporosis: Introduction and Methodology
Cranney et al.
Endocr. Rev. 2002;23:496-507.
ABSTRACT | FULL TEXT  

Evaluating drug treatments for Parkinson's disease: how good are the trials?
Wheatley et al.
BMJ 2002;324:1508-1511.
FULL TEXT  

Publication Bias in Editorial Decision Making
Olson et al.
JAMA 2002;287:2825-2828.
ABSTRACT | FULL TEXT  

Journal Prestige, Publication Bias, and Other Characteristics Associated With Citation of Published Studies in Peer-Reviewed Journals
Callaham et al.
JAMA 2002;287:2847-2850.
ABSTRACT | FULL TEXT  

Replacement of Oral Corticosteroids With Inhaled Corticosteroids in the Treatment of Acute Asthma Following Emergency Department Discharge* : A Meta-analysis
Edmonds et al.
Chest 2002;121:1798-1805.
ABSTRACT | FULL TEXT  

Abstracts of Randomized Controlled Trials Presented at the Society for Pediatric Research Meeting: An Example of Publication Bias
Klassen et al.
Arch Pediatr Adolesc Med 2002;156:474-479.
ABSTRACT | FULL TEXT  

To IPD or not to IPD?: Advantages and Disadvantages of Systematic Reviews Using Individual Patient Data
Stewart and Tierney
Eval Health Prof 2002;25:76-97.
ABSTRACT  

Systematic reviews in epidemiology: why are we so far behind?
Dickersin
Int J Epidemiol 2002;31:6-12.
FULL TEXT  

Lack of Long-Term Drift in Timolol's Effectiveness in Patients with Ocular Hypertension
Bengtsson and Heijl
IOVS 2001;42:2839-2842.
ABSTRACT | FULL TEXT  

Effect of Early Patient Enrollment on the Time to Completion and Publication of Randomized Controlled Trials
Haidich and Ioannidis
Am J Epidemiol 2001;154:873-880.
ABSTRACT | FULL TEXT  

False positive outcomes and design characteristics in occupational cancer epidemiology studies
Swaen et al.
Int J Epidemiol 2001;30:948-954.
ABSTRACT | FULL TEXT  

Trends in Acute Ischemic Stroke Trials Through the 20th Century
Kidwell et al.
Stroke 2001;32:1349-1359.
ABSTRACT | FULL TEXT  

Deleterious clinical effects of transfusion-associated immunomodulation: fact or fiction?
Vamvakas and Blajchman
Blood 2001;97:1180-1195.
FULL TEXT  

Effect of Patient Reminder/Recall Interventions on Immunization Rates: A Review
Szilagyi et al.
JAMA 2000;284:1820-1827.
ABSTRACT | FULL TEXT  

The risk of bias from omitted research
Garattini and Liberati
BMJ 2000;321:845-846.
FULL TEXT  

Evidence-based Laboratory Medicine: Supporting Decision-Making
Price
Clin. Chem. 2000;46:1041-1050.
ABSTRACT | FULL TEXT  

Epidemiology of research into interventions for the treatment of osteoarthritis of the knee joint
Chard et al.
Ann Rheum Dis 2000;59:414-418.
ABSTRACT | FULL TEXT  

Evidence-based Orthodontics: Where do I find the Evidence?
Harrison
J. Orthod. 2000;27:71-78.
FULL TEXT  

CNS tumors and exposure to acrylonitrile: Inconsistency between experimental and epidemiology studies
Collins and Strother
Neuro Oncol Duke 1999;1:221-230.
ABSTRACT  

The Fate of Neuroradiologic Abstracts Presented at National Meetings in 1993: Rate of Subsequent Publication in Peer-Reviewed, Indexed Journals
Marx et al.
Am. J. Neuroradiol. 1999;20:1173-1177.
ABSTRACT | FULL TEXT  

Complementary Medicine and the Cochrane Collaboration
Ezzo et al.
JAMA 1998;280:1628-1630.
FULL TEXT  

The Reading Corner. III. Error Types
Koretz
Nutr Clin Pract 1998;13:182-185.
 

A review of randomised controlled trials published in Archives of Disease in Childhood from 1982-96
Campbell et al.
Arch. Dis. Child. 1998;79:192-197.
FULL TEXT  

Publication Bias and Research on Passive Smoking: Comparison of Published and Unpublished Studies
Misakian and Bero
JAMA 1998;280:250-253.
ABSTRACT | FULL TEXT  

Positive-Outcome Bias and Other Limitations in the Outcome of Research Abstracts Submitted to a Scientific Meeting
Callaham et al.
JAMA 1998;280:254-257.
ABSTRACT | FULL TEXT  

Unpublished Research From a Medical Specialty Meeting: Why Investigators Fail to Publish
Weber et al.
JAMA 1998;280:257-259.
ABSTRACT | FULL TEXT  

Effect of the Statistical Significance of Results on the Time to Completion and Publication of Randomized Efficacy Trials
Ioannidis
JAMA 1998;279:281-286.
ABSTRACT | FULL TEXT  

meta-analysis bias in location and selection of studies
Egger and Smith
BMJ 1998;316:61-66.
FULL TEXT  

The Clinical Value of Computerized Information Services: A Review of 98 Randomized Clinical Trials
Balas et al.
Arch Fam Med 1996;5:271-278.
ABSTRACT  

Estimating Effect Size Under Publication Bias: Small Sample Properties and Robustness of a Random Effects Selection Model
Hedges and Vevea
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS 1996;21:299-332.
ABSTRACT  

The Effect of School Resources on Student Achievement
Greenwald et al.
REVIEW OF EDUCATIONAL RESEARCH 1996;66:361-396.
ABSTRACT  

Volume and outcome in coronary artery bypass graft surgery: true association or artefact?
Sowden et al.
BMJ 1995;311:151-155.
ABSTRACT | FULL TEXT  

Users' Guides to the Medical Literature: VI. How to Use an Overview
Oxman et al.
JAMA 1994;272:1367-1371.
ABSTRACT  

The Cochrane Collaboration
Godlee
BMJ 1994;309:969-970.
FULL TEXT  

Publication Bias and Public Health Policy on Environmental Tobacco Smoke
Bero et al.
JAMA 1994;272:133-136.
ABSTRACT  

Full Publication of Results Initially Presented in Abstracts: A Meta-analysis
Scherer et al.
JAMA 1994;272:158-162.
ABSTRACT  

Meta-analytic stimulus for changes in clinical trials
Harvard and Lau
Stat Methods Med Res 1993;2:161-172.
ABSTRACT  

Should Unpublished Data Be Included in Meta-analyses? Current Convictions and Controversies
Cook et al.
JAMA 1993;269:2749-2753.
ABSTRACT  

Is Successful Prevention Newsworthy?
Weetman
Indoor and Built Environment 1992;1:197-198.
 

Publication Bias and the Editorial Process
Kaufman
JAMA 1992;267:2891-2891.
ABSTRACT  

Publication Bias and the Editorial Process
Liberati
JAMA 1992;267:2891-2891.
ABSTRACT  

Publication Bias: The Triumph of Hope Over Experience
Rennie and Flanagin
JAMA 1992;267:411-412.
ABSTRACT