This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on Web of Science (49)  • Contact me when this article is cited  Related Content  • Similar articles in JAMA  Topic Collections  • Journalology/ Peer Review/ Authorship  • Quality of Care  • Evidence-Based Medicine  • Alert me on articles by topic  Social Bookmarking   What's this?

Jaime L. Peters, MSc; Alex J. Sutton, PhD; David R. Jones, PhD; Keith R. Abrams, PhD; Lesley Rushton, PhD

JAMA. 2006;295:676-680.

Context  Egger's regression test is often used to help detect publication bias in meta-analyses. However, the performance of this test and the usual funnel plot have been challenged particularly when the summary estimate is the natural log of the odds ratio (lnOR).

Objective  To compare the performance of Egger's regression test with a regression test based on sample size (a modification of Macaskill's test) with lnOR as the summary estimate.

Design  Simulation of meta-analyses under a number of scenarios in the presence and absence of publication bias and between-study heterogeneity.

Main Outcome Measures  Type I error rates (the proportion of false-positive results) for each regression test and their power to detect publication bias when it is present (the proportion of true-positive results).

Results  Type I error rates for Egger's regression test are higher than those for the alternative regression test. The alternative regression test has the appropriate type I error rates regardless of the size of the underlying OR, the number of primary studies in the meta-analysis, and the level of between-study heterogeneity. The alternative regression test has comparable power to Egger's regression test to detect publication bias under conditions of low between-study heterogeneity.

Conclusion  Because of appropriate type I error rates and reduction in the correlation between the lnOR and its variance, the alternative regression test can be used in place of Egger's regression test when the summary estimates are lnORs.

Author Affiliations: Centre for Biostatistics and Genetic Epidemiology, Department of Health Sciences, University of Leicester, Leicester, England (Drs Sutton, Jones, and Abrams, and Ms Peters); MRC Institute for Environment and Health, Leicester, England (Dr Rushton). Dr Rushton is now with the Department of Epidemiology and Public Health, Imperial College London, London, England.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

The Quality of Meta-Analyses of Genetic Association Studies: A Review With Recommendations
Minelli et al.
Am J Epidemiol 2009;170:1333-1343.
ABSTRACT | FULL TEXT  

Tirofiban as adjunctive therapy for acute coronary syndromes and percutaneous coronary intervention: a meta-analysis of randomized trials
Valgimigli et al.
Eur Heart J 2009;0:ehp376v1-ehp376.
ABSTRACT | FULL TEXT  

The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration
Liberati et al.
ANN INTERN MED 2009;151:W-65-W-94.
ABSTRACT | FULL TEXT  

Novel methods to deal with publication biases: secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications
Moreno et al.
BMJ 2009;339:b2981-b2981.
ABSTRACT | FULL TEXT  

The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration
Liberati et al.
BMJ 2009;339:b2700-b2700.
ABSTRACT | FULL TEXT  

Meta-analysis of dry cow management for dairy cattle. Part 1. Protection against new intramammary infections
Halasa et al.
J DAIRY SCI 2009;92:3134-3149.
ABSTRACT | FULL TEXT  

Blood pressure reduction and renin-angiotensin system inhibition for prevention of congestive heart failure: a meta-analysis
Verdecchia et al.
Eur Heart J 2009;30:679-688.
ABSTRACT | FULL TEXT  

Selective Reporting of Adjusted Estimates in Observational Epidemiology Studies: Reasons and Implications for Meta-analyses
Peters and Mengersen
Eval Health Prof 2008;31:370-389.
ABSTRACT  

Effect of mechanical ventilation in the prone position on clinical outcomes in patients with acute hypoxemic respiratory failure: a systematic review and meta-analysis
Sud et al.
CMAJ 2008;178:1153-1161.
ABSTRACT | FULL TEXT  

The association between gastro-oesophageal reflux disease and asthma: a systematic review
Havemann et al.
Gut 2007;56:1654-1664.
ABSTRACT | FULL TEXT  

Meta-analysis of studies of passive smoking and lung cancer: effects of study type and continent
Taylor et al.
Int J Epidemiol 2007;36:1048-1059.
ABSTRACT | FULL TEXT  

Smoking is a risk factor for multiple sclerosis: a metanalysis
Hawkes
Mult Scler 2007;13:610-615.
ABSTRACT  

Physical Activity of Moderate Intensity and Risk of Type 2 Diabetes: A systematic review
Jeon et al.
Diabetes Care 2007;30:744-752.
ABSTRACT | FULL TEXT  

The Extent to Which Tobacco Marketing and Tobacco Use in Films Contribute to Children's Use of Tobacco: A Meta-analysis
Wellman et al.
Arch Pediatr Adolesc Med 2006;160:1285-1296.
ABSTRACT | FULL TEXT  

The Effect of Early, Intensive Statin Therapy on Acute Coronary Syndrome: A Meta-analysis of Randomized Controlled Trials.
Hulten et al.
Arch Intern Med 2006;166:1814-1821.
ABSTRACT | FULL TEXT  

The case of the misleading funnel plot
Lau et al.
BMJ 2006;333:597-600.
FULL TEXT