This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on ISI (71)  • Contact me when this article is cited  Related Content  • Similar articles in JAMA

Michael Callaham, MD; Robert L. Wears, MD,MS; Ellen Weber, MD

JAMA. 2002;287:2847-2850.

Context  Citation by other authors is important in the dissemination of published science, but factors predicting it are little studied.

Methods  To identify characteristics of published research predicting citation in other journals, we searched the Science Citations Index database for a standardized 3.5 years for all citations of published articles originally submitted to a 1991 emergency medicine specialty meeting. Analysis was conducted by classification and regression trees, a nonparametric modeling technique of regression trees, to determine the impact of previously determined characteristics of the full articles on the outcome measures. We calculated the the number of times an article was cited each year and calculated the mean impact factor (citations per manuscript per year) in other citing journals.

Results  Of the 493 submitted manuscripts, 204 published articles met entry criteria. The mean citations per year was 2.04 (95% confidence interval, 1.6-2.4; range, 0-20.9) in 440 different journals. Nineteen articles (9.3%) were never cited. The ability to predict the citations per year was weak (pseudo R² = 0.14.). The strongest predictor of citations per year was the impact factor of the original publishing journal. The presence of a control group, the subjective newsworthiness score, and sample size predicted citation frequency (24.3%, 26.0%, and 26.5% as strongly, respectively). The ability to predict mean impact factor of the citing journals was even weaker (pseudo R² = 0.09). The impact factor of the publishing journal was the strongest predictor, followed by the newsworthiness score (89.9% as strongly) and a subjective quality score (61.5%). Positive outcome bias was not evident for either outcome measure.

Conclusion  In this cohort of published research, commonly used measures of study methodology and design did not predict the frequency of citations or the importance of citing journals. Positive outcome bias was not evident. The impact factor of the original publishing journal was more important than any other variable, suggesting that the journal in which a study is published may be as important as traditional measures of study quality in ensuring dissemination.

Author Affiliations: Division of Emergency Medicine, University of California, San Francisco (Drs Callaham and Weber), Department of Emergency Medicine, University of Florida at Jacksonville, Jacksonville (Dr Wears).

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Differential Citation Rates of Major Cardiovascular Clinical Trials According to Source of Funding: A Survey From 2000 to 2005
Conen et al.
Circulation 2008;118:1321-1327.
ABSTRACT | FULL TEXT  

Author Perception of Peer Review
Gibson et al.
Obstet Gynecol 2008;112:646-652.
ABSTRACT | FULL TEXT  

Improving the "Impact" of Academic Psychiatry
Coverdale et al.
Acad. Psychiatry 2008;32:169-172.
FULL TEXT  

European and US publications in the 50 highest ranking pathology journals from 2000 to 2006
Fritzsche et al.
J. Clin. Pathol. 2008;61:474-481.
ABSTRACT | FULL TEXT  

Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: retrospective cohort study
Lokker et al.
BMJ 2008;336:655-657.
ABSTRACT | FULL TEXT  

Stronger European medical research
Groves
BMJ 2008;336:341-342.
FULL TEXT  

A Bibliometric Analysis of Global Clinical Research by Anesthesia Departments
Swaminathan et al.
Anesth. Analg. 2007;105:1741-1746.
ABSTRACT | FULL TEXT  

How To Choose the Right Journal for Your Manuscript
Thompson
Chest 2007;132:1073-1076.
FULL TEXT  

Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994-2005) and their Editors' views
Chew et al.
JRSM 2007;100:142-150.
ABSTRACT | FULL TEXT  

"Eigenlob": self-citation in biomedical journals
Falagas and Kavvadia
FASEB J. 2006;20:1039-1042.
FULL TEXT  

Publication of Material Presented at Radiologic Meetings: Authors' Country and International Collaboration
Miguel-Dasit et al.
Radiology 2006;239:521-528.
ABSTRACT | FULL TEXT  

Factors Associated with Academic Radiology Research Productivity
Itagaki and Pile-Spellman
Radiology 2005;237:774-780.
ABSTRACT | FULL TEXT  

Method Matters: An Empirical Study of Impact in Cognitive Neuroscience
Fellows et al.
J. Cogn. Neurosci. 2005;17:850-858.
ABSTRACT | FULL TEXT  

Bias
Delgado-Rodriguez and Llorca
J. Epidemiol. Community Health 2004;58:635-641.
ABSTRACT | FULL TEXT  

Author self-citation in the diabetes literature
Gami et al.
CMAJ 2004;170:1925-1927.
ABSTRACT | FULL TEXT  

An Examination of Leading Mental Health Journals for Evidence to Inform Evidence-Based Practice
Shumway and Sentell
Psychiatr. Serv. 2004;55:649-653.
ABSTRACT | FULL TEXT  

Doubling the Impact: Publication of Systematic Review Articles in Orthopaedic Journals
Bhandari et al.
JBJS 2004;86:1012-1016.
ABSTRACT | FULL TEXT  

Does activity in research correlate with visibility?
Reynolds and Wierzbicki
J. Clin. Pathol. 2004;57:426-427.
ABSTRACT | FULL TEXT  

Understanding the Limitations of the Journal Impact Factor
Kurmis
JBJS 2003;85:2449-2454.
ABSTRACT | FULL TEXT  

Diffusion of News about Research
Kiernan
Science Communication 2003;25:3-13.
ABSTRACT  

Increasing the trust in scientific authorship
LAGNADO
Br. J. Psychiatry 2003;183:3-4.
FULL TEXT