This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on Web of Science (301)  • Contact me when this article is cited  Related Content  • Related letter  • Similar articles in JAMA  Topic Collections  • Informatics/ Internet in Medicine  • Internet  • Informatics, Other  • Review  • Alert me on articles by topic  Social Bookmarking   What's this?

Navigating to Knowledge or to Babel?

Alejandro R. Jadad, MD, DPhil; Anna Gagliardi, MSc, MLS

JAMA. 1998;279:611-614.

Context.— The rapid growth of the Internet has triggered an information revolution of unprecedented magnitude. Despite its obvious benefits, the increase in the availability of information could also result in many potentially harmful effects on both consumers and health professionals who do not use it appropriately.

Objectives.— To identify instruments used to rate Web sites providing health information on the Internet, rate criteria used by them, establish the degree of validation of the instruments, and provide future directions for research in this area.

Data Sources.— MEDLINE (1966-1997), CINHAL (1982-1997), HEALTH (1975-1997), Information Science Abstracts (1966 to September 1995), Library and Information Science Abstracts (1969-1995), and Library Literature (1984-1996); the search engines Lycos, Excite, Open Text, Yahoo, HotBot, Infoseek, and Magellan; Internet discussion lists; meeting proceedings; multiple Web pages; and reference lists.

Instrument Selection.— Instruments used at least once to rate the quality of Web sites providing health information with their rating criteria available on the Internet.

Data Extraction.— The name of the developing organization, Internet address, rating criteria, information on the development of the instrument, number and background of people generating the assessments, and data on the validity and reliability of the measurements.

Data Synthesis.— A total of 47 rating instruments were identified. Fourteen provided a description of the criteria used to produce the ratings, and 5 of these provided instructions for their use. None of the instruments identified provided information on the interobserver reliability and construct validity of the measurements.

Conclusions.— Many incompletely developed instruments to evaluate health information exist on the Internet. It is unclear, however, whether they should exist in the first place, whether they measure what they claim to measure, or whether they lead to more good than harm.

From the Health Information Research Unit (Dr Jadad and Ms Gagliardi), Canadian Cochrane Network and Centre (Dr Jadad), Supportive Cancer Care Research Unit (Dr Jadad), and the McMaster Evidence-Based Practice Center (Dr Jadad), Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

RELATED LETTER

Internet Health Ratings Systems: Knowledge vs Babel
, , , , , , , , , , , , and
JAMA. ;280():697-699.
FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Trying to Measure the Quality of Health Information on the Internet: Is It Time to Move On?
DESHPANDE and JADAD
The Journal of Rheumatology 2009;36:1-3.
FULL TEXT  

Practicing Reliability: Reconstructing Traditional Boundaries in the Gray Areas of Health Information Review on the Web
Adams and Bal
Science Technology Human Values 2009;34:34-54.
ABSTRACT  

eHealth as a challenge to 'expert' power: a focus group study of internet use for health information and management
Donnelly et al.
JRSM 2008;101:501-506.
ABSTRACT | FULL TEXT  

A study of undue pain and surfing: using hierarchical criteria to assess website quality
Lorence and Abraham
Health Informatics Journal 2008;14:155-173.
ABSTRACT  

Health informatics: current issues and challenges
Bath
Journal of Information Science 2008;34:501-518.
ABSTRACT  

The Internet as an Emerging Patient Education Tool Among African American Men With Prostate Cancer: An Exploratory Study
Wallington
Am J Mens Health 2008;2:106-121.
ABSTRACT  

Ubiquitous Computing: Trust Issues for a "Healthy" Society
Sillence and Briggs
Social Science Computer Review 2008;26:6-12.
ABSTRACT  

Patients retrieving additional information via the Internet: A trend analysis in a Swedish population, 2000--05
Rahmqvist and Bara
Scand J Public Health 2007;35:533-539.
ABSTRACT  

Chronic illness and health-seeking information on the Internet
Ayers and Kronenfeld
Health (London) 2007;11:327-347.
ABSTRACT  

Why did that happen? Exploring the proliferation of barely usable software in healthcare systems
Johnson
Qual Saf Health Care 2006;15:i76-i81.
ABSTRACT | FULL TEXT  

Seeking health information on the internet: lifestyle choice or bad attack of cyberchondria?
Lewis
Media Culture Society 2006;28:521-539.
ABSTRACT  

Accuracy and self correction of information received from an internet breast cancer list: content analysis
Esquivel et al.
BMJ 2006;332:939-942.
ABSTRACT | FULL TEXT  

Quality of health information on the Internet in pediatric neuro-oncology
Hargrave et al.
Neuro Oncol Duke 2006;8:175-182.
ABSTRACT | FULL TEXT  

Quality of arthritis information on the Internet
Ansani et al.
Am J Health Syst Pharm 2005;62:1184-1189.
ABSTRACT | FULL TEXT  

Extent, Accuracy, and Credibility of Breastfeeding Information on the Internet
Shaikh and Scott
J Hum Lact 2005;21:175-183.
ABSTRACT  

Public Health Informatics: The Nature of the Field and Its Relevance to Health Promotion Practice
Kukafka
Health Promot Pract 2005;6:23-28.
ABSTRACT  

Patient Internet Use for Health Information at Three Urban Primary Care Clinics
Dickerson et al.
J. Am. Med. Inform. Assoc. 2004;11:499-504.
ABSTRACT | FULL TEXT  

A resource guide for practice development through technology
SPALLEK
Journal of the American Dental Association 2004;135:38S-44S.
FULL TEXT  

Impact of FUTON and NAA Bias on Visibility of Research
Murali et al.
Mayo Clin Proc. 2004;79:1001-1006.
ABSTRACT  

Cystic Fibrosis on the Internet: A Survey of Site Adherence to AMA Guidelines
Anselmo et al.
Pediatrics 2004;114:100-103.
ABSTRACT | FULL TEXT  

Design and Evaluation of SchoolhealthLink, a Web-Based Health Information Resource
Bachman et al.
The Journal of School Nursing 2003;19:351-357.
ABSTRACT | FULL TEXT  

Emerging challenges in using health information from the internet
Theodosiou and Green
Adv. Psychiatr. Treat. 2003;9:387-396.
ABSTRACT | FULL TEXT  

Development and Application of a Tool Designed to Evaluate Web Sites Providing Information on Alzheimer's Disease
Bath and Bouchier
Journal of Information Science 2003;29:279-297.
ABSTRACT  

The Internet for Medical Information About Cancer: Help or Hindrance?
Matthews et al.
Psychosomatics 2003;44:100-103.
ABSTRACT | FULL TEXT  

The Internet and primary care physicians: coping with different expectations
van Woerkum
Am. J. Clin. Nutr. 2003;77:1016S-1018.
ABSTRACT | FULL TEXT  

Evaluation of Websites that Provide Information on Alzheimer's Disease
Bouchier and Bath
Health Informatics Journal 2003;9:17-31.
ABSTRACT  

Specialized medical search-engines are no better than general search-engines in sourcing consumer information about androgen deficiency
Ilic et al.
Hum Reprod 2003;18:557-561.
ABSTRACT | FULL TEXT  

American Oncologists' Views of Internet Use by Cancer Patients: A Mail Survey of American Society of Clinical Oncology Members
Helft et al.
JCO 2003;21:942-947.
ABSTRACT | FULL TEXT  

Measuring the Relevance of Evaluation Criteria among Health Information Seekers on the Internet
Barnes et al.
J Health Psychol 2003;8:71-82.
ABSTRACT  

From Physician to Consumer: The Effectiveness of Strategies to Manage Health Care Utilization
Flynn et al.
Med Care Res Rev 2002;59:455-481.
ABSTRACT  

Analysis of Internet-Based Health Assessments
Bensley and Lewis
Health Promot Pract 2002;3:463-476.
ABSTRACT  

An evaluation of general practice websites in the UK
Howitt et al.
Fam Pract 2002;19:547-556.
ABSTRACT | FULL TEXT  

Product-Related Emphasis of Skin Disease Information Online
Hu et al.
Arch Dermatol 2002;138:775-780.
ABSTRACT | FULL TEXT  

Empirical Studies Assessing the Quality of Health Information for Consumers on the World Wide Web: A Systematic Review
Eysenbach et al.
JAMA 2002;287:2691-2700.
ABSTRACT | FULL TEXT  

Against internet exceptionalism
Shepperd and Charnock
BMJ 2002;324:556-557.
FULL TEXT  

Examination of instruments used to rate quality of health information on the internet: chronicle of a voyage with an unclear destination
Gagliardi and Jadad
BMJ 2002;324:569-573.
ABSTRACT | FULL TEXT  

Breast cancer on the world wide web: cross sectional survey of quality of information and popularity of websites
Meric et al.
BMJ 2002;324:577-581.
ABSTRACT | FULL TEXT  

How to find the good and avoid the bad or ugly: a short guide to tools for rating quality of health information on the internet * Commentary: On the way to quality
Wilson and Risk
BMJ 2002;324:598-602.
FULL TEXT  

Education and debate: Regulating health information: a US perspective * Commentary: Legal aspects of health on the internet: a European perspective
Terry and Stanberry
BMJ 2002;324:602-606.
FULL TEXT  

Evaluating the quality of educational materials about schizophrenia
Currie et al.
Psychiatr. Bull. 2002;26:96-98.
ABSTRACT | FULL TEXT  

A guide to creating your own patient-oriented website
Clement et al.
JRSM 2002;95:64-67.
FULL TEXT  

Indicators of Accuracy of Consumer Health Information on the Internet: A Study of Indicators Relating to Information for Managing Fever in Children in the Home
Fallis and Fricke
J. Am. Med. Inform. Assoc. 2002;9:73-79.
ABSTRACT | FULL TEXT  

Melanoma Information on the Internet: Often Incomplete--A Public Health Opportunity?
Bichakjian et al.
JCO 2002;20:134-141.
ABSTRACT | FULL TEXT  

Consumer health information seeking on the Internet: the state of the art
Cline and Haynes
Health Educ Res 2001;16:671-692.
ABSTRACT | FULL TEXT  

Enhancing learning through use of interactive tools on health-related websites
Stout et al.
Health Educ Res 2001;16:721-733.
ABSTRACT | FULL TEXT  

Improving the Quality of Medical Care: Building Bridges Among Professional Pride, Payer Profit, and Patient Satisfaction
Grol
JAMA 2001;286:2578-2585.
ABSTRACT | FULL TEXT  

Internet resources for end-of-life care
VandeKieft et al.
AM J HOSP PALLIAT CARE 2001;18:313-320.
ABSTRACT  

The Readability of Pediatric Patient Education Materials on the World Wide Web
D'Alessandro et al.
Arch Pediatr Adolesc Med 2001;155:807-812.
ABSTRACT | FULL TEXT  

Quality of health information about depression on internet
Tomlin et al.
BMJ 2001;322:1366-1366.
FULL TEXT  

Medical Scientific Publishing in the Twenty-first Century : II. Conflict of Interest in Scientific Publication
Chapman
JBJS 2001;83:e4-5.
FULL TEXT  

Book reviews in the electronic age
Gray and Lamerton
Br. J. Psychiatry 2001;178 :277a-277a.
FULL TEXT  

The Best of the Web: What Your Patients Find Online
Journal Watch Dermatology 2001;2001:6-6.
FULL TEXT  

Access vs Quality Assurance: the e-Health Conundrum
Terry
JAMA 2001;285:807-807.
FULL TEXT  

Quality of web based information on treatment of depression: cross sectional survey
Griffiths and Christensen
BMJ 2000;321:1511-1515.
ABSTRACT | FULL TEXT  

The Content and Accessibility of Sex Education Information on the Internet
Smith et al.
Health Educ Behav 2000;27:684-694.
ABSTRACT  

Research, the Internet, and the Way Things are
Malone
Health Educ Behav 2000;27:695-697.
 

Quality of websites: kitemarking the west wind
Delamothe
BMJ 2000;321:843-844.
FULL TEXT  

The impact of the Internet on the doctor-patient relationship
Nwosu and Cox
Health Informatics Journal 2000;6:156-161.
ABSTRACT  

Recent advances: Consumer health informatics
Eysenbach
BMJ 2000;320:1713-1716.
FULL TEXT  

Fibromyalgia: Is Recovery Impeded by the Internet?
Armstrong and Goldenberg
Arch Intern Med 2000;160:1039-1040.
FULL TEXT  

Guidelines for Medical and Health Information Sites on the Internet: Principles Governing AMA Web Sites
Winker et al.
JAMA 2000;283:1600-1606.
ABSTRACT | FULL TEXT  

Parents on the Web: Risks for Quality Management of Cough in Children
Pandolfini et al.
Pediatrics 2000;105:e1-e1.
ABSTRACT | FULL TEXT  

Shopping around the internet today and tomorrow: towards the millennium of cybermedicine
Eysenbach et al.
BMJ 1999;319:1294-1294.
FULL TEXT  

Creating your own medical Internet library
Stewart
CMAJ 1999;161:1155-1160.
ABSTRACT | FULL TEXT  

An insight into rheumatology resources available on the World Wide Web (http://www.ilar.org)
Armstrong et al.
Rheumatology (Oxford) 1999;38:1028-1028.
FULL TEXT  

Promoting partnerships: challenges for the internet age
Jadad
BMJ 1999;319:761-764.
FULL TEXT  

Helping patients access high quality health information
Shepperd et al.
BMJ 1999;319:764-766.
FULL TEXT  

The Mailbase Hand Surgery Electronic Mailing List
NDUKWE et al.
J Hand Surg Eur Vol 1999;24:145-147.
ABSTRACT  

Published criteria for evaluating health related web sites: review
Kim et al.
BMJ 1999;318:647-649.
ABSTRACT | FULL TEXT  

The Internet, intranets and reproductive medicine
Jenkins
Hum Reprod 1999;14:586-589.
FULL TEXT  

The Basis for Using the Internet to Support the Information Needs of Primary Care
Westberg and Miller
J. Am. Med. Inform. Assoc. 1999;6:6-25.
ABSTRACT | FULL TEXT  

The Quality of Medical Information on the Internet: A New Public Health Concern
McLeod
Arch Ophthalmol 1998;116:1663-1665.
FULL TEXT  

Information epidemics, economics, and immunity on the internet
Coiera
BMJ 1998;317:1469-1470.
FULL TEXT  

Towards quality management of medical information on the internet: evaluation, labelling, and filtering of information
Eysenbach et al.
BMJ 1998;317:1496-1502.
FULL TEXT  

The Internet: Increasing Information, Decreasing Certainty
Coelho
JAMA 1998;280:1454-1454.
FULL TEXT  

Medicine and Health on the Internet: The Good, the Bad, and the Ugly
Lindberg and Humphreys
JAMA 1998;280:1303-1304.
FULL TEXT  

Applicability and Quality of Information for Answering Clinical Questions on the Web
Hersh et al.
JAMA 1998;280:1307-1308.
FULL TEXT  

An Evidence-Based Approach to Interactive Health Communication: A Challenge to Medicine in the Information Age
Robinson et al.
JAMA 1998;280:1264-1269.
ABSTRACT | FULL TEXT  

Current Concepts Review - Internet Resources for Orthopaedic Surgeons
GOLLADAY et al.
JBJS 1998;80:1525-32.
FULL TEXT  

A Surgical Internet Discussion List (Surginet): A Novel Venue for International Communication Among Surgeons
Gilas et al.
Arch Surg 1998;133:1126-1130.
ABSTRACT | FULL TEXT  

Internet Health Ratings Systems: Knowledge vs Babel
Badgett et al.
JAMA 1998;280:697-699.
FULL TEXT  

Domestic Violence Resources on the Internet
Goodman
JAMA 1998;280:477-478.
FULL TEXT  

Evidence based patient information
Coulter
BMJ 1998;317:225-226.
FULL TEXT  

Searching for the best evidence. Part 1: where to look
McKibbon and Marks
Evid. Based Nurs. 1998;1:68-70.
FULL TEXT