 |
 |

Hormone Replacement Therapy and Cognition
Systematic Review and Meta-analysis
Erin S. LeBlanc, MD,MPH;
Jeri Janowsky, PhD;
Benjamin K. S. Chan, MS;
Heidi D. Nelson, MD,MPH
JAMA. 2001;285:1489-1499.
ABSTRACT
 |  |
Context Some observational data suggest that hormone replacement therapy (HRT) may reduce the risk of cognitive decline and dementia but results have been conflicting.
Objective To review and evaluate studies of HRT for preventing cognitive decline and dementia in healthy postmenopausal women.
Data Sources Studies with English-language abstracts identified in MEDLINE (1966-August 2000), HealthSTAR (1975-August 2000, PsychINFO (1984-August 2000); Cochrane Library databases; and articles listed in reference lists of key articles.
Study Selection Randomized controlled trials and cohort studies were reviewed for the effects of HRT on cognitive decline; cohort and case-control studies were reviewed for dementia risk. No randomized controlled trials regarding dementia risk were identified.
Data Extraction Twenty-nine studies met inclusion criteria and were rated. Two reviewers rated study quality independently and 100% agreement was reached on Jadad scores and 80% agreement was reached on US Preventive Services Task Force quality scores. A final score was reached through consensus if reviewers disagreed.
Data Synthesis Studies of cognition were not combined quantitatively because of heterogeneous study design. Women symptomatic from menopause had improvements in verbal memory, vigilance, reasoning, and motor speed, but no enhancement of other cognitive functions. Generally, no benefits were observed in asymptomatic women. A meta-analysis of observational studies suggested that HRT was associated with a decreased risk of dementia (summary odds ratio, 0.66; 95% confidence interval, 0.53-0.82). However, possible biases and lack of control for potential confounders limit interpretation of these studies. Studies did not contain enough information to assess adequately the effects of progestin use, various estrogen preparations or doses, or duration of therapy.
Conclusions In women with menopausal symptoms, HRT may have specific cognitive effects, and future studies should target these effects. The meta-analysis found a decreased risk of dementia in HRT users but most studies had important methodological limitations.
INTRODUCTION
Observational data suggest a relationship between lifelong endogenous estrogen exposure and cognition.1-2 Thus, as has been hypothesized, postmenopausal hormone replacement therapy (HRT) might prevent cognitive decline and dementia. To determine supporting evidence, we reviewed medical literature on HRT (estrogen alone or estrogen combined with progestins) (1) to prevent cognitive decline, or (2) to decrease dementia risk in healthy postmenopausal women. This review was conducted in conjunction with the US Preventive Services Task Force to update its recommendations on HRT use.
A review showing possible positive effects of HRT on overall cognition in perimenopausal women has been previously published.3 What is not known is which cognitive domains might be most affected by estrogen. Cognition includes a variety of processes from memory to attention to motor speed, each mediated by different brain systems. Sex steroids might not affect various brain systems and cognitive processes equally. Indeed, performance on mental rotation and articulatory skills varies across the menstrual cycle, but other cognitive domains are unaffected.4-6 Such neural and cognitive specificity is not surprising because estrogen receptors are not distributed uniformly throughout the brain. For example, the hippocampus, a brain area rich in estrogen receptors,7-9 mediates verbal memory,10-11 a function that some studies show is affected by estrogen.4, 12 We sought to determine whether HRT affects cognition and the cognitive specificity of any effects.
We also evaluated the effects of HRT on dementia risk. A previous meta-analysis found that HRT users had a decreased risk of dementia, and the overall risk reduction just reached significance.3 However, when only case-control studies were combined, the risk reduction was no longer statistically significant. Since that time, 2 additional case-control studies have been performed.13-14
METHODS
We searched MEDLINE (1966-August 2000), HealthSTAR (1975-August 2000), PsychINFO (1984-August 2000) and the Cochrane Library databases. We combined the Medical Subject Headings hormone replacement therapy and estrogens with the headings dementia, mental processes, cognition disorders, and memory disorders. Additional articles were obtained from reference lists of relevant reviews. A single reader (E.S.L.) reviewed all 509 abstracts identified by the search and found 56 studies with primary data.
To identify which studies to include, a "best evidence" approach was applied.15 For the question of the association between HRT and cognition, we included only randomized, double-blind, placebo-controlled trials and cohort studies. Cohort studies were included because they used older populations followed up for longer periods than did randomized controlled trials.
To address the association between HRT and dementia, we included only cohort and case-control studies. There were no randomized controlled trials about the association. For a case-control study to be included, the study methodology had to provide details about how Alzheimer disease or dementia was determined. If 2 studies were done on the same population, the study with the most recent data was included.
Jadad scores were used to measure the quality of the randomized controlled trials (BOX 1).16 For the other studies, methodological limitations that could compromise the study's quality were recorded based on a quality score created by a work group of the US Preventive Services Task Force (USPSTF) (BOX 2).17 Two reviewers (E.S.L. and H.D.N.) rated study quality independently; there was 100% agreement on Jadad scores and 80% agreement on USPSTF quality scores. When the reviewers disagreed, a final score was reached through consensus. We evaluated studies for selection bias using funnel plots.18
The original goal was to combine the results of the cognitive tests quantitatively; however, the study designs and cognitive measures were too dissimilar. Instead, the cognitive tests were qualitatively combined according to what was measured (memory, attention, reasoning, mental status, motor speed, verbal function) using a reference guide19 and expert opinion. When possible, we calculated the increment of effect and normalized the scores using a total of 100 points. In some cases, scores were estimated from figures.12, 20-21
For studies of dementia, we performed a meta-analysis of the 2 cohort22-23 and 10 case-control studies13-14,24-31 meeting inclusion criteria. All reported either relative risk (RR) or odds ratio (OR) estimates. The logarithm of RR (logRR) was assumed to have a normal distribution. If confidence intervals (CIs) or P values were reported, SEs for the logRR were calculated. If neither was reported, SEs were calculated for studies that reported enough data. The logRR and the corresponding SEs were used as data points for the meta-analysis.
Fixed and random effects models were fit on the data. Mean RRs and CIs were estimated for a global HRT effect. The Bayesian data analytic framework was used to fit the model. Inference on the parameters was done via posterior probability distributions. The data were analyzed using WinBUGS software,32 which uses a method of Markov Chain Monte Carlo called Gibbs Sampling to simulate posterior probability distributions.
Noninformative prior probability distributions were used. Inference was made on 5000 simulated draws (1000 draws from 5 chains) from the posterior distribution after adequate convergence. Sensitivity analysis was performed using different prior distributions, combining only studies with similar methods and excluding a study with uncertain CIs.
RESULTS
Effects on Cognition
The literature search identified 9 randomized controlled trials (Table 1), of which 1 had a quality score of five34 and 3 had quality scores of four35-37; and 8 cohort studies (Table 2), 6 rated as fair and 2 as poor in quality, that used formal testing to measure the effects of estrogen on the cognition of women without dementia. The randomized controlled trials are dissimilar in several ways. Three used a cross-over design12, 34-35; the rest used separate experimental and placebo groups. The mean age of the women in the studies ranged from 45 to 80 years. Three studies included women immediately after a total abdominal hysterectomy/bilateral salpingo-oophorectomy12, 36-37; 6 other studies included only a small percentage of women with surgical menopause.20, 34-35,38-39,42 Some studies included women with menopausal symptoms12, 20, 36, 39; one specifically excluded symptomatic women.37 More than 40 different cognitive tests were used in these studies, and 30 of these tests were used by only 1 investigator. Only 7 tests were used in more than 2 studies, and even when tests were repeated by several investigators, the administration was not uniform.12, 35-37,39, 42-45 Only 2 studies used the identical estrogen formulation and dose. Duration of use ranged from 21 days to 6 months. Because of these differences in design, results were not combined quantitatively. Instead, the tests were grouped according to the cognitive process they measured. Details of effects are summarized in Table 3.
|
|
|
|
Table 1. Hormone Replacement Therapy (HRT) and Cognition in Randomized Controlled Trials*
|
|
|
|
|
|
|
Table 2. Hormone Replacement Therapy (HRT) and Cognition in Cohort Studies*
|
|
|
|
|
|
|
Table 3. Summary of Cognitive Tests*
|
|
|
Memory
Memory is the first process to be affected in Alzheimer disease; thus, memory tasks are often used to track dementia onset. Although cross-sectional studies suggest that HRT affects memory,47-51 results from randomized controlled trials and cohort studies are conflicting.
Nine tests of verbal recall were used by 2 randomized controlled trials and 4 cohort studies.12, 36, 40, 42, 44-45 In verbal recall tests, subjects are shown verbal stimuli such as lists of words, word pairs, or paragraphs and are asked to recall them either immediately or after a 15- to 60-minute retention interval.19 The 2 randomized controlled trials and 1 cohort study found that users had better immediate verbal recall than nonusers. Users recalled 1 to 2 more words or word pairs from a paragraph or word list of 13 to 14 unrelated words or word pairs after the delay period.36, 42, 44 However, no test was uniformly positive in all studies. Estrogen exposure was associated with improvement in at least 1 test of delayed verbal recall in 3 of 4 studies.36, 42, 44-45 Users recalled 2 to 5 more words or word pairs from a paragraph or word list of 13 to 14 unrelated words or word pairs.12, 36, 44 However, neither study using several measures of delayed verbal recall found a difference on more than 1 test.36, 42Also, none of the tests were positive in all of the studies.36, 42, 44-45
On visual memory tests, subjects are shown shapes or figures and respond through drawing. One small cohort study21 found that users performed better on 1 test of visual recall, but 5 other studies,35-36,39, 42, 45 including 3 randomized controlled trials,35-36,39 found no benefit.
Attention and Working Memory
Ten studies looked at the effects of HRT on attention or working memory: the ability to hold information in mind, to manipulate it, and to use it to guide behavior without external cues.19 Three randomized controlled trials used 3 separate tests to measure working memory. No study found that users performed better than nonusers.34-35,45 One study found that although there were no behavioral effects, the estrogen group, when performing working memory tasks, had increased activation of certain brain areas by functional magnetic resonance imaging.34
Digit span, the most commonly used test, was used in 6 studies.12, 35-37,39, 42 On this test, subjects repeat a list of 2 to 8 numbers backward. Only 1 study, using women with symptoms of menopause, found that women randomized to estrogen performed better than nonusers.12
Women using estrogen showed improvement compared with nonusers on 1 of the 8 tests of mental tracking, such as arithmetic and repeating months backward.20, 35, 39, 45 Although 1 study found that women were better able to read a word or state its color despite distracting stimuli,20 this was not confirmed by a larger study.35
Although quite varied, complex attention tasks typically require both visual attention and concentration. Five studies did not find estrogen users better able than nonusers to pair symbols and numbers or to connect consecutively numbered and lettered circles.35, 37, 39, 43, 49 However, 2 randomized controlled trials found that women symptomatic from menopause had improvement on 2 other tests of complex attention when taking estrogen.20, 39
Of the 3 studies measuring vigilance, 2 found that estrogen improved the ability to sustain attention. The women in both studies were symptomatic, with fatigue, sleep problems, hot flashes, and depression.20, 39 In contrast, a larger randomized cross-over trial did not find that women given estrogen performed better on 2 sensitive tests of vigilance.35
Concept Formation and Reasoning
Concept formation and reasoning refers to the quality or process of thinking and was tested in 3 studies with conflicting results. While a randomized cross-over study and cohort study found that subjects given estrogen improved in abstract reasoning scores compared with when they took placebo,12, 40 a New York-based cohort study did not find that scores for ever-users changed over 2.5 years compared with never-users.44
Motor Speed
Motor speed, as measured by simple reaction time, was improved by 150 milliseconds in symptomatic postmenopausal women given estrogen in 1 study20 but not another.35 Users had improvement in clerical speed and accuracy in a third study.12
Dementia Screening Measures
In 2 early studies, women given estrogen did not have improvement in mental status as measured by the Mini-Mental State Examination or Cognitive Capacity Screening Examination.43, 45-46 However, this is not unexpected, given that the simplicity of the Mini-Mental State Examination for cognitively intact women might preclude finding subtle differences (ceiling effect). Two recent cohort studies using more sensitive multidimensional tests of cognition found that over time users performed better than nonusers.40-41
Verbal Function
Only 1 study40 of 4 found that users performed better than nonusers on tests of verbal functions and language skills.42, 44-45 Users of unopposed estrogen were more fluent in naming categories.40
Influence of Symptoms
In the randomized controlled trials, changes in cognitive measures were most likely to occur in symptomatic women (Table 1). In all 4 trials in women with somatic complaints, estrogen improved at least 1 cognitive function.12, 20, 36, 38-39 The cognitive processes that were most consistently improved were verbal recall12, 36, 42, 44 and vigilance,20, 39 although complex attention,20, 39 mental tracking,12, 20 concept formation and reasoning,12 and motor speed12, 20 were also affected.
The 2 randomized trials in asymptomatic women found no enhancement of cognitive function.33, 37 Two trials that did not state the symptom profile of subjects also showed no improvement. One of these, a cross-over study of 62 women using transdermal estrogen for 3 months, used sensitive tests (outcomes measured in milliseconds) and had a power of 90%.35
Effects of Progestins
All of the randomized controlled trials used unopposed estrogen. The 4 cohort studies that looked at the type of HRT found that most (> 70%) of the women used unopposed oral conjugated equine estrogen.42, 44-46 One recent cohort study looked separately at users of unopposed and combined HRT regimens. Women currently using unopposed estrogen had more improvement in global cognition, abstract reasoning, and category fluency, compared with never-users. However, current users of estrogen combined with progestin had a decline in global cognition and mental tracking scores.40
Formulation, Dose, and Duration
Subjects in the randomized controlled trials used a variety of preparations and doses. Because the randomized controlled trials lasted only several months, information about duration comes from cohort studies. The 1 cohort study that looked at duration found that users of greater than 20 years scored slightly higher on 1 of 9 cognitive measures.45 Although 1 cohort study looking at recency of use actually found that past users had more benefit than current users,43 another study found that past users had scores intermediate between current and never-users.40
Effects on Dementia
Two cohort studies (Table 4) and 10 case-control studies (Table 5) on the association between postmenopausal estrogen use and risk of Alzheimer disease met inclusion criteria.
|
|
|
|
Table 4. Hormone Replacement Therapy (HRT) and Dementia in Cohort Studies*
|
|
|
|
|
|
|
Table 5. Hormone Replacement Therapy (HRT) and Dementia in Case-Control Studies*
|
|
|
The strongest evidence for an association between HRT and Alzheimer disease comes from 2 cohort studies (Table 4). Because users tend to be healthier and have healthier lifestyles as well as other differences, the raters did not feel that comparable groups were assembled and therefore rated both studies as fair. In the Manhattan Study of Aging, 156 ever-users of postmenopausal estrogen and 968 nonusers were followed up for 1 to 5 years.23 Users were significantly younger, more educated, less likely to be black, more likely to have undergone a hysterectomy, and younger at menopause. After controlling for education, age, and ethnicity, users were significantly less likely to develop Alzheimer disease (RR, 0.5; 95% CI, 0.25-0.9) and had a later age of onset. The Baltimore Longitudinal Study of Aging followed up 230 HRT users and 242 nonusers every 2 years for up to 16 years.22 Loss to follow-up and maintenance of comparable groups was not described. After controlling for age and education, users were significantly less likely to develop Alzheimer disease than nonusers (RR, 0.46; 95% CI, 0.21-1.0).
Most of the case-control studies had important methodological limitations: 8 were rated poor, 1 was rated fair, and 1 was rated good. Several studies used self-report for controls and proxy for cases.14, 25-26 In these studies, the risk estimates could indicate a spurious protective effect of estrogen because proxy respondents might not be aware of previous HRT exposure.52 ( Although Watkins et al53 believe proxys' responses are often correct, we still believe proxy bias is a potentially a significant limitation.) Some studies did not use blinded interviewers.28-31 Other studies did not control for education.24-25,28-31 Women who use HRT are generally more educated,54-56 and formal education has been found to be protective against dementia.57-58 Several of the studies only looked at current use of HRT.25-26,31 Women with dementia might have been less likely to receive HRT because of concerns about compliance or potential interactions with complex medication regimens. Finally, the largest case-control study used self-administered questionnaires completed 5 years before death to define HRT exposure and did not exclude women with early dementia.24 Women with early, subtle memory changes might be less likely to remember previous HRT use, causing a false-protective effect of HRT to be seen.
In the earlier case-control studies,28-31 HRT use was only 1 of many risk factors evaluated. These early case-control studies did not find an association between HRT and Alzheimer disease (OR, 0.78-2.38). All but one27 of the more recent case-control studies found significantly decreased risks of Alzheimer disease among users of postmenopausal estrogen (OR, 0.33-1.1) (Table 5). 13-14,24-27
Two case-control studies13, 27 were rated fair and good because they used objective methods to determine estrogen use. In 1 study, HRT was determined through blinded record abstraction.13 After controlling for age, education, and length of time in the linkage system, users of any form of postmenopausal estrogen for at least 6 months had a 58% risk reduction (OR, 0.42; 95% CI, 0.18-0.96). The second study used computerized pharmacy records to identify postmenopausal estrogen use.27 After controlling for age and history of hysterectomy, this study found no decreased risk of Alzheimer disease among ever-users of HRT (OR, 1.1; 95% CI, 0.6-1.8).
Only 1 study looked at dementia other than Alzheimer disease and found that women exposed to HRT had a 50% decreased risk of developing dementia secondary to ischemic vascular disease, although the 95% CI did not reach significance (OR, 0.50; 95% CI, 0.26-1.20).25
Bayesian Data Interpretation.
The results of these 2 cohort and 10 case-control studies were combined by meta-analysis. The test of heterogeneity indicated that the studies were not heterogeneous (P>.10). The fixed and random effects model did not differ, so we present only the random effects model.
The summary RR was 0.66 (95% CI, 0.53-0.82) (Figure 1). The estimates did not change substantially when case-control (RR, 0.71; 95% CI, 0.56-0.91) and cohort studies (RR, 0.50; 95% CI, 0.30-0.80) were analyzed separately or when poor quality studies were excluded (RR, 0.64; 95% CI, 0.32-1.06) although excluding poor quality studies made the result no longer significant. When studies with proxy bias were excluded (which was one of the factors considered in classifying a study as "poor") the RR was 0.72 (95% CI, 0.55-0.96). The summary RR was similar for studies looking only at Alzheimer disease or using only the strict clinical criteria of the work group of the National Institute of Neurological and Communicative Disorders and Stroke and the Alzheimer's Disease and Related Disorders Association (NINCDS-ADRDA). Using different prior distributions and excluding both a study with uncertain CIs31 and a study with a low SE (thus, a high weight)24 did not significantly change the risk estimate.
|
|
|
|
Figure. Results of Meta-analysis of Dementia Studies
|
|
|
Formulation, Dose, and Duration
Where reported, 66% to 95% of women used oral conjugated equine estrogen.13, 26-27 Data on the relation of dose, duration, and recency of treatment to response are scant, and results of studies that examined these relationships had conflicting results.13, 22-24,27
Only 1 study looked at the effect of progestins on Alzheimer disease risk. Adding progestin use to the logistic regression model did not significantly change the risk estimate.27
Finally, studies were evaluated for evidence of study selection bias. Some asymmetry was detected in the funnel plots, suggesting that study selection bias was possible although interpretation of the plots is subjective (data available from author on request).
COMMENT
Although the study populations and outcome measures differ and most of the studies have methodological shortcomings, the 9 randomized controlled trials and 8 cohort studies that we reviewed offer provisional conclusions about the effects of postmenopausal estrogen on cognition and risk of dementia. No deleterious effects on cognition have been reported. Estrogen does not appear to enhance asymptomatic women's performance consistently on formal cognitive testing; however, in symptomatic women, postmenopausal estrogen improved cognitive performance, especially in tests of verbal memory, vigilance, reasoning, and motor speed. There were not consistent effects on visual recall, working memory, complex attention, mental tracking, mental status, or verbal function. Symptomatic women taking estrogen might perform better on cognitive testing because they have fewer hot flashes and sleep better or have improved mood. However, affective changes would be expected to have broad effects on most cognitive functions, and this analysis showed that only some cognitive domains were affected by estrogen. Alternatively, the subtle effects of estrogen on cognition might only be apparent in subjects not performing at maximum cognitive ability because of sleep loss.
There is insufficient evidence about whether progestins attenuate these cognitive effects, the optimal estrogen formulation, or dose. Duration of use was not related to cognitive performance.
Two cohort and 10 case-control studies suggest that HRT users have a 34% decreased risk of Alzheimer disease (95% CI, 18%-47%). However, there are limitations in the studies on which this estimate is based. The risk estimates may have shown a spuriously larger protective effect of HRT if proxy respondents for women with dementia were not aware of HRT exposure, if women with undiagnosed mild memory changes did not remember previous HRT use, or if women with dementia were less likely to receive HRT due to concerns about compliance or medical complications.
Also, HRT users might be less likely to develop Alzheimer disease not because of postmenopausal estrogen exposure but because they are healthier and have healthier lifestyles ("healthy user bias").59 Physical health status has been associated with cognitive changes with advancing age.60 Finally, we cannot exclude that studies that did not find a protective effect of HRT on dementia risk were less likely to be published although statistical tests on the data did not reveal this bias.
Whether estrogen is also associated with a decreased risk of other forms of dementia is unknown. No conclusions can be drawn about progestins or whether specific dosages or formulations of estrogen are more protective.
It has been proposed that HRT decreases the risk of dementia by improving cognition and delaying clinical disease onset. However, the studies we reviewed do not show a consistent improvement in the cognition of older women. In addition, 3 recent randomized controlled trials found HRT did not improve the cognitive function of women with dementia.61-63 Therefore, if the association between HRT and Alzheimer disease proves to be true and not the result of other variables such as education or health or mood, how HRT might prevent the neuropathological changes of Alzheimer disease will need to be explored further. Current theory suggests that HRT might promote the breakdown of -amyloid precursors, thereby preventing the development of neurofibrillary tangles, or it might stimulate dendritic spine density, promoting neuronal circuitry.3, 64
Large double-blind, placebo controlled trials with intervention arms containing estrogen with and without progestins are needed and 2 such primary prevention trials are under way.65-66 Of crucial importance in designing a study of cognition is deciding on cognitive measures. These must be sensitive to small differences because a subtle decline in cognitive function may have important clinical consequences, for instance reducing the quality of interpersonal or intellectual life. They should examine particular cognitive domains, such as verbal memory and vigilance, as the evidence indicates that estrogen has neural and cognitive specificity. This review demonstrates the need for a large standardized data set with a hierarchy of cognitive measures to distinguish which domains and neural systems are affected by HRT. Results for all cognitive measures studied, not just those with statistical significance, should be reported in a way that the magnitude of the effect is clear. In addition, future trials should include functional outcome measures, such as activities of daily living or progression to nursing home care.
Clinicians are confronted with questions about the efficacy of HRT for cognitive health and dementia prevention. The analysis presented herein distinguishes these issues and should help physicians advise patients on what has become a complex body of evidence. From a clinical perspective, the most important conclusion is that HRT improves some cognitive functions in symptomatic women. However, it may not affect all cognitive processes equally. Which cognitive functions and the strength of HRT's effects cannot be determined from the current literature. Only future randomized trials can determine whether HRT use also prevents Alzheimer disease.
ADDENDUM
After this study was conducted, the literature search described herein was updated. In the period from August 2000 to February 2001, 1 additional study67 that met selection criteria was published. Thirty-seven women (mean [SD] age 65 [4.9] years) without menopausal symptoms were randomized in double-blind fashion to 3 weeks of transdermal 17 -estradiol or placebo. The women receiving estrogen performed worse than those receiving placebo at baseline and subsequently improved more on verbal and nonverbal memory and spatial cognition tasks. Although the improvement was not statistically significant in the primary analysis, an exploratory analysis combining multiple memory or spatial cognitive measures suggested a beneficial effect of estrogen. Estrogen did not enhance performance on working memory tasks. The additional study does not change our conclusions.
AUTHOR INFORMATION
Author Contributions: Study concept and design: LeBlanc, Janowsky, and Nelson.
Acquisition of data: LeBlanc and Nelson.
Analysis and interpretation of data: LeBlanc, Janowsky, Chan, and Nelson.
Drafting of the manuscript: LeBlanc, Nelson, and Chan.
Critical revision of the manuscript for important intellectual content: LeBlanc and Janowsky.
Statistical expertise: Chan.
Obtained funding: Nelson.
Administrative, technical, or material support: Janowsky and Nelson.
Study supervision: Janowsky and Nelson.
Funding/Support: This study was conducted under contract 290-97-0018, task order 2 from the Oregon Health Sciences University Evidence-based Practice Center under contract to the Agency for Healthcare Research and Quality Portland Veterans Affairs Medical Center Women's Health Fellowship, and grant AG12611 from the and National Institute on Aging, Rockville, Md.
Disclaimer: The authors of this article are responsible for its contents, including any clinical or treatment recommendations. No statement in this article should be construed as an official position of the Agency for Healthcare Research and Quality or the US Department of Health and Human Services.
Acknowledgment: We gratefully thank Mark Helfand, MD, from the Evidence-based Practice Center for his thoughtful review of the manuscript. We also thank Janet Allan, MD, Risa Lavizzo-Mourey, MD, and Steven Teutsch, MD, from the USPSTF, and Eric Orwoll, MD, for their helpful comments on earlier versions of this review. We are grateful to Peggy Nygren for her assistance with preparation of the manuscript.
| Box 1. Criteria for Grading Quality of Randomized Controlled Trials: The Jadad Score16
Study received 1 point for each yes or 0 point for each no for each of the following questions:
- Was the study described as randomized such as using the words randomly, random, and randomization?
a. An additional point was given if method of randomization was described and it was appropriate (for example, table of random numbers, computer generated)
b. A point was deducted if the method of randomization was inappropriate (for example, patients allocated alternately by birth date or hospital number)
- Was the study described as double blind?
a. A point was given if method of blinding was described and it was appropriate (for example, identical placebo)
b. An additional point was deducted if method of blinding was inappropriate (for example, comparing placebo tablet with injection)
- Was there a description of withdrawals and dropouts?
Maximum number of points is 5.
RETURN TO TEXT |
|
| Box 2. Criteria for Grading the Internal Validity of Individual Studies
The Methods Work Group for the US Preventive Services Task Force (USPSTF) developed a set of criteria to determine how well individual studies were conducted (internal validity).17 Presented below are a set of minimal criteria for case-control and cohort study designs. The Task Force also defined a 3-category rating of "good," "fair," and "poor," based on these criteria. In general, a good study is one that meets all criteria well. A fair study is one that does not meet (or it is not clear that it meets) at least one criterion but has no known important limitation that could invalidate its results. A poor study has important limitations. These specifications are not meant to be rigid rules but rather are intended to be general guidelines, and individual exceptions, when explicitly explained and justified, can be made.
Case-Control Studies
- Accurate ascertainment of cases
- Nonbiased selection of cases/controls with exclusion criteria applied equally to both
- High response rate
- Diagnostic testing procedures applied equally to each group
- Measurement of exposure accurate and applied equally to each group
- Appropriate attention to potential confounding variables
Cohort Studies
- Initial assembly of comparable groups: consideration of potential confounders with either restriction or measurement for adjustment in the analysis; consideration of inception cohorts
- Maintenance of comparable groups (includes attrition, cross-overs, adherence, contamination)
- Important differential loss to follow-up or overall high loss to follow-up
- Measurements: equal, reliable, and valid (includes masking of outcome assessment)
- Clear definition of interventions
- Important outcomes considered
- Analysis: adjustment for potential confounders
RETURN TO TEXT |
|
Corresponding Author and Reprints: Erin S. LeBlanc, MD, MPH, Oregon Health Sciences University, 3181 SW Sam Jackson Park Rd, Mail Code HRC3, Portland, OR 97201-3098 (e-mail: leblance{at}ohsu.edu).
Author Affiliations: Evidence-based Practice Center (Drs LeBlanc and Nelson and Mr Chan) and the Departments of Medicine (Dr LeBlanc) and Neurology (Dr Janowsky), and Division of Medical Informatics and Outcomes Research (Dr Nelson and Mr Chan), Oregon Health Sciences University, and Medical Service (Dr Nelson), Veterans Affairs Medical Center, Portland.
REFERENCES
1. Smith CA, McCleary CA, Murdock GA, et al. Lifelong estrogen exposure and cognitive performance in elderly women. Brain Cogn. 1999;39:203-218.
FULL TEXT
|
ISI
| PUBMED
2. Yaffe K, Browner W, Cauley J, Launer L, Harris T. Association between bone mineral density and cognitive decline in older women. J Am Geriatr Soc. 1999;47:1176-1182.
ISI
| PUBMED
|