You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT JAMA
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 281 No. 14, April 14, 1999 TABLE OF CONTENTS
  JAMA
  •  Online Features
  Review
 This Article
 •Abstract
 •PDF
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on HighWire
 •Citing articles on Web of Science (193)
 •Contact me when this article is cited
 Related Content
 •Related articles
 •Similar articles in JAMA
 Topic Collections
 •Substance Abuse/ Alcoholism
 •Review
 •Alert me on articles by topic
 Social Bookmarking
  Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit Add to Technorati Add to Twitter What's this?

Pharmacological Treatment of Alcohol Dependence

A Review of the Evidence

James C. Garbutt, MD; Suzanne L. West, PhD, MPH; Timothy S. Carey, MD, MPH; Kathleen N. Lohr, PhD; Fulton T. Crews, PhD

JAMA. 1999;281:1318-1325.

ABSTRACT

Context  Alcoholism affects approximately 10% of Americans at some time in their lives. Treatment consists of psychosocial interventions, pharmacological interventions, or both, but which drugs are most effective at enhancing abstinence and preventing relapse has not been systematically reviewed.

Objective  To evaluate the efficacy of 5 categories of drugs used to treat alcohol dependence—disulfiram, the opioid antagonists naltrexone and nalmefene, acamprosate, various serotonergic agents (including selective serotonergic reuptake inhibitors), and lithium.

Data Sources  Reports of randomized controlled trials, nonrandomized trials, and other study designs in English, French, and German identified from multiple searches of MEDLINE, EMBASE, and specialized databases; hand searching bibliographies of review articles; searches for unpublished literature; and discussions with investigators in the field.

Study Selection  We included all studies on alcohol-dependent human subjects aged 18 years or older from all inpatient and outpatient settings between 1966 and December 1997 that met our inclusion criteria.

Data Extraction  We abstracted the following information: study design and blinding, diagnostic instrument and severity assessment, drug interventions and cointerventions, demographic and comorbidity details about patients, compliance, and numerous outcome measures (eg, relapse, return to drinking, drinking or nondrinking days, time to first drink, alcohol consumed per unit of time, craving). We graded quality of the individual articles (scale, 0-100) independently from the strength of evidence for each drug class (A, strong and consistent evidence of efficacy in studies of large size and/or high quality; B, mixed evidence of efficacy; C, evidence of lack of efficacy; and I, insufficient evidence).

Data Synthesis  Of 375 articles evaluated, we abstracted and analyzed data from 41 studies and 11 follow-up or subgroup studies. Naltrexone (grade A) reduces the risk of relapse to heavy drinking and the frequency of drinking compared with placebo but does not substantially enhance abstinence, ie, avoidance of any alcohol consumption. Acamprosate (grade A, from large-scale studies in Europe) reduces drinking frequency, although its effects on enhancing abstinence or reducing time to first drink are less clear. Controlled studies of disulfiram (grade B) reveal a mixed outcome pattern—some evidence that drinking frequency is reduced but minimal evidence to support improved continuous abstinence rates. The limited data on serotonergic agents were not very promising (grade I), although most studies were confounded by high rates of comorbid mood disorders. Lithium lacks efficacy (grade C) in the treatment of primary alcohol dependence.

Conclusions  Recent reports documenting that naltrexone and acamprosate are more effective than placebo in the treatment of alcoholism justify clinical interest in use of these medications for alcohol-dependent patients. Use of disulfiram is widespread but less clearly supported by the clinical trial evidence; however, targeted studies on supervised administration of disulfiram may be warranted. Use of existing serotonergic agents or lithium for patients with primary alcohol dependence does not appear to be supported by the efficacy data available at this time; these medications may still have a positive effect in patients with coexisting psychiatric disorders.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Conclusion
 •Author information
 •References

Alcohol dependence, or alcoholism, is often a progressive chronic disorder that both the American Medical Association and the American Psychiatric Association recognize as a disease.1 It is a common disorder posing a heavy burden on patients, their families, and society. Epidemiological studies indicate that alcoholism will affect approximately 10% of Americans at some time in their lives, with men affected more than women.2-5 This is a high prevalence rate compared with many other diseases and highlights the public health significance of alcohol dependence. In addition to the estimated 100,000 US citizens who die each year because of alcohol-related causes, including traffic collisions and cirrhosis of the liver,6 alcoholism costs the nation an estimated $166 billion annually in direct and indirect health and social costs.7

Treating alcoholism involves several stages. The initial stage deals with acute withdrawal and detoxification.8 Later stages attempt to maintain patients in remission and develop a lifestyle compatible with long-term abstinence (ie, avoidance of any alcohol consumption). This latter aspect of patient management has traditionally involved psychosocial interventions (including Alcoholics Anonymous and various counseling approaches), pharmacological modalities (primarily disulfiram), and combinations of both. Although many individuals do achieve long-term sobriety with treatment, others continue to relapse and deteriorate despite multiple courses of treatment. Pharmacological treatment is emerging as another means to enhance abstinence and prevent relapse, complementing psychosocial interventions that have been in use for many years. The findings we report here are part of a rigorous systematic review of the relevant scientific literature on the pharmacological treatment of alcoholism conducted by the Research Triangle Institute–University of North Carolina at Chapel Hill Evidence-based Practice Center and sponsored by the Agency for Health Care Policy and Research (AHCPR).9


METHODS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Conclusion
 •Author information
 •References

Drugs and Outcomes Reviewed

We conducted a detailed search of the scientific literature on 5 classes of drugs.9 We focused on early drugs used for alcoholism (disulfiram and lithium) and pharmacotherapies that have been used more recently (the opiate antagonists naltrexone and nalmefene, acamprosate, and various serotonergic agents) (Table 1). These classes of medications represent the major agents used or recently tested for the treatment of alcohol dependence after alcohol withdrawal.


View this table:
[in this window]
[in a new window]
Table 1. Pharmacotherapies Used for Maintaining Abstinence in Alcohol-Dependent Patients


With the advice of a technical expert advisory group (see "Acknowledgment" section), we developed study questions and methods. We reviewed the efficacy of these agents for reduction in the number of standard drinks of alcohol, reduction in the number of drinking days (or increase in the number of nondrinking days), overall resumption of drinking, number of episodes of heavy drinking, time to first drink, reduction in the rate of relapse determined by a priori criteria, and craving. Our results are drawn largely from intention-to-treat analyses; the full evidence report9 provides information on subgroup and follow-up analyses, occurrence rates of adverse effects, and patient compliance.

Literature Searched Table 2 shows the inclusion and exclusion criteria for articles selected for review. We used the following databases: MEDLINE, HealthSTAR, the American Society of Health-System Pharmacists International Pharmaceutical Abstracts database, EMBASE, Alcohol and Alcohol Problems Database, and PsycINFO. Search strategies included all medications of interest and related classes of medications, alcoholism, alcohol drinking, and study and design characteristics. We also reviewed materials available from the Cochrane Collaboration, published abstracts, and US Food and Drug Administration documents.


View this table:
[in this window]
[in a new window]
Table 2. Pharmacotherapy for Alcohol Dependence: Inclusion/Exclusion Criteria


To obtain data for our evidence tables, we developed a data extraction form, a follow-up results form, a comorbid study results form, an adverse-effect profile, and an extraction guide. We used dual abstraction procedures (1 content reviewer and 1 methods reviewer); the principal investigators (S.L.W. and J.C.G.) completed a third conflict-resolution review.

To assess the quality of individual articles, reviewers completed a quality rating form covering study design, diagnostic and outcome measures, statistical analyses, and discussion. The form used standard methodological items, such as loss to follow-up, blinding, and comparability between treatment groups. It also included items specific to alcohol dependence, such as authors' alcoholism criteria and method of assessment. The quality score was independent of the article's findings on efficacy of the pharmacological intervention. Individual scores summed to 40 points and were rescaled to 100 points (scale available from the authors on request). We judged the overall strength of the evidence on efficacy based on the consistency across studies, quality of studies, sample size, and magnitude of effects (Table 3).


View this table:
[in this window]
[in a new window]
Table 3. Grade of Strength of Evidence on the Efficacy of Pharmacotherapies for Alcohol Dependence


After applying our inclusion and exclusion criteria and reviewing the titles and/or abstracts of 375 articles, we fully abstracted and analyzed data for 41 studies and 11 follow-up or subgroup evaluations, including 11 disulfiram studies, with 1 subgroup publication; 1 nalmefene article; 3 naltrexone studies, with 5 subgroup publications; 9 acamprosate articles; 9 serotonergic agent studies not restricted to comorbid populations, with 1 subgroup study; 3 serotonergic agent studies restricted to persons with coexisting depression or anxiety, with 1 subgroup analysis; and 6 lithium articles, with 3 subgroup analyses. One article addressed both fluoxetine and acamprosate. We did not exclude any articles from analysis on the basis of poor quality ratings; this judgment is reflected in the discussions and rating of the strength of evidence.


RESULTS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Conclusion
 •Author information
 •References

Primary Outcomes for Individual Medications

Table 4 shows the primary findings with evidence graded on the A-B-C-I scale defined in Table 3. When multiple citations refer to the same trial, only the original is included in Table 4. We included in Table 4 only those studies that provided information on standard alcohol outcomes, including drinking days, return to drinking, time to first drink, alcohol consumed per unit of time, episodes of heavy drinking, craving, or relapse.


View this table:
[in this window]
[in a new window]
Table 4. Randomized Controlled Trials to Evaluate the Efficacy of Pharmacotherapies Used for Maintaining Abstinence in Alcohol-Dependent Patients*


Disulfiram. Although the literature is substantial on use of this drug to treat alcoholism (135 studies), the number of controlled clinical trials is limited; of the 11 trials we reviewed, 5 concerned oral disulfiram10-15 and the remainder studied disulfiram implants.16-21

Oral Disulfiram (Maintenance Dosage, 200-250 mg/d). The 5 oral disulfiram studies involved 1207 subjects; 3 were placebo controlled and used double-blind random assignment.10-11,13 Outcome measures and results varied; they provide modest evidence that disulfiram reduces drinking frequencies without significantly enhancing abstinence rates (Table 4). The only group that studied supervised administration of the drug found that subjects taking disulfiram had significantly improved outcomes in drinking frequency and amount consumed14; however, the trial did not maintain double-blind standards (subjects were told after randomization if they were receiving disulfiram).

Disulfiram Implants (1-Time Dose, 800-1000 mg). Although implants of disulfiram appear to be an attractive method to ensure compliance, the bioavailability of disulfiram following implantation has not been demonstrated in the therapeutic trials. Six studies (combined enrollment, n = 282) used disulfiram implants; 5 used a placebo, most commonly a saline injection.17-21 The outcome measures reflect diverse results (Table 4).

We judged the efficacy evidence for disulfiram (modalities combined) as warranting a grade of B—inconsistent but positive evidence that disulfiram reduces the number of drinking days, and inconsistent but more often negative evidence about other outcome measures.

Opiate Antagonists. Of the 77 research articles identified, 3 controlled studies evaluated the efficacy of naltrexone in alcohol-dependent patients22-24 and 1 pilot study evaluated nalmefene.25 We also reviewed substudies of these trials.26-30

Naltrexone (50 mg/d). Although the overall sample size for the 3 naltrexone studies is modest (n = 271 randomized patients), the trials are recent and of good quality, with consistent results on relapse rates and drinking frequencies (Table 4). One study investigated the effect of both naltrexone vs placebo and supportive therapy vs coping skills therapy, thus providing the only work to address the interaction between pharmacological and psychosocial interventions.22 Naltrexone had a positive effect (on abstinence) only when combined with supportive psychotherapy; patients receiving naltrexone and coping skills therapy showed no such effect. Other outcomes show a more consistent pattern (Table 4). Among all patients in the first 2 trials,22-23 relapse rates at the end of the trials were higher for the placebo groups (54%23 and approximately 80%22) than for the naltrexone groups (23%23 and approximately 40%22). In a third trial,24 end-of-study relapse rates for all subjects were 53% and 35% for placebo and naltrexone patients, respectively; however, for compliant patients, the figures were 52% and 14%. Of 2 studies that measured a biological marker for alcohol consumption ({gamma}-glutamyl transpeptidase [GGTP]), one found that naltrexone recipients had significantly lower GGTP levels at the end of the trial24 and the other earlier trial had a nonsignificant trend in that direction.23 O'Malley et al28 studied patients for an additional 6 months after trial completion and found that compared with subjects receiving placebo, those receiving naltrexone had lower rates of heavy drinking. Reports on subsets of patients who sampled alcohol found that naltrexone diminished the subjective "high" after alcohol consumption.24, 26, 29

Nalmefene (10-40 mg/d). The nalmefene trial randomized 21 subjects to placebo and 2 nalmefene dosage groups; 8 subjects completed the study.25 The significant finding was a lower relapse rate in the high-dosage nalmefene group (data not shown).

The high quality of these trials coupled with the consistent finding for an effect of naltrexone in reducing relapse rates and drinking frequencies warranted a grade of A; we gave nalmefene a grade of I.

Acamprosate (1300-2000 mg/d). Of the 37 acamprosate studies identified in our literature search, we abstracted data for 9.31-39 A total of 2170 patients were enrolled; all trials used a double-blind method and 1 used a crossover design.31

The most consistent finding in the acamprosate trials has been its effect on drinking frequency (Table 4); nondrinking days were typically increased by 30% to 50% (eg, from 162 to 225 nondrinking days35). Several studies also found that acamprosate approximately doubled abstinence rates, although a majority of patients returned to drinking while taking acamprosate. The acamprosate trials did not assess relapse rates. Of 4 trials assessing GGTP, 2 reported improvements among acamprosate recipients,33, 39 1 indicated a trend toward improvement,34 and 1 reported no effect.35

Among subjects followed up for 48 weeks after trial completion, patients taking acamprosate showed a greater number of cumulative nondrinking days than did those receiving placebo since entry into the trial (387 vs 250 days) and a higher abstinence rate (40% vs 17%).35 Among subjects followed up for 12 months after trial completion, acamprosate continued to exert a positive effect on abstinence rates but not number of nondrinking days.36 Acamprosate recipients had higher rates of abstinence at 6 months after treatment than controls (43% vs 30%).39 Ladewig et al32 did not find a carryover effect for acamprosate up to 6 months after active treatment had ended, but this group also failed to find any effect for acamprosate during the latter part of their active trial.

Based on the large number of subjects and the consistent finding in the trials that acamprosate reduces drinking frequency, we gave acamprosate an efficacy rating of A.

Serotonergic Agents (Dosages Varied by Drug). We reviewed 3 classes of serotonergic agents: selective serotonin reuptake inhibitors (SSRIs, principally fluoxetine), buspirone hydrochloride, and ondansetron hydrochloride (Table 1). The US Food and Drug Administration approved SSRIs for use in depression and anxiety disorders, buspirone for anxiety, and ondansetron for nausea. In recent years, these drugs have been evaluated off label in alcohol dependence, especially when patients exhibit comorbid mood or anxiety disorders. Thus, an adequate examination of their effects on alcohol dependence must take into account whether an affective or anxiety disorder is present. We divided trials (Table 4) into those that studied alcohol-dependent individuals with varying rates of psychiatric comorbidity (including none)31, 40-47 and those that prospectively selected alcohol-dependent subjects with a known depressive or anxiety disorder.48-50

Trials in Subjects With Varying Rates of Comorbid Depression or Anxiety. The SSRI fluoxetine has been studied in 5 double-blind placebo-controlled trials (n = 227 subjects); 1 used a crossover design,31 2 used randomization,41-42 and 2 did not use randomization.40, 43 Outcomes are mixed regarding the efficacy of fluoxetine for alcohol-dependent patients. Citalopram had no effect on GGTP or episodes of heavy drinking.46 The 1 trial of buspirone (n = 57 subjects, using a double-blind placebo-controlled design) showed no therapeutic effect on several measures, including GGTP levels.47 One trial of ondansetron (n = 71 subjects, using a double-blind placebo-controlled design, with random assignment to high dosage [4 mg/d] and low dosage [0.5 mg/d]) found that low-dosage ondansetron reduced drinking only among light drinkers.45

Trials of Alcohol-Dependent Subjects With Depression or Anxiety. Trials among patients who also had depression or anxiety totaled 179 subjects (n = 51 for a fluoxetine trial50; n = 128 for 2 buspirone trials48-49). Depressed alcohol-dependent patients taking fluoxetine showed improved amount and frequency of drinking compared with those receiving placebo; the buspirone studies showed only 1 positive change in drinking outcomes (time to first drink).

Generally, the studies of fluoxetine involved a modest number of patients and results are at best mixed, as is true of the buspirone and ondansetron studies. We judged that the limited nature of these data warranted efficacy ratings of I.

Lithium (Dosages and Blood Levels Varied). Six trials and 3 related substudies (n = 823 subjects) have appeared on the effects of lithium in alcohol-dependent subjects with and without depression or bipolar disorder51-59; about 55% of all subjects were studied in the large cooperative trial sponsored by the Department of Veterans Affairs.58 All trials (Table 4) reported comorbid depression in subjects; only 2 controlled for depression in their data analyses.52, 58 The strongest and largest trial found no positive effect for lithium in either depressed or nondepressed alcoholic-dependent subjects.58 One study (not controlling for comorbidity) found improved drinking outcomes in subjects with high lithium levels (compliant by definition).57

Based on the negative findings of the large well-conducted study and the fact that all positive findings with lithium were limited to studies that did not control for comorbidity, we gave lithium an efficacy rating of C.

Secondary Measures

Compliance. In a clinical trial, the extent to which patients are compliant may affect whether a drug effect will be found. In the reviewed studies, investigators monitored compliance in diverse ways, including self-report, proxy report, pill counts at return visits, urine markers, and blood levels of active medication. The effect of compliance on outcome measures was rarely analyzed. In 2 cases in which compliance was studied, Fuller et al13 found that compliant subjects had improved outcomes regardless of assigned drug and Volpicelli et al24 found a positive outcome for naltrexone only in compliant subjects.

Adverse Events. In assessing the usefulness of a medication, clinicians must balance efficacy against risks (adverse effects, morbidity, and mortality). We noted risks (when described in the trials) and gathered information from 1 large safety and tolerability study of naltrexone.60 Given the incomplete picture of risk provided by clinical trials, the risk-benefit ratio for any of the reviewed medications cannot be fully specified. Disulfiram, lithium, SSRIs, and buspirone, although generally well tolerated, are associated with adverse effects and occasional morbidity. These trials reported no deaths attributed to any of these agents; dropout rates due to adverse effects, when reported, were low. In the naltrexone trials, no mortality was reported and the most common adverse effects were nausea and dizziness. The naltrexone safety and tolerability study60 reported higher rates for 2 adverse effects, new-onset nausea (9.8% for naltrexone vs 0% for nonmedication group) and headache (6.6% for naltrexone vs 1.7% for nonmedication group) and a 15% discontinuance rate for naltrexone subjects because of adverse effects. In the acamprosate trials, no mortality attributed to medication was reported. The most common adverse effect was diarrhea; dizziness, itching, and increased sexual desire were also significantly greater in the active vs placebo groups. Dropout rates were less than 1% for any 1 adverse effect.


COMMENT
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Conclusion
 •Author information
 •References

The pharmacotherapy of alcohol dependence has significantly changed during the past few years. The discovery of new medications may positively affect core components of the alcohol dependence syndrome, such as loss of control of drinking, preoccupation with alcohol use, or protracted abstinence symptoms. The development of new classes of medicines specifically effective for the primary symptoms of alcohol dependence represents an advance of historic importance.

Results from our evidence report9 that are reviewed here are noteworthy in 2 broad areas: (1) understanding the clinical implications of the efficacy of the reviewed medications and (2) addressing the remaining gaps in the knowledge base. No study examined the efficacy of these agents compared with each other; variations in study design, duration of follow-up, and outcome measures prevented comparison of these medications for relative efficacy.

Although we attempted to identify the nature and extent of psychosocial interventions based on information provided by the authors, typically these interventions were poorly described. Thus, the literature did not allow us to evaluate the important question of efficacy of pharmacotherapy when used in conjunction with varying types and intensities of psychosocial therapies.

Efficacy of Medications

Naltrexone and Acamprosate. The interest generated by recent reports documenting that naltrexone and acamprosate are more effective than placebo in the treatment of alcoholism appears warranted by the strength of the evidence (evidence grade, A), showing their efficacy among alcohol-dependent patients. The naltrexone trials involved a modest number of subjects (n = 271), but the quality of the trials was high and the findings consistently showed that naltrexone reduced drinking frequency and relapse rates, controlling for compliance. Although requiring confirmation, naltrexone's primary effect appears to be its ability to reduce the patient's emotional response to alcohol consumption; this may deter patients who sample alcohol from progressing to heavy drinking (relapse) and decrease alcohol intake over time. Other actions of naltrexone are likely operative, given the evidence that abstinence was enhanced in 2 of the 3 trials. The clinical impact of naltrexone is not yet clear—for some patients it may be profound, for others it may bring no benefit. Current work will expand this knowledge base considerably; 18 National Institute on Alcohol Abuse and Alcoholism (NIAAA)–sponsored trials targeting approximately 3000 subjects and 1 multisite Department of Veterans Affairs study involving 600 subjects are under way or just completed.

The acamprosate trials involved a large number of subjects (n = 2170), were of moderate to good quality, and consistently showed positive effects on reducing drinking frequency, with some evidence of enhancing abstinence. The acamprosate trials have been limited to European populations, although results from a just-completed US-based, placebo-controlled, double-blind, multisite trial sponsored by Lipha Pharmaceuticals Inc, New York, NY (n = {approx}450 subjects), should be published within the next year. To date, acamprosate has not been used clinically in the United States; its impact on US practice is not yet clear.

Disulfiram. The disulfiram trials (evidence grade, B) were less consistent in both quality and results; they provided moderate evidence of reduced drinking frequency but no evidence of enhanced abstinence. Supervised disulfiram administration has been posited as a particularly effective treatment method,61 but the only placebo-controlled trial with this approach did not maintain double-blind conditions.14 The bioavailability of implanted disulfiram was not shown; alcohol challenges after implantation did not produce a disulfiram-ethanol reaction.

Disulfiram presents an interesting clinical dilemma. It has been used for close to 50 years and many practitioners believe it has great value. Nevertheless, the controlled clinical trials yield ambiguous conclusions about its efficacy. Is this divergence between clinical practice and clinical trials a real phenomenon? On one hand, given the appropriate subjects and research design (eg, supervised administration), disulfiram might demonstrate greater efficacy than in the data we reviewed. On the other hand, a large portion of the disulfiram effect is related to fear of a disulfiram-ethanol reaction; hence, in a placebo-controlled trial, an active drug effect would be more difficult to ascertain.

Serotonergic Agents and Lithium. The controlled studies of serotonergic agents were limited and yielded mixed results (evidence grade, I). Coexisting mood and anxiety disorders greatly complicate interpretation of the findings, but the limited evidence available does not support the use of serotonergic agents for treating primary alcohol-dependent patients. The 2 studies that evaluated buspirone in alcohol-dependent subjects with anxiety had primarily negative effects, although 1 was suggestive for some positive effects.49 The 1 fluoxetine trial in alcohol-dependent subjects with depression was positive.50 This minimal database on these medications will be greatly expanded by a Pfizer Inc (New York, NY) multisite trial of the SSRI sertraline hydrochloride for clinically depressed alcohol-dependent subjects and by 7 NIAAA trials (n = {approx}1100 subjects).

The controlled trials of lithium did not demonstrate efficacy in either nondepressed or depressed alcohol-dependent subjects (evidence grade, C). We concluded that the literature does not support use of lithium for treatment of primary alcohol dependence.

Improving the Knowledge Base

Our evidence tables document significant variability in trial design.9 First, the alcohol outcomes measured in each study vary substantially. Of the work reviewed, 24 measured number of drinking/nondrinking days; 22, abstinence; 14, drinks per unit of time; 13, time to first drink; 12, at least 1 biological measure (eg, GGTP); and 6, a criteria-based definition of relapse. Second, the meaning and use of the term relapse vary considerably. In the naltrexone trials, a relapse is a bout of heavy use with an a priori definition, such as consuming at least 5 drinks per occasion (for men), whereas in the European acamprosate trials, relapse refers to return to any drinking. Third, the concept of craving is not often addressed; of 41 studies reviewed, 17 measured craving using many different assessment techniques. Fourth, compliance with medication was irregularly addressed. Fifth, the type and intensity of psychosocial treatment, as well as compliance with that treatment, were typically not described. Moreover, the presence of psychiatric disorders was sometimes not mentioned or, when acknowledged, was not controlled for in the analysis. Sixth, external validity and generalizability are problems because subjects were commonly recruited from specialized substance abuse settings; the requirements of many protocols would inevitably produce subject selection bias. In addition, dropout rates were, with some exceptions, in the 20% to 50% range and sometimes higher.

The lack of consistency in research design across these trials is a major issue that prohibits cross-study comparisons, and it deterred us from conducting meta-analyses of the pooled efficacy data in these studies. These methodological problems appear to be improving, but additional standardization (eg, uniform definitions, recommended core outcome measures for clinical trials) would clearly be an important advance, to which funding and professional organizations such as the NIAAA, the Research Society on Alcoholism, and the American Society of Addiction Medicine could contribute greatly.

Efficacy and Effectiveness of These Medications

Efficacy trials examine whether a health intervention works in an ideal treatment setting; effectiveness studies focus on the impact of an intervention in everyday settings. Now that efficacy has been established for at least some of the medications reviewed here, effectiveness issues in primary care settings should be examined, including:

  • Which psychosocial interventions are effective when combined with medication therapy?
  • Do combinations of pharmacological treatments have additive benefit with acceptable adverse effects?
  • What is the optimum duration of medication use (most studies to date have examined therapy for only 3-6 months)?

The work we reviewed invariably combined medications with some type of psychosocial intervention. Thus, these medications have been tested only in conjunction with psychosocial interventions; their effectiveness used in isolation is unknown. Although 2 medications, naltrexone and acamprosate, did bring clinically and statistically significant improvement compared with placebo in drinking outcomes, most subjects did resume drinking during treatment. Clinicians and researchers remain challenged by the problem of alcohol dependence; these pharmaceutical agents are only the beginning of improved treatment strategies.


Conclusion
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Conclusion
 •Author information
 •References

The pharmacotherapy of alcohol dependence is experiencing a major shift in direction. Traditional medications (such as disulfiram) that show limited efficacy may be used less frequently, although they may still have value. New medications, including naltrexone and acamprosate, are likely to be used at increasing rates, although additional clinical experience is needed to ascertain their range of effectiveness. We herald the advances in the pharmacotherapy of alcohol dependence as valuable developments, but we note that treatment of patients with alcoholism should continue to incorporate a biopsychosocial perspective in an effort to change a life from a pattern of addiction to a pattern of sobriety and improved physical, mental, and social health.


AUTHOR INFORMATION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Conclusion
 •Author information
 •References

Funding/Support: This study was supported by contract 290-97-0011 from the AHCPR.

Alternate Source: An executive summary of this report was posted on the Agency for Health Care Policy and Research Web site (http://www.ahcpr.gov/clinic/alcosumm.htm) in January 1999.

Acknowledgment: We acknowledge the assistance of Jacqueline Besteman, JD, MA, the AHCPR task order officer for the Evidence-based Practice Program; and Ernestine Murray, RN, MAS, the AHCPR task order officer for this project. We appreciate the considerable help of the members of the technical expert advisory group: Raymond F. Anton, MD, Center for Drug and Alcohol Programs, Medical College of South Carolina, Charleston; Raye Z. Litten III, PhD, the Treatment Research Branch of the NIAAA, Rockville, Md; Michael Mayo-Smith, MD, MPH, Manchester Veterans Affairs Medical Center, Manchester, NH; Charles P. O'Brien, MD, PhD, the Treatment Research Center of the University of Pennsylvania, Philadelphia; Stephanie S. O'Malley, PhD, Division of Substance Abuse Research, Yale University School of Medicine, New Haven, Conn; Linda L. Powell, MSW, CCSW, Employee Assistance Program, Merit Behavioral Care Corp, Raleigh, NC; William F. Renn, CCSW, CSAC, the Behavioral Medicine Center of Cumberland Hospital, Fayetteville, NC (now with the Department of Psychiatry, University of North Carolina at Chapel Hill); and Constance M. Weisner, DrPH, Alcohol Research Group and the Kaiser Permanente Medical Care Program, Berkeley, Calif. We thank the following staff from the University of North Carolina at Chapel Hill: Gordon DeFriese, PhD, codirector of the Research Triangle Institute–University of North Carolina at Chapel Hill Evidence-based Practice Center; Anne Jackman, MA, project administrator; David Overstreet, PhD; Alexei Kampov, PhD; Sue Tolleson-Rinehart, PhD; and Lynn Whitener, DrPH. We also thank the following Research Triangle Institute staff: Linda Lux, MPA, project administrator; Nancy Berkman, PhD; and Alicia Wilson, MS, RPh; as well as Linda Fonville for excellent secretarial work and Nicole Walker for skilled contract administration assistance.

Corresponding Author and Reprints: Suzanne L. West, PhD, MPH, Research Triangle Institute, 3040 Cornwallis Rd, PO Box 12194, Research Triangle Park, NC 27709-2194 (e-mail: swest{at}rti.org).

Author Affiliations: Departments of Psychiatry (Drs Garbutt and Crews), Medicine (Dr Carey), and Pharmacology (Dr Crews) and Bowles Center for Alcohol Studies (Drs Garbutt and Crews), School of Medicine, and the School of Public Health (Drs West and Lohr), University of North Carolina at Chapel Hill; and Research Triangle Institute, Research Triangle Park, NC (Drs West and Lohr).


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Conclusion
 •Author information
 •References

1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition. Washington, DC: American Psychiatric Association; 1994.
2. Regier DA, Farmer ME, Rae DS, et al. Comorbidity of mental disorders with alcohol and other drug abuse. JAMA. 1990;264:2511-2518. FREE FULL TEXT
3. Grant BF. Prevalence and correlates of alcohol use and DSM-IV alcohol dependence in the United States. J Stud Alcohol. 1997:58:464-473.
4. Grant BF, Harford TC, Dawson DA, Chou P, Dufour M, Pickering R. Prevalence of DSM-IV alcohol abuse and dependence: United States, 1992. Alcohol Health Res World. 1994;19:243-248.
5. Caetano R, Tam TW. Prevalence and correlates of DSM-IV and ICD-10 alcohol dependence. Alcohol Alcohol. 1995;30:177-186. FREE FULL TEXT
6. McGinnis JM, Foege WH. Actual causes of death in the United States. JAMA. 1993;270:2207-2212. FREE FULL TEXT
7. National Institute on Drug Abuse (NIDA), National Institute on Alcohol Abuse and Alcoholism (NIAAA). The Economic Costs of Alcohol and Drug Abuse in the United States, 1992. Bethesda, Md: National Institutes of Health, US Dept of Health and Human Services; 1998.
8. Mayo-Smith MF, for the American Society of Addiction Medicine Working Group for Practice Guideline on Pharmacological Management of Alcohol Withdrawal. Pharmacological management of alcohol withdrawal: a meta-analysis and evidence-based practice guideline. JAMA. 1997;278;144-151.
9. West SL, Garbutt JC, Carey TS, et al. Pharmacotherapy for Alcohol Dependence: Evidence Report No. 3. Rockville, Md: Agency for Health Care Policy and Research; 1999. AHCPR publication 99-E004.
10. Fuller RK, Roth HP. Disulfiram for the treatment of alcoholism. Ann Intern Med. 1979;90:901-904. FULL TEXT | ISI | PUBMED
11. Fuller R, Roth H, Long S. Compliance with disulfiram treatment of alcoholism. J Chronic Dis. 1983;36:161-170. FULL TEXT | ISI | PUBMED
12. Schuckit MA. A one-year follow-up of men alcoholics given disulfiram. J Stud Alcohol. 1985;46:191-195. ISI | PUBMED
13. Fuller RK, Branchey L, Brightwell DR, et al. Disulfiram treatment of alcoholism. JAMA. 1986;256:1449-1455. FREE FULL TEXT
14. Chick J, Gough K, Falkowski W, et al. Disulfiram treatment of alcoholism. Br J Psychiatry. 1992;161:84-89. FREE FULL TEXT
15. Bischof T, Bucher J, Battig B, Frei A. Disulfiram in the treatment of alcoholic patients [in German]. Schweiz Rundsch Med Prax. 1995;84:698-702. PUBMED
16. Whyte CR, O'Brien PM. Disulfiram implant: a controlled trial. Br J Psychiatry. 1974;124:42-44. ISI | PUBMED
17. Wilson A, Davidson WJ, White J. Disulfiram implantation: placebo, psychological deterrent, and pharmacological deterrent effects. Br J Psychiatry. 1976;129:277-280. FREE FULL TEXT
18. Wilson A, Davidson WJ, Blanchard R, White J. Disulfiram implantation. J Stud Alcohol. 1978;39:809-819. ISI | PUBMED
19. Wilson A, Davidson WJ, Blanchard R. Disulfiram implantation: a trial using placebo implants and two types of controls. J Stud Alcohol. 1980;41:429-436. ISI | PUBMED
20. Johnsen J, Stowell A, Bache-Wiig JE, et al. A double-blind placebo controlled study of male alcoholics given a subcutaneous disulfiram implantation. Br J Addict. 1987;82:607-613. FULL TEXT | ISI | PUBMED
21. Johnsen J, Morland J. Disulfiram implant: a double-blind placebo controlled follow-up on treatment outcome. Alcohol Clin Exp Res. 1991;15:532-536. FULL TEXT | ISI | PUBMED
22. O'Malley SS, Jaffe A, Chang G, et al. Naltrexone and coping skills therapy for alcohol dependence: a controlled study. Arch Gen Psychiatry. 1992;49:881-887. FREE FULL TEXT
23. Volpicelli JR, Alterman AI, Hayashida M, O'Brien CP. Naltrexone in the treatment of alcohol dependence. Arch Gen Psychiatry. 1992;49:876-880. FREE FULL TEXT
24. Volpicelli JR, Rhines KC, Rhines JS, et al. Naltrexone and alcohol dependence: role of subject compliance. Arch Gen Psychiatry. 1997;54:737-742. FREE FULL TEXT
25. Mason BJ, Ritvo EC, Morgan RO, et al. A double-blind, placebo-controlled pilot study to evaluate the efficacy and safety of oral nalmefene HCl for alcohol dependence. Alcohol Clin Exp Res. 1994;18:1162-1167. FULL TEXT | ISI | PUBMED
26. Volpicelli JR, Watson NT, King AC, Sherman CE, O'Brien CP. Effect of naltrexone on alcohol "high" in alcoholics. Am J Psychiatry. 1995;152:613-615. FREE FULL TEXT
27. Volpicelli JR, Clay KL, Watson NT, O'Brien CP. Naltrexone in the treatment of alcoholism. J Clin Psychiatry. 1995;56:39-44.
28. O'Malley SS, Jaffe AJ, Chang G, et al. Six-month follow-up of naltrexone and psychotherapy for alcohol dependence. Arch Gen Psychiatry. 1996;53:217-224. FREE FULL TEXT
29. O'Malley SS, Jaffe AJ, Rode S, Rounsaville BJ. Experience of a "slip" among alcoholics treated with naltrexone or placebo. Am J Psychiatry. 1996;153:281-283. FREE FULL TEXT
30. O'Brien CP, Volpicelli LA, Volpicelli JR. Naltrexone in the treatment of alcoholism: a clinical review. Alcohol. 1996;13:35-39. FULL TEXT | ISI | PUBMED
31. Gerra G, Caccavari R, Delsignore R, Bocchi R, Fertonani G, Passeri M. Effects of fluoxetine and ca-acetyl-homotaurinate on alcohol intake in familial and nonfamilial alcoholic patients. Curr Ther Res. 1992;52:291-295. FULL TEXT
32. Ladewig D, Knecht T, Leher P, Fendl A. Acamprosate: a stabilizing factor in long-term withdrawal of alcoholic patients [in German]. Ther Umsch. 1993;50:182-188. PUBMED
33. Paille FM, Guelfi JD, Perkins AC, Royer RJ, Steru L, Parot P. Double-blind randomized multicentre trial of acamprosate in maintaining abstinence from alcohol. Alcohol Alcohol. 1995;30:239-247. FREE FULL TEXT
34. Roussaux JP, Hers D, Ferauge M. Does acamprosate diminish the appetite for alcohol in weaned alcoholics? [in French]. J Pharm Belg. 1996;51:65-68. PUBMED
35. Sass H, Soyka M, Mann K, Zieglgansberger W. Relapse prevention by acamprosate. Arch Gen Psychiatry. 1996;53:673-680. FREE FULL TEXT
36. Whitworth AB, Fischer F, Lesch OM, et al. Comparison of acamprosate and placebo in long-term treatment of alcohol dependence. Lancet. 1996;347:1438-1442. FULL TEXT | ISI | PUBMED
37. Geerlings PJ, Ansoms C, Van den Brink W. Acamprosate and prevention of relapse in alcoholics. Eur Addict Res. 1997;3:129-137.
38. Pelc I, Verbanck P, Le Bon O, Gavrilovic M, Lion K, Lehert P. Efficacy and safety of acamprosate in the treatment of detoxified alcohol-dependent patients. Br J Psychiatry. 1997;170:73-77.
39. Poldrugo F. Acamprosate treatment in a long-term community-based alcohol rehabilitation programme. Addiction. 1997;92:1537-1546. FULL TEXT | ISI | PUBMED
40. Gorelick DA, Paredes A. Effect of fluoxetine on alcohol consumption in male alcoholics. Alcohol Clin Exp Res. 1992;16:261-265. FULL TEXT | ISI | PUBMED
41. Kranzler HR, Burleson JA, Korner P, et al. Placebo-controlled trial of fluoxetine as an adjunct to relapse prevention in alcoholics. Am J Psychiatry. 1995;152:391-397. FREE FULL TEXT
42. Janiri L, Gobbi G, Mannelli P, Pozzi G, Serretti A, Tempesta E. Effects of fluoxetine at antidepressant doses on short-term outcome of detoxified alcoholics. Int Clin Psychopharmacol. 1996;11:109-117. ISI | PUBMED
43. Kabel DI, Petty F. A placebo-controlled, double-blind study of fluoxetine in severe alcohol dependence. Alcohol Clin Exp Res. 1996;20:780-784. FULL TEXT | ISI | PUBMED
44. Kranzler HR., Burleson JA, Brown J, Babor TF. Fluoxetine treatment seems to reduce the beneficial effects of cognitive-behavioral therapy in type B alcoholics. Alcohol Clin Exp Res. 1996;20:1534-1541. FULL TEXT | ISI | PUBMED
45. Sellers EM, Toneatto T, Romach MK, Somer GR, Sobell LC, Sobell MB. Clinical efficacy of the 5-HT3 antagonist ondansetron in alcohol abuse and dependence. Alcohol Clin Exp Res. 1994;18:879-885. FULL TEXT | ISI | PUBMED
46. Tiihonen J, Ryynanen OP, Kauhanen J, Hakola HP, Salaspuro M. Citalopram in the treatment of alcoholism. Pharmacopsychiatry. 1996;29:27-29. ISI | PUBMED
47. Malec E, Malec T, Gagne MA, Dongier M. Buspirone in the treatment of alcohol dependence. Alcohol Clin Exp Res. 1996;20:307-312. FULL TEXT | ISI | PUBMED
48. Malcolm R, Anton RF, Randall CL, et al. A placebo-controlled trial of buspirone in anxious inpatient alcoholics. Alcohol Clin Exp Res. 1992;16:1007-1013. FULL TEXT | ISI | PUBMED
49. Kranzler HR, Burleson JA, Del Boca FK, et al. Buspirone treatment of anxious alcoholics. Arch Gen Psychiatry. 1994;51:720-731. FREE FULL TEXT
50. Cornelius JR, Salloum IM, Ehler JG, et al. Fluoxetine in depressed alcoholics: a double-blind, placebo-controlled trial. Arch Gen Psychiatry. 1997;54:700-705. FREE FULL TEXT
51. Kline NS, Wren JC, Cooper TB, Varga E, Canal O. Evaluation of lithium therapy in chronic and periodic alcoholism. Am J Med Sci. 1974;268:15-22. FULL TEXT | ISI | PUBMED
52. Merry J, Reynolds CM, Bailey J, Coppen A. Prophylactic treatment of alcoholism by lithium carbonate. Lancet. 1976;1:481-482. PUBMED
53. Pond SM, Becker CE, Vandervoort R, et al. An evaluation of the effects of lithium in the treatment of chronic alcoholism, I. Alcohol Clin Exp Res. 1981;5:247-251. ISI | PUBMED
54. Fawcett J, Clark DC, Gibbons RD, et al. Evaluation of lithium therapy for alcoholism. J Clin Psychiatry. 1984;45:494-499. ISI | PUBMED
55. Fawcett J, Clark DC, Aagesen CA, et al. A double-blind, placebo-controlled trial of lithium carbonate therapy for alcoholism. Arch Gen Psychiatry. 1987;44:248-256. FREE FULL TEXT
56. de la Fuente JR, Morse RM, Niven RG, Ilstrup DM. A controlled study of lithium carbonate in the treatment of alcoholism. Mayo Clin Proc. 1989;64:177-180. ISI | PUBMED
57. Clark DC, Fawcett J. Does lithium carbonate therapy for alcoholism deter relapse drinking? Recent Dev Alcohol. 1989;7:315-328. PUBMED
58. Dorus W, Ostrow DG, Anton R, et al. Lithium treatment of depressed and nondepressed alcoholics. JAMA. 1989;262:1646-1652. FREE FULL TEXT
59. Pisani VD, Fawcett J, Clark DC, McGuire M. The relative contributions of medication adherence and AA meeting attendance to abstinent outcome for chronic alcoholics. J Stud Alcohol. 1993;54:115-119. ISI | PUBMED
60. Croop RSM, Faulkner EB, Labriola DFP, for the Naltrexone Usage Study Group. The safety profile of naltrexone in the treatment of alcoholism. Arch Gen Psychiatry. 1997;54:1130-1135. FREE FULL TEXT
61. Brewer C. Recent developments in disulfiram treatment. Alcohol Alcohol. 1993;28:383-395. FREE FULL TEXT


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter     What's this?

RELATED ARTICLES

April 14, 1999
JAMA. 1999;281(14):1347-1348.
EXTRACT | FULL TEXT  

Do you have a drinking problem?
JAMA. 1999;281(14):1352.
PDF  


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Alcohol abuse and pulmonary disease
Boe et al.
J. Leukoc. Biol. 2009;86:1097-1104.
ABSTRACT | FULL TEXT  

Best Practices: Comparing Medication Treatments in Mental Health: Drug Class Reviews and Policy Challenges
Carey et al.
Psychiatr. Serv. 2007;58:746-748.
ABSTRACT | FULL TEXT  

Emerging approaches to managing alcohol dependence
SWIFT
Am J Health Syst Pharm 2007;64:S12-S22.
ABSTRACT | FULL TEXT  

Brief Interventions for Problem Drinking: Another Piece of the Puzzle
O'Connor
ANN INTERN MED 2007;146:223-225.
FULL TEXT  

Alcohol Use and Anxiety: Diagnostic and Management Issues
Brady et al.
Am. J. Psychiatry 2007;164:217-221.
FULL TEXT  

THE EFFECTIVENESS OF A TAILORED INTERVENTION FOR EXCESSIVE ALCOHOL CONSUMPTION PRIOR TO ELECTIVE SURGERY
SHOURIE et al.
Alcohol Alcohol 2006;41:643-649.
ABSTRACT | FULL TEXT  

Psychotic Spectrum Disorders and Alcohol Abuse: A Review of Pharmacotherapeutic Strategies and a Report on the Effectiveness of Naltrexone and Disulfiram
Petrakis et al.
Schizophr Bull 2006;32:644-654.
ABSTRACT | FULL TEXT  

Pharmacologic Control of Ventricular Rate: American College of Chest Physicians Guidelines for the Prevention and Management of Postoperative Atrial Fibrillation After Cardiac Surgery
Martinez et al.
Chest 2005;128:56S-60S.
ABSTRACT | FULL TEXT  

EFFECT OF COMMUNITY NURSE FOLLOW-UP WHEN TREATING ALCOHOL DEPENDENCE WITH ACAMPROSATE
PELC et al.
Alcohol Alcohol 2005;40:302-307.
ABSTRACT | FULL TEXT  

Unhealthy Alcohol Use
Saitz
NEJM 2005;352:596-607.
FULL TEXT  

Treatment for alcohol related problems
Ritson
BMJ 2005;330:139-141.
FULL TEXT  

A PRAGMATIC TRIAL OF ACAMPROSATE IN THE TREATMENT OF ALCOHOL DEPENDENCE IN PRIMARY CARE
KIRITZE-TOPOR et al.
Alcohol Alcohol 2004;39:520-527.
ABSTRACT | FULL TEXT  

Evidence-Based Guidelines for the Pharmacological Management of Substance Misuse, Addiction and Comorbidity: Recommendations from the British Association for Psychopharmacology
Lingford-Hughes et al.
J Psychopharmacol 2004;18:293-335.
 

A COMPARISON OF TWO INTENSITIES OF PSYCHOSOCIAL INTERVENTION FOR ALCOHOL DEPENDENT PATIENTS TREATED WITH ACAMPROSATE
Hammarberg et al.
Alcohol Alcohol 2004;39:251-255.
ABSTRACT | FULL TEXT  

Does Acamprosate Improve Reduction of Drinking As Well As Aiding Abstinence?
Chick et al.
J Psychopharmacol 2003;17:397-402.
ABSTRACT  

Inhibition of Invasion and Angiogenesis by Zinc-Chelating Agent Disulfiram
Shian et al.
Mol. Pharmacol. 2003;64:1076-1084.
ABSTRACT | FULL TEXT  

Acamprosate for the Adjunctive Treatment of Alcohol Dependence
Overman et al.
The Annals of Pharmacotherapy 2003;37:1090-1099.
ABSTRACT | FULL TEXT  

BACLOFEN EFFICACY IN REDUCING ALCOHOL CRAVING AND INTAKE: A PRELIMINARY DOUBLE-BLIND RANDOMIZED CONTROLLED STUDY
Addolorato et al.
Alcohol Alcohol 2002;37:504-508.
ABSTRACT | FULL TEXT  

DOES PSYCHOSOCIAL TREATMENT ENHANCE THE EFFICACY OF ACAMPROSATE IN PATIENTS WITH ALCOHOL PROBLEMS?
de Wildt et al.
Alcohol Alcohol 2002;37:375-382.
ABSTRACT | FULL TEXT  

Naltrexone in the Treatment of Alcohol Dependence
Krystal et al.
NEJM 2001;345:1734-1739.
ABSTRACT | FULL TEXT  

Flupenthixol decanoate and relapse prevention in alcoholics: results from a placebo-controlled study
Wiesbeck et al.
Alcohol Alcohol 2001;36:329-334.
ABSTRACT | FULL TEXT  

Update in Addiction Medicine
Schneider et al.
ANN INTERN MED 2001;134:387-395.
FULL TEXT  

Outpatient Management of Patients with Alcohol Problems
Fiellin et al.
ANN INTERN MED 2000;133:815-827.
ABSTRACT | FULL TEXT  

PHARMACOTHERAPY OF ALCOHOLISM: GAPS IN KNOWLEDGE AND OPPORTUNITIES FOR RESEARCH
Kranzler
Alcohol Alcohol 2000;35:537-547.
ABSTRACT | FULL TEXT  

Managing the heavy drinker in primary care
DTB 2000;38:60-64.
ABSTRACT | FULL TEXT  

Alcoholic liver disease
Walsh and Alexander
Postgrad. Med. J. 2000;76:280-286.
ABSTRACT | FULL TEXT  

Review: studies with sufficient follow-up do not show a clear benefit for pharmacotherapy in alcohol dependence
Mayo-Smith
Evid. Based Med. 2000;5:23-23.
FULL TEXT  

Pharmacologic Treatment of Alcohol Dependence
JWatch Psychiatry 1999;1999:9-9.
FULL TEXT  





HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | CME | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 1999 American Medical Association. All Rights Reserved.