You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT ARCHIVES
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 64 No. 11, November 2007 TABLE OF CONTENTS
  Archives
  •  Online Features
  Original Article
 This Article
 •Abstract
 •PDF
 • Reply to article
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on HighWire
 •Contact me when this article is cited
 Related Content
 •Similar articles in this journal
 Topic Collections
 •Neurology
 •Alzheimer Disease
 •Psychopharmacology
 •Psychiatry, Other
 •Violence and Human Rights
 •Violence and Human Rights, Other
 •Randomized Controlled Trial
 •Alert me on articles by topic

Cost-Benefit Analysis of Second-Generation Antipsychotics and Placebo in a Randomized Trial of the Treatment of Psychosis and Aggression in Alzheimer Disease

Robert A. Rosenheck, MD; Douglas L. Leslie, PhD; Jody L. Sindelar, PhD; Edward A. Miller, PhD; Peter N. Tariot, MD; Karen S. Dagerman, MS; Sonia M. Davis, DrPH; Barry D. Lebowitz, PhD; Peter Rabins, MD, MPH; John K. Hsiao, MD; Jeffery A. Lieberman, MD; Lon S. Schneider, MD; for the Clinical Antipsychotic Trial of Intervention Effectiveness–Alzheimer's Disease (CATIE-AD) investigators

Arch Gen Psychiatry. 2007;64(11):1259-1268.

ABSTRACT

Context  Second-generation antipsychotics (SGAs) are prescribed for psychosis, aggression, and agitation in Alzheimer disease (AD).

Objective  To conduct a cost-benefit analysis of SGAs and placebo (taken to represent a "watchful waiting" treatment strategy) for psychosis and aggression in outpatients with AD.

Design  Randomized placebo-controlled trial of alternative SGA initiation strategies.

Setting  Forty-two outpatient clinics.

Participants  Outpatients with AD and psychosis, aggression, or agitation (N = 421).

Intervention  Participants were randomly assigned to treatment with olanzapine, quetiapine fumarate, risperidone, or placebo with the option of double-blind rerandomization to another antipsychotic or citalopram hydrobromide or open treatment over 9 months.

Main Outcome Measures  Monthly interviews documented health service use and costs. The economic perspective addressed total health care and medication costs. Costs of study drugs were estimated from wholesale prices with adjustment for discounts and rebates. Quality-adjusted life-years (QALYs) were assessed with the Health Utilities Index Mark 3 and were supplemented with measures of functioning, activities of daily living, and quality of life. Primary analyses were conducted using all available data. Secondary analyses excluded observations after the first medication change (ie, phase 1 only). Cost-benefit analysis was conducted using the net health benefits approach in a sensitivity analysis in which QALYs were valued at $50 000 per year and $100 000 per year.

Results  Average total health costs, including medications, were significantly lower for placebo than for SGAs, by $50 to $100 per month. There were no differences between treatments in QALYs or other measures of function. Phase 1–only analyses were broadly similar. Net-benefit analysis showed greater net health benefits for placebo as compared with other treatments, with probabilities ranging from 50% to 90%.

Conclusions  There were no differences in measures of effectiveness between initiation of active treatments or placebo (which represented watchful waiting) but the placebo group had significantly lower health care costs.

Trial Registration  clinicaltrials.gov Identifier: NCT00015548.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Alzheimer disease (AD) is a costly and debilitating illness that affects an estimated 5 to 8 million Americans.1 In 2000, Medicare spending to treat 4.5 million Americans with AD totaled $62 billion, or 34% of all Medicare spending, with an additional government expenditure of $19 billion through Medicaid.2 Psychotic symptoms and agitation complicate the course of AD in about half of all cases.3-4 In recent years, second-generation antipsychotics (SGAs) have become the first-line pharmacological treatments for psychosis or agitation associated with dementia, in part because they have been perceived as more effective and safer than older antipsychotic medications.5-6 Some studies have shown reduced risk of neurological adverse effects relative to older antipsychotics.7-8 The few controlled trials of these drugs in AD have been mainly in nursing home patients9 where safety issues have emerged concerning risk for cerebrovascular adverse events10-11 and death.11 Antidepressants, such as citalopram hydrobromide, have been suggested as alternatives to antipsychotics.12-13

To further evaluate the effectiveness of these agents in the treatment of patients with AD, the National Institute of Mental Health (NIMH) initiated the Clinical Antipsychotic Trial of Intervention Effectiveness–AD Trial (CATIE-AD). CATIE-AD used an experimental study design to compare the effectiveness of SGAs (olanzapine, risperidone, and quetiapine fumarate) that were available in the United States in January 2001 and commonly used in patients with dementia and placebo.14 The primary clinical outcome from this study was time to discontinuation for any cause from the initial randomly assigned drug or placebo,15 an outcome that integrated outcomes for efficacy, safety, and tolerability into a global measure of effectiveness that reflects therapeutic benefits in relation to undesirable effects. No differences were found between treatments on this measure, although time to discontinuation specifically because of lack of efficacy favored olanzapine and risperidone over placebo, and time to discontinuation specifically because of adverse events or intolerability favored placebo over the 3 SGAs.15 The current article presents results from CATIE-AD on measures of health care costs and health-related quality of life. It also presents a cost-benefit analysis using the net health benefit approach16 in which quality-adjusted life-years (QALYs) are given a range of plausible monetary values from which health care costs are subtracted, yielding a dollar-based estimate of net health benefits on which treatments can be compared.


METHODS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

STUDY DESIGN

The background, rationale, and methods of CATIE-AD have been presented in detail previously.14 The trial was conducted between April 2001 and November 2004 at 45 clinical sites in the United States.

Participants were initially randomly assigned to receive olanzapine, quetiapine, risperidone, or placebo under double-blind conditions in a 2:2:2:3 allocation ratio (phase 1). Those whose initial assigned treatments were discontinued (end of phase 1) could be randomly and double-blindly assigned to receive treatment with 1 of the 2 SGAs that they were not initially assigned to or with citalopram (phase 2). Participants receiving placebo in phase 1 received citalopram or 1 of the 3 SGAs in a 3:1:1:1 ratio in phase 2. Participants whose phase 2 treatments were discontinued could then be randomly assigned to open-label treatment with one of the active agents not yet received (phase 3). Patients could be shifted at any time to open treatment with the physician's choice of medication and continue data collection.

The objective of the cost-benefit component of CATIE-AD was to compare alternative treatment initiation strategies in an intention-to treat (ITT) analysis (ie, to determine whether choice of one of the SGAs as the first treatment in the CATIE-AD algorithm led to superior health and cost outcomes as compared with the other SGAs or placebo, which we take herein to represent an initial strategy of "watchful waiting"). Secondary cost-benefit analysis compared treatments exclusively during the period on the initially assigned condition (phase 1–only analysis). Although placebo is not a real-world treatment, it is a relevant experimental condition for this cost-benefit analysis inasmuch as it represents an approach to agitation and psychosis in AD involving general support without active pharmacotherapy. Watchful waiting has become an increasingly important clinical option in diseases such prostate17 and other forms of cancer18-20 and depression21-22 as well as in surgical conditions such as abdominal aortic aneurysm23 and inguinal hernia.24 It can only be subject to double-blind experimental evaluation through a "placebo" control.

PARTICIPANTS

Eligible participants had dementia of the Alzheimer type (DSM-IV)25 and Mini-Mental State Examination26 scores from 5 to 26 and were ambulatory outpatients living at home or in assisted living. They had clinically severe delusions, hallucinations, aggression, or agitation, occurring after the onset of symptoms of dementia. A score of "moderate" or greater was required during the week prior to randomization on the Brief Psychiatric Rating Scale27 and a severity score of "moderate" or more was required on the delusion, hallucination, agitation, or "aberrant motor behavior" items of the Neuropsychiatric Inventory.28 A study partner or caregiver who lived with or visited the prospective participant at least 8 hours per week and 3 days per week was required to contribute to the assessments.

Participants were excluded if they had schizophrenia, schizoaffective disorder, delirium, or probable vascular dementia (by Association Internationale pour la Recherche et l'Enseignement en Neurosciences–National Institute of Neurological Disorders and Stroke criteria).29 Other exclusion criteria were described previously.15 Participants were allowed to continue to receive stable doses of various medications, including cholinesterase inhibitors, memantine, antihypertensives, anti-inflammatory drugs, anticoagulants, laxatives, and diuretics. Concurrent use of antipsychotics, antidepressants, anticonvulsants as mood stabilizers, or regularly prescribed benzodiazepines was prohibited.

The study was reviewed and approved by the NIMH data safety and monitoring board and the institutional review board for each site. Written informed consent was obtained from participants or their legally authorized representatives and from the study partners.

INTERVENTIONS

The trial was designed to encourage prescribing as close as possible to typical clinical practices, allowing flexibility of dosing while maintaining the randomized (phases 1-3) and double-blinded treatment assignment (phases 1-2) of a clinical trial. Study physicians adjusted dosages based on their clinical judgments and participants' responses to treatment.15

PSYCHOSOCIAL INTERVENTION

All participants and caregivers were given basic information and education about AD, its course, clinical problems, and management. Caregivers were offered 2 counseling sessions during the first 18 weeks and could speak with staff members as needed.30-31

MEASURES

Costs

The economic perspective addressed comprehensive health care costs, which were estimated by multiplying the number of units of each type of service received by the estimated local unit cost of that service and then summing the products across different services.32

Service use was documented every month through a questionnaire completed by the caregiver that recorded 5 kinds of hospital stays across 6 different types of facilities, nights spent in nursing homes, halfway houses, board and care homes, and respite care programs. Use of 18 types of outpatient services or community supports commonly used by patients with AD33 and 14 types of outpatient mental health care, including psychiatric and psychosocial rehabilitation services, were documented along with 7 different types of medical or surgical outpatient visits and use of both psychiatric and medical emergency department services.

Unit costs of these services were estimated from published reports and administrative data sets (data available on request). Antipsychotic medication costs were based on published wholesale prices for the specific capsule strengths used in CATIE,34 adjusted downward for discounts and rebates affecting patients whose medication costs would have been paid by Medicaid (with costs about 25% less than wholesale prices)35 or by the Department of Veterans Affairs (40% less than wholesale prices).36 Costs of more than 200 different ancillary medications were estimated on the basis of average daily medication costs for specific agents in the 2002 MarketScan data set, representing typical medication costs for privately insured patients.37

Quality of Life

Cost-benefit analysis requires a single measure of health-related quality of life that reflects both health gains and health losses due to adverse effects. The Public Health Service Task Force on Cost-Effectiveness in Health and Medicine32 specifically recommended that health states be expressed as quality-adjusted life-years (QALYs), a year of life rated on a cardinal scale from 0 (worst possible health) to 1 (perfect health), as evaluated by members of the general public.

Quality-adjusted life-years were assessed in CATIE-AD using the Health Utilities Index Mark 3,38 a generic utility measure that has been used in previous studies of AD.39-40 The Health Utilities Index was supplemented by 3 disease-specific measures: (1) the Alzheimer’s Disease Related Quality of Life Scale,41-42 (2) the Alzheimer's Disease Cooperative Study Activities of Daily Living Scale (ADCS-ADL),43 and (3) the AD Dependence Scale,44-45 which rates the degree of dependence or assistance needed by a patient. All of these measures were administered to caregivers who were asked to rate recently observed behaviors.

STATISTICAL METHODS

The overall difference among the treatment groups was evaluated using a test with 3 df. If the difference was significant at P ≤ .05, then each drug was compared with placebo/watchful waiting by means of a Hochberg adjustment for multiple comparisons46 in which the largest pairwise P value was considered statistically significant at P = .05 and the smallest was compared with P = .017 (P = .05/3). The SGAs were tested with each other with a 2-df test. If that test was significant at P < .05, then each pair was compared at P = .05.

Average monthly costs during 9 months were compared across treatment groups in an ITT analysis using all available data with a mixed model including terms representing the baseline value of the dependent cost variable, time (treated as a classification variable for months 1-9), pooled site, and baseline x time interactions. Dropouts and patients who died were not included in these. The baseline x time term adjusts for baseline differences in characteristics of participants who dropped out early and thus are less well represented at later points. A random subject effect and a first-order autoregressive covariance structure were used to adjust standard errors for the correlation of observations from the same individual.

Because of the skewed distribution of nondrug cost data, statistical tests for health care costs and total costs including medications were conducted on log-transformed data. Adjusted average monthly log-transformed costs were then retransformed into average monthly costs using the "smearing estimation" method of Duan,47 after testing the data for heteroscedasticity.48 Median costs and winsored mean cost (in which the top and bottom 3% of observations are set to the value of the third and 97th percentiles, respectively49) are also presented. The same ITT analytic model was used for quality-of-life outcomes based on scores averaged across the 3-, 6-, and 9-month observations, again using a random subject effect and a first-order autoregressive covariance structure.

In addition to the primary analysis, in which all data were used and observations were classified according to the initial randomization, a secondary analysis was also conducted excluding observations after participants discontinued the initially assigned treatment (ie, limited to phase 1 of the trial). Since 63% of the patients had discontinued treatment in phase 1 by 3 months (when the first quality-of-life assessments were made) the phase 1 analysis of quality-of-life outcomes is limited to the subset of patients still in phase 1 by 3 months. Approximately 80% of patients discontinued taking phase 1 medication before 9 months. The repeated-measures model estimates the missing values due to discontinuation based on the correlations between points for patients who did not discontinue treatment and assumes that the loss of data caused by a patient's discontinuing medication use during the phase is missing at random. Mixed-model results limited to phase 1–only assessments should therefore be viewed cautiously.

Post hoc power analysis, using the actual standard errors of mean differences between pairs of drugs from this study,50 showed that in the primary analysis there was 80% power to detect differences of 0.22 SD for log-transformed cost measures, 0.28 SD for QALYs, and 0.26 to 0.28 SD for other outcomes. For the phase 1–only analysis, there was 80% power to detect differences of 0.31 SD for cost, 0.47 SD for QALYs, and 0.33 to 0.49 SD for other outcomes. We thus had adequate power to detect small to moderate differences between groups in the primary analysis but limited power to detect small effects that might be clinically meaningful.

COST-BENEFIT ANALYSIS

In the cost-benefit analysis, treatments were compared using the method of net health benefits.16 In this approach, a range of conventional estimates for the dollar value of a QALY are multiplied by the QALY estimate for each patient at each point to estimate the monetized value of his or her health status at each observation. Following conventions used in policy making,50 we used estimates of $50 000 per QALY per year ($4167 per QALY per month) and $100 000 per QALY per year ($8333 per QALY per month) in a sensitivity analysis.

Monthly health care costs were then subtracted from the estimated monthly health benefits to generate an estimate of net health benefits for each patient for each month. Finally, we used mixed-model regression analyses of the type described earlier to compare mean differences between the groups on net health benefits using monthly net health benefits estimates from all points. Following the method proposed by Hoch et al,51 which uses linear regression to make these comparisons. The probability that the treatment with the greatest net benefits is superior to the others at each of the 2 estimated values of a QALY was estimated in a 1-tailed test based on the significance of differences between the least square means as 1 – p/2.52


RESULTS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Altogether, 421 participants entered the study: 100 were randomized to olanzapine, 85 to risperidone, 94 to quetiapine, and 142 to placebo. Data on screening, enrollment, completion of phase 1, and continuation into phase 2 were presented in Figure 1 of the primary report of this study.16 Altogether, 231 patients (54.9%) participated in phase 2; 99 (23.5%), in phase 3; and 174 (41.3%), in phase 4.

A total of 280 participants (66.8%) had at least 1 follow-up visit while receiving the initially randomized treatment (ie, during phase 1): 72 (72.0%) who had been randomized to olanzapine; 60 (57.4%), to risperidone; 54 (71.4%), to quetiapine; and 94 (66.7%), to placebo. There were no differences between groups in these proportions ({chi}²3 = 5.74; P = .20).

There were no significant differences on baseline characteristics (Table 1) or in the proportion of monthly follow-up assessments that were completed between groups (80% overall: olanzapine, 80%; risperidone, 80%; quetiapine, 78%; placebo, 81%; {chi}²3 = 6.7; P = .10). However, the proportion of monthly assessments that were completed during phase 1 treatment (31% overall) was significantly higher for those assigned to risperidone (34.9%) and olanzapine (33%) as compared with those assigned to quetiapine (30%) and placebo (27.9%) ({chi}²3 = 13.7; P < .01). A total of 8 patients died during phase 1 (1.9%) and 30, during the entire trial (7.1%), with no statistically significant differences between groups.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 1. Patient Characteristics at the Time of Random Assignment by Initial Treatment


The proportion of patients at study entry who were taking first-generation antipsychotics (5%) or SGAs (10%) did not differ significantly between groups and the proportion of patients who took such medications outside the study protocol (1% and 3%, respectively) was also quite small (Table 1 and Table 3 in the original report from this study).15

Table 2 reports average monthly costs by treatment group. As expected, the group initially assigned to placebo (ie, watchful waiting) had significantly lower experimental drug costs of about $55 per month (Figure 1), which led to significantly lower total drug costs despite there being no statistically significant differences in the cost of concomitant medications across the treatment groups. Mean health service costs (log transformed) were also not significantly different across the treatment groups. Although unadjusted mean total costs were higher for the group initially assigned to placebo than for the group assigned to risperidone, this result was driven by outlier observations. The group assigned to placebo had the lowest median costs, and when the top and bottom 3% of the distribution were set to the third and 97th percentile values, respectively (creating a "winsored" mean), total average monthly costs fell to $1023 for the group initially assigned to placebo as compared with the other groups: $1118 for olanzapine, $1215 for quetiapine, and $1092 for risperidone (Figure 2). Retransformed log data using the smearing estimator showed even greater mean cost differences favoring the group assigned to placebo, totaling $400 to $500 per month in total drug plus health service costs (data available on request).


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 2. Average Monthly Costs by Treatment Group Over 9 Monthsa



Figure 1
View larger version (22K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Figure 1. Comparison of treatments on average monthly medication costs (experimental drugs and concomitant medications). Quetiapine was given as quetiapine fumarate.



Figure 2
View larger version (29K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Figure 2. Comparison of treatments on total average monthly health care costs including medications. Values are given as winsored means, in which the top and bottom 3% of observations are set to the value of the third and 97th percentiles, respectively. Quetiapine was given as quetiapine fumarate.


Table 3 reports mixed model–adjusted means of the effectiveness measures by treatment group across months 3, 6, and 9. There were no significant differences across the treatment groups in QALYs (Figure 3), Alzheimer’s Disease–Related Quality of Life Scale scores, or Dependence Scale scores. However, participants assigned to olanzapine were actually more impaired on the ADCS-ADL Scale than those assigned to the placebo (ie, watchful waiting) group (mean score, 30.4 vs 34.4 [–4.0 points]; P = .004).These differences were greatest at the 3-month assessment (mean [SE], –5.5 [1.56] points; df = 1603; P < .001), still significant at 6 months (mean [SE], –3.7 [1.61] points; df = 1603; P = .02), and not significant at 9 months (mean [SE], –2.8 [1.64] points; df = 1603; P = .09).


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 3. Comparison of Effectiveness by Treatment Group (Adjusted Means Across All Points Based on Mixed Models)



Figure 3
View larger version (21K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Figure 3. Comparison of treatments on quality-adjusted life-years (QALYs) measured by the Health Utilities Index Mark 3.38 Quetiapine was given as quetiapine fumarate.


Results of the secondary analysis, limited to observations during phase 1, the period of treatment with the initially assigned drug, were similar to the ITT analysis, although since data loss was substantial, these results should be interpreted very cautiously. Phase 1 cost differences were generally larger, with the placebo group showing significantly lower total drug costs, experimental drug costs, and total costs of $200 to $600 per month (Table 2).

With respect to the effectiveness measures, participants in the placebo group showed significantly higher functioning on the ADCS-ADL Scale relative to each of the SGAs (mean [SE], 10.03 [1.96] points greater than olanzapine; df = 1148; P < .001; 4.78 [2.1] points greater than quetiapine; df = 1148; P = .02; and 5.47 [2.08] points greater than risperidone; df = 1148; P = .01). The placebo (ie, watchful waiting) group had significantly lower scores on the Dependence Scale compared with the olanzapine group (mean [SE], –0.41 [0.146]; df = 1153; P = .005) (Table 3). In the analyses of both the ADCS-ADL and Dependence scale scores, the advantages for placebo increased from the 3-month to the 9-month follow-up assessment.

Analysis of net health benefits showed that when the value of health benefits was estimated at $50 000 per QALY, placebo was superior to olanzapine, with a probability of 88% on ITT and 90% on phase 1–only analysis, and superior to quetiapine, with a probability of 89% on ITT and 90% on phase 1–only analysis. Risperidone was superior to placebo, with a probability of 51% on ITT, while placebo was superior to risperidone, with a probability of 77% on phase 1–only analysis.

When the value of a QALY was estimated at $100 000 per QALY, placebo was superior to olanzapine, with a probability of 87% on both ITT and phase 1–only analysis, and superior to quetiapine, with a probability of 72% on ITT and 74% on phase 1–only analysis. Risperidone was superior to placebo, with a probability of 68% on ITT, while placebo was superior to risperidone, with a probability of 55% on phase 1–only analysis. Thus, as the estimated value of a QALY increases from $50 000 to $100 000, treatments with better QALY results are more likely to be superior or less likely to be inferior. Similarly, as one shifts from ITT to phase 1–only analysis, placebo appears to be superior because the cost differential becomes greater when excluding observations after patients switched from placebo to expensive active medications. These analyses were repeated on nonwinsored means, with no change in the pattern or magnitude of results.

Thus, while there were no significant differences between treatments with regard to net health benefits at the conventional 95% probability standard, placebo was most often superior to the SGAs on net health benefit analysis,16 with probabilities ranging from 50% to 90%.


COMMENT
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

This study reports on the cost-benefit analysis of a relatively large clinical trial of 3 SGA medications and placebo in the treatment of outpatients with AD with psychosis, aggression, or agitation. We found that SGA treatment groups had significantly higher costs than the group that initially received placebo, representing a watchful waiting treatment approach, but there were no statistically significant differences on QALYs, the main measure of effectiveness. These results are consistent with the primary CATIE-AD phase 1 outcomes,15 in which there were no differences across treatment groups in time to all-cause discontinuation of phase 1 medication, although participants originally assigned to olanzapine and risperidone were less likely to discontinue taking the assigned medication because of lack of efficacy than the other drugs and participants initially assigned to treatment with placebo were less likely to discontinue use for intolerability.

Consistent with these findings, the present study found that initial assignment to each active medication was more costly than placebo (ie, than watchful waiting before active treatment), predominantly because of greater drug costs. While there were no differences between the groups in QALYs, the placebo group was superior to the olanzapine group on the activities of daily living measure of effectiveness in the ITT analysis and superior to all medication groups on this measure in the phase 1–only analysis, as well as to the olanzapine group on the Dependence Scale. One conclusion of this analysis would thus be that the watchful waiting strategy, entailing general medical management, nonspecific support, and delayed initiation of antipsychotic pharmacotherapy, is slightly less costly and no less effective than immediate treatment with SGA medications. Cost-benefit analysis using the net health benefit approach16, 51 and applying estimates of $50 000 per QALY and $100 000 per QALY in a sensitivity analysis suggested that placebo/watchful waiting was superior to SGAs, with probabilities ranging from 50% to 90%, not reaching the conventional standard of 95% confidence. The secondary finding that patients taking olanzapine scored worse on the activities of daily living measure than patients treated with watchful waiting most likely represents the greater level or combination of sedation, gait disturbances, and behaviorally inhibiting adverse effects with this drug.

Strengths of the study included its large sample size, high follow-up rate on primary analysis, and moderate duration. However, several limitations of the study require comment. First, the study was conducted under highly controlled conditions. Although medications could be discontinued or switched after 2 weeks, results may not be generalizable to real-world clinical settings in which placebo, for example, is not offered as a treatment, although we feel it can be usefully understood to represent a conservative strategy of watchful waiting, a strategy that was sufficient during the entire 9 months for 15% of patients assigned to placebo.

It could, furthermore, be argued that continuing to assign participants to their original treatment condition following a medication switch is misleading since the treatment has actually changed. However, this study sought specifically to test different treatment initiation strategies through a true ITT analysis. There has been growing interest in stepped treatment strategies in which patients are initially expected to try a first-line drug, sometimes an older generic drug or sometimes watchful waiting, and are only offered additional medications if they do not respond to the initial treatment. In the secondary analyses in which observations following the first medication switch were excluded (ie, the phase 1–only analysis), the pattern of results found in the ITT analysis was strengthened. Cost differences favoring placebo were greater in the phase 1–only analysis, with similar results for QALYs and some evidence of lower functioning among participants assigned to SGAs as their first treatment.

Statistical power was limited, especially in the phase 1–only results. Although there was an 80% chance of detecting moderate effect sizes (ie, from 0.31-0.49), power was inadequate to detect small differences of effect size (0.20 to 0.30 or 0.04-0.08 QALYs) that could be of clinical importance. It has been demonstrated that panels of judges cannot differentiate between health states that differ by 0.03 QALYs or less.52, 54 Since the maximal average superiority of any drug over placebo was 0.02 QALYs in this study (on both the ITT analysis and the phase 1–only analysis), it is somewhat less likely that important clinical benefits were missed.

While data loss from attrition was modest in the primary ITT analysis, there was 80% power to detect small to moderate differences and there were only modest differences between groups in follow-up rates. Although data loss was more substantial in the phase 1–only analysis, significant differences were observed on cost measures and some outcome measures in both the ITT analysis and the phase 1–only analysis, suggesting that the study had sufficient statistical power to detect differences on these measures. While no analysis showed significant advantage for any SGA over either placebo/watchful waiting or over other SGAs, the group originally assigned to placebo had significantly lower costs and higher activities of daily living scores than some SGA groups on both the ITT analysis and the phase 1–only analysis, suggesting sufficient power to detect some group differences.

Costs were based on proxy self-reported use data from the patients' caregivers. Surveys of service use were conducted monthly to improve the accuracy of the service use data, but these data have not been validated. However, there is no reason to suspect any bias between the treatment conditions in the measures of service use and costs.

Participants in the trial were followed up for only 9 months, so any benefits or adverse effects that developed after 9 months of treatment are not captured in the study. In addition, since the study focused on outpatients, its generalizability to nursing home residents is unknown. Although dosing was flexible according to clinical need, it has been suggested that quetiapine was dosed lower than in other studies,55 perhaps limiting its effectiveness.

To our knowledge, this study is the first cost-benefit analysis of SGA medication in the treatment of noncognitive symptoms of AD in outpatients, an off-label use of SGAs that is both common and costly. Annual sales of antipsychotic medications in the United States reached $10.5 billion in 2005.56 A study of antipsychotic use and costs among outpatients in the Department of Veterans Affairs found that 42.8% of outpatients who received antipsychotic medications in 1999 were prescribed the drug for an off-label use, and 5% were treated exclusively for dementia.36 A more recent study of Medicare beneficiaries in nursing homes found that 27%, more than 600 000 patients, received a prescription for antipsychotic medication in 2000 and 2001 and that antipsychotic use is increasing in nursing homes.57 Together, these findings imply that at least $500 million, and probably substantially more, is spent each year on SGA medications for the treatment of dementia, a condition for which they have not received Food and Drug Administration (FDA) approval.

FDA approval requires only that the manufacturer demonstrate that the drug is safe and effective in adequate and well-controlled studies as compared with placebo in a specified condition. However, once the drug is approved by the FDA, physicians are free to prescribe it for other indications, including treating conditions for which the drug was not approved, although manufacturers are prohibited from marketing the drug for such uses. Off-label use is less often studied in randomized controlled trials than use for the indicated condition. As this study and others9, 58-59 have shown, these drugs may offer little clinical efficacy overall when prescribed to patients for agitation and psychosis associated with AD and showed no overall health economic or effectiveness benefits compared with a strategy that begins with watchful waiting. Future research should examine the pharmacoepidemiology of these drugs in dementia to identify circumstances under which they might be cost-effective. Further support is needed to encourage cost-benefit and cost-effectiveness evaluations of widely used and costly off-label prescription regimens.


AUTHOR INFORMATION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Correspondence: Robert A. Rosenheck, MD, Northeast Program Evaluation Center (182), VA Connecticut Health Care System, 950 Campbell Ave, West Haven, CT 06516 (robert.rosenheck{at}yale.edu).

Submitted for Publication: November 4, 2006; final revision received April 13, 2007; accepted April 16, 2007.

Author Contributions: Dr Rosenheck had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Financial Disclosure: Dr Rosenheck has received research support from Eli Lilly, Janssen Pharmaceutica, AstraZeneca, and Wyeth and has been a consultant to GlaxoSmithKline, Bristol-Myers Squibb, and Janssen Pharmaceutica. Dr Tariot has received consulting fees from or has served on paid advisory boards for Eli Lilly, AstraZeneca, Forest Laboratories, GlaxoSmithKline, Novartis, Abbott, Bristol-Myers Squibb, Eisai, Janssen Pharmaceutica, Merck, Pfizer, and Schwabe; has received lecture fees from AstraZeneca and Forest Laboratories, grant support from the National Institutes of Health and Arizona, research support from Abbott, AstraZeneca, Bristol-Myers Squibb, Eisai, Forest Laboratories, GlaxoSmithKline, Janssen Pharmaceutica, Eli Lilly, Merck, Pfizer, Schwabe, and Wyeth, and educational fees from AstraZeneca, Eisai, Forest Laboratories, Lundbeck, Merz Pharma, and Pfizer; and serves on Alzheimer's Association, National Institute of Mental Health (NIMH), and National Institute on Aging study sections. Dr Davis is an employee of Quintiles Inc and has received consulting fees from Eli Lilly and Pfizer. Dr Rabins has served on speakers' bureaus for Pfizer, Forest Laboratories, AstraZeneca, and Janssen Pharmaceutica and owns a copyright for the Alzheimer's Disease–Related Quality of Life Scale. Dr Lebowitz is a former employee of the NIMH. Dr Hsiao is an employee of the NIMH. Dr Lieberman has received grant and/or research support from Acadia, Bristol-Myers Squibb, GlaxoSmithKline, Janssen Pharmaceutica, Merck, Organon, and Pfizer; has been an unpaid consultant to Eli Lilly and Pfizer; has been an unpaid member of advisory boards for AstraZeneca, Eli Lilly, GlaxoSmithKline, Lundbeck, Organon, and Pfizer; and holds a patent for Repligen. Dr Schneider has received consulting fees from AstraZeneca, Forest Laboratories, and Johnson & Johnson and lecture fees from AstraZeneca, Eli Lilly, and Forest Laboratories.

Funding/Support: This work was supported by grant NO1 MH9001 from the NIMH. AstraZeneca, Forest Pharmaceuticals, Janssen Pharmaceutica, and Eli Lilly provided medications for the studies.


The CATIE-AD Study Group

The CATIE-AD study group includes the following members:

ADVISORS AND PROTOCOL COMMITTEE

G. Alexopoulos, C. E. Davis, K. L. Davis, S. Davis, J. K. Hsiao, D. V. Jeste, I. R. Katz, K. R. Krishnan, G. Koch, B. Lebowitz, J. A. Lieberman, C. G. Lyketsos, D. Marin, B. G. Pollock, P. V. Rabins, R. A. Rosenheck, M. Sano, S. Schultz, G. W. Small, and D. Sultzer.

TRIAL CENTER

K. Dagerman, M. S. Ismail, L. S. Schneider, and P. N. Tariot.

NATIONAL INSTITUTE OF MENTAL HEALTH STAFF

J. Baum, B. Bowers, D. Eskenazi, P. Gibbons, J. Gonzalez, W. R. Harlan, J. K. Hsiao, S. Hyman, T. Insel, B. D. Lebowitz, G. S. Norquist, J. T. Olin, L. Ritz, and J. B. Severe.

UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL (UNC) AND DUKE UNIVERSITY, DURHAM, NORTH CAROLINA

J. A. Lieberman (formerly at UNC, currently at Columbia University) and C. E. Davis, principal investigators; R. Keefe (Duke University), I. Rojas, S. Stroup (UNC), and M. Swartz (Duke University).

QUINTILES INC

S. Abbott, P. J. Butler, M. DiJohn, J. Ho, B. LaPlante, I. Amara, S. Davis, and S. Kavanagh.

VETERANS AFFAIRS NEW ENGLAND MENTAL ILLNESS RESEARCH, EDUCATION, AND CLINICAL CENTER

J. Cahill and H. Lin.

STUDY INVESTIGATORS

L. Adler, Clinical Insights, Baltimore, Maryland; I. Ahmed, University of Hawaii, Honolulu; P. Aupperle, University of Medicine and Dentistry of New Jersey, Piscataway; S. Bartels, Dartmouth–Hitchcock Medical Center, Lebanon, New Hampshire; A. Baskys, Veterans Affairs Medical Center, Long Beach, California; J. Beyer and M. Doraiswamy, Duke University Medical Center; L. Blake, Northwestern University Medical School, Chicago, Illinois; C. T. Cohen, SUNY Brooklyn, Brooklyn, New York; S. Colon, Veterans Affairs Medical Center, Tuscaloosa, Alabama; D. Devanand, Columbia University, New York, New York; M. Dysken, Veterans Affairs Medical Center, Minneapolis, Minnesota; A. Freeman III, Louisiana State University Health Sciences Center, Shreveport; G. T. Grossberg, Saint Louis University, St Louis, Missouri; H. Grossman, Mount Sinai School of Medicine, New York; S. Gupta, Global Research and Consulting, Olean, New York; G. Haefner, Berman Research Group, Hialeah, Florida; D. Jeste, University of California San Diego and Veterans Affairs Medical Center, San Diego; B. Jones and D. Johnston, Wake Forest University, Winston-Salem, North Carolina; I. Katz and D. Weintraub, University of Pennsylvania and Veterans Affairs Medical Center, Coatesville; Z. Lebedeva and M. Parsa, Northeast Ohio Health Center, Columbus; M. T. Levy, Staten Island University Hospital, Staten Island, New York; C. G. Lyketsos, Johns Hopkins University, Baltimore; D. McManus, Southern Illinois University, Springfield; J. E. Mintzer, Medical University of South Carolina, North Charleston; R. Ownby, University of Miami, Miami, Florida; E. Palmer, Lahey Clinic, Burlington, Massachusetts; E. Pfeiffer, University of South Florida Suncoast Gerontology Center, Tampa; N. Pomara, Nathan S. Kline Institute, Orangeburg, New York; S. Potkin, University of California, Irvine; J. M. Ryan, Monroe Community Hospital, Rochester, New York; C. Sadowsky, Palm Beach Neurology, West Palm Beach, Florida; B. Saltz, Mental Health Advocates, Boca Raton, Florida; S. Scheinthal, University of Medicine and Dentistry of New Jersey, Stratford; L. S. Schneider and S. Pawluczyk, University of Southern California, Los Angeles; S. Schultz, University of Iowa College of Medicine, Iowa City; J. Sheikh, Stanford University School of Medicine, Stanford, California; F. Sicuro, Millennium Psychiatric Associates, St Louis; P. Solomon, Southwestern Vermont Medical Center, Bennington; D. Sultzer, Veterans Affairs Greater Los Angeles Healthcare System, University of California, Los Angeles; L. Tune, Wesley Woods Health Center, Atlanta, Georgia; C. H. van Dyck, Yale University School of Medicine, New Haven, Connecticut; and M. Weiner, University of Texas Southwestern Medical Center, Dallas.


Author Affiliations: VA Connecticut Health Care System, West Haven (Drs Rosenheck, Leslie, and Miller); Yale University, New Haven, Connecticut (Dr Sindelar); University of Arizona, Phoenix (Dr Tariot); Departments of Psychiatry, Neurology, and Gerontology, University of Southern California, Los Angeles (Ms Dagerman and Dr Schneider); University of California at San Diego (Dr Lebowitz); Johns Hopkins University, Baltimore, Maryland (Dr Rabins); University of North Carolina, Chapel Hill (Dr Davis); National Institute of Mental Health, Bethesda, Maryland (Dr Hsiao); and Department of Psychiatry, College of Physicians and Surgeons, Columbia University, New York State Psychiatric Institute, New York (Dr Lieberman).


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

1. Manca A, Davies L, Burns A. Cost-effectiveness of therapeutics for Alzheimer's Disease. In: Davis K, Charney D, Coyle JT, eds. Neuropsychopharmacology: The Fifth Generation of Progress. New York, NY: Lippincott Williams & Wilkins; 2002:1267-1280.
2. Lewin Group. Saving Lives, Saving Money: Dividends for Americans Investing in Alzheimer Research. Falls Church, VA: Lewin Group; 2004.
3. Jeste DV, Finkel SI. Psychosis of Alzheimer's disease and related dementias: diagnostic criteria for a distinct syndrome. Am J Geriatr Psychiatry. 2000;8(1):29-34. FREE FULL TEXT
4. Paulsen JS, Salmon DP, Thal LJ, Romero R, Weisstein-Jenkins C, Galasko D, Hofstetter CR, Thomas R, Grant I, Jeste DV. Incidence of and risk factors for hallucinations and delusions in patients with probable AD. Neurology. 2000;54(10):1965-1971. FREE FULL TEXT
5. Treatment of agitation in older persons with dementia: the Expert Consensus Panel for agitation in dementia. Postgrad Med. 1998(spec No.):1-88. PUBMED
6. Alexopoulos GS, Streim J, Carpenter D, Docherty JP. Using antipsychotic agents in older patients. J Clin Psychiatry. 2004;65(suppl 2):5-99.
7. Woerner MG, Alvir JM, Saltz BL, Lieberman JA, Kane JM. Prospective study of tardive dyskinesia in the elderly: rates and risk factors. Am J Psychiatry. 1998;155(11):1521-1528. FREE FULL TEXT
8. Jeste DV, Lacro JP, Palmer B, Rockwell E, Harris MJ, Caligiuri MP. Incidence of tardive dyskinesia in early stages of low-dose treatment with typical neuroleptics in older patients. Am J Psychiatry. 1999;156(2):309-311. FREE FULL TEXT
9. Schneider LS, Dagerman KS, Insel PS. Efficacy and adverse effects of atypical antipsychotics for dementia: meta-analysis of randomized placebo-controlled trials. Am J Geriatr Psychiatry. 2006;14(3):191-210. FREE FULL TEXT
10. Wooltorton E. Risperidone (Risperdal): increased rate of cerebrovascular events in dementia trials. CMAJ. 2002;167(11):1269-1270. FREE FULL TEXT
11. Schneider LS, Dagerman KS, Insel P. Risk of death with atypical antipsychotic drug treatment for dementia: meta-analysis of randomized placebo-controlled trials. JAMA. 2005;294(15):1934-1943. FREE FULL TEXT
12. Lyketsos CG, Olin J. Depression in Alzheimer's disease: overview and treatment. Biol Psychiatry. 2002;52(3):243-252.