Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Cost-effectiveness of Housing First Intervention With Intensive Case Management Compared With Treatment as Usual for Homeless Adults With Mental Illness

Cost-effectiveness of Housing First Intervention With Intensive Case Management Compared With... Key Points Question Is a Housing First intervention IMPORTANCE In the At Home/Chez Soi trial for homeless individuals with mental illness, the with Intensive Case Management for scattered-site Housing First (HF) with Intensive Case Management (ICM) intervention proved more homeless people with mental illness effective than treatment as usual (TAU). cost-effective compared with treatment as usual? OBJECTIVE To evaluate the cost-effectiveness of the HF plus ICM intervention compared with TAU. Findings In this economic evaluation study of data from the At Home/Chez DESIGN, SETTING, AND PARTICIPANTS This is an economic evaluation study of data from the At Soi randomized clinical trial with 1198 Home/Chez Soi randomized clinical trial. From October 2009 through July 2011, 1198 individuals initially homeless participants, the were randomized to the intervention (n = 689) or TAU (n = 509) and followed up for as long as 24 incremental cost-effectiveness ratio was months. Participants were recruited in the Canadian cities of Vancouver, Winnipeg, Toronto, and $56.08 per additional day of stable Montreal. Participants with a current mental disorder who were homeless and had a moderate level housing. At $67 per day of stable of need were included. Data were analyzed from 2013 through 2019, per protocol. housing, there was an 80% chance that the Housing First intervention with INTERVENTIONS Scattered-site HF (using rent supplements) with off-site ICM services was Intensive Case Management was cost- compared with usual housing and support services in each city. effective compared with treatment as usual. MAIN OUTCOMES AND MEASURES The analysis was performed from the perspective of society, with days of stable housing as the outcome. Service use was ascertained using questionnaires. Unit Meaning Expanding access to Housing costs were estimated in 2016 Canadian dollars. First with Intensive Case Management appears to be warranted from an RESULTS Of 1198 randomized individuals, 795 (66.4%) were men and 696 (58.1%) were aged 30 to economic point of view. 49 years. Almost all (1160 participants, including 677 in the HF group and 483 in the TAU group) contributed data to the economic analysis. Days of stable housing were higher by 140.34 days (95% Supplemental content CI, 128.14-153.31 days) in the HF group. The intervention cost $14 496 per person per year; reductions in costs of other services brought the net cost down by 46% to $7868 (95% CI, $4409-$11 405). Author affiliations and article information are listed at the end of this article. The incremental cost-effectiveness ratio was $56.08 (95% CI, $29.55-$84.78) per additional day of stable housing. In sensitivity analyses, adjusting for baseline differences using a regression-based method, without altering the discount rate, caused the largest change in the incremental cost- effectiveness ratio with an increase to $60.18 (95% CI, $35.27-$86.95). At $67 per day of stable housing, there was an 80% chance that HF was cost-effective compared with TAU. The cost- effectiveness of HF appeared to be similar for all participants, although possibly less for those with a higher number of previous psychiatric hospitalizations. (continued) Open Access. This is an open access article distributed under the terms of the CC-BY License. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 1/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Abstract (continued) CONCLUSIONS AND RELEVANCE In this study, the cost per additional day of stable housing was similar to that of many interventions for homeless individuals. Based on these results, expanding access to HF with ICM appears to be warranted from an economic standpoint. TRIAL REGISTRATION isrctn.org Identifier: ISRCTN42520374 JAMA Network Open. 2019;2(8):e199782. Corrected on September 11, 2019. doi:10.1001/jamanetworkopen.2019.9782 Introduction A significant proportion of homeless individuals experience mental illness. Housing First (HF), which provides immediate access to subsidized housing together with support services, has proven to be 2,3 the most effective approach at helping such individuals access and maintain permanent housing. Previous analyses, using mostly before-and-after comparisons or quasi-experimental designs, have reported significant cost offsets associated with the provision of HF. To our knowledge, only 1 cost- effectiveness analysis, conducted alongside a randomized clinical trial, has been published. The multiple-site At Home/Chez Soi trial compared outcomes of the scattered-site variant of HF, in which participants receive income-related rent supplements for private market apartments of their choice, with those of treatment as usual (TAU). The trial tested, in parallel, HF with Assertive Community Treatment for people who had more severe mental illness and functional difficulties and HF with Intensive Case Management (ICM) for those whose needs were less acute. Summary results 7,8 of cost analyses, but not cost-effectiveness analyses, were included in the main trial reports. Herein we report on the cost-effectiveness of HF with ICM compared with TAU. Methods The cost-effectiveness analysis was performed in conformity with the published protocol of the At Home/Chez Soi study. The analysis followed the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) reporting guideline. The analysis began in 2013 and underwent successive refinements until 2019. The study protocol is available elsewhere. The trial was conducted in the Canadian cities of Vancouver, British Columbia; Winnipeg, Manitoba; Toronto, Ontario; Montreal, Québec; and Moncton, New Brunswick. Ethics approval was obtained from the local ethics review board at each data-collection site and from the Centre for Addiction and Mental Health, where the coordinating center was based. Participants provided written informed consent after the screening interview. Participants 6,7 Details on sample recruitment are available elsewhere. Briefly, potential participants were referred from various sources or found through street outreach. Individuals were eligible if they were adults with legal status in their province of residence; had at least 1 of 6 current mental disorders, including psychotic disorder, major depressive disorder, or posttraumatic stress disorder; and were absolutely homeless or precariously housed with previous episodes of absolute homelessness. Individuals who were currently receiving services from an Assertive Community Treatment or ICM team (similar to what the experimental interventions offered, minus the access to rent supplements and dedicated housing staff) were not eligible. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 2/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Initial Assessment and Randomization Using data collected online during the baseline interview, a computerized algorithm classified individuals as high or moderate need. To be classified as high need, individuals needed to (1) have a lower level of functioning (score of 62 on the Multnomah Community Ability Scale) ; (2) have a diagnosis of current psychotic disorder or bipolar disorder; and (3) meet at least 1 of the following criteria: 2 or more hospitalizations for mental illness during a 1-year period within the previous 5 years; comorbid substance use; or 1 or more arrests or incarcerations in the past 6 months. Others were classified as moderate need. (In Moncton, high-need and moderate-need individuals were classified as high need, because of the relatively small pool of individuals eligible for the study. Accordingly, data from Moncton are not included in this analysis.) Moderate-need individuals were randomized to receive HF plus ICM or other services normally available to them (TAU). An adaptive randomization algorithm with allocation concealment was used. From October 2009 through June 2011, 1198 moderate-need individuals were recruited. Interventions Participants in the HF plus ICM group received recovery-oriented supports from an ICM team with about 17 participants per case manager. Each ICM team worked in collaboration with housing specialists, also paid by the project, to help participants find housing of their choice, usually an apartment on the private rental market, and respond to housing issues as they arose. Participants were required to pay 25% or 30% of their income toward the rent, depending on whether it covered heating costs. The project paid the remainder of the rent, with this supplement ranging from a mean of $375 in Montreal to $600 in Vancouver. Periodic evaluation of the fidelity of the interventions to the program model, combined with feedback and ongoing coaching, aided standardization of the interventions across sites. Although their intervention did not include HF, participants assigned to the TAU group had access to substantial supports, especially in the larger cities. These supports included emergency response services, such as shelters and hospital emergency departments, and some rehabilitative services, such as drug and alcohol rehabilitation centers and transitional housing. A small number of participants also were able to access ICM or Assertive Community Treatment services after they were recruited into the study. Data Collection Study participants were followed up for as long as 24 months. At baseline, interviewers used the Mini International Neuropsychiatric Interview and other sources such as medical records to ascertain diagnosis, assess whether abuse or dependence of alcohol or other substances was present, and document homelessness, hospitalization, and arrest history, among others. At baseline and every 6 months thereafter, a battery of standardized questionnaires was administered. The Multnomah Community Ability Scale, the only interviewer-rated measure, was completed at the end of the interview. Measures also included 3 questionnaires adapted for this study and designed to assess use 6,13 of services. Participants completed the Health Services and Justice Services Use questionnaire at baseline and every 6 months thereafter. The Health Services and Justice Services Use questionnaire documented all non–overnight health- and justice-related services. The Residential Time-Line Follow-Back instrument was administered every 3 months starting 3 months after baseline and asked participants where they had spent every night since the previous interview (or since 3 months before baseline). To enable estimation of costs associated with service use, the Residential Time-Line Follow-Back instrument allowed coding of simultaneous places of residence; for example, if a participant had a subsidized apartment and was hospitalized, costs were associated with both places concurrently. Finally, the Vocational Time-Line Follow-Back questionnaire asked about income received month by month and any regular or casual work obtained during the previous 3 months. Due to the nature of the intervention and the inclusion of measures on service use and housing, participants and interviewers could not be blinded. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 3/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Choice of Outcome Measure Days of stable housing (as assessed by the Residential Time-Line Follow-Back instrument) served as the outcome measure. Places where people stayed were classified as stable (own apartment, social housing, or staying with one’s family if this could be maintained for6 months) or unstable. Thus, all other housing situations, for this purpose, were deemed unstable. Perspective of the Economic Analysis As discussed in detail elsewhere, cost elements were collected and analyzed from the perspective 15 16 of society. We modified this perspective slightly, following Weisbrod et al, in that we included social assistance and disability benefits as costs. This modified societal perspective may be viewed as 17,18 consistent with a social cost impact analysis. Calculation of Costs per Individual We calculated many unit costs at a high level of specificity, distinguishing, for example, among supportive housing providers with different staffing levels. Whenever possible, we used financial statements and activity reports to estimate a fully allocated average cost of each service. The unit costs that we used and the methods that we used to derive them have been published. Unit costs for the intervention were based on reported expenses of each clinical team and housing provider. Program expenses were distributed among participants based on their own time receiving services from their clinical team, as estimated using the Health Services and Justice Services Use questionnaire, and on the number of nights that they had a subsidized apartment or housing unit provided by the project. All unit costs were originally in 2011 Canadian dollars or adjusted to 2011 Canadian dollars. For this analysis, we used the city-specific Consumer Price Index to convert costs into 2016 Canadian dollars. We calculated costs per individual by multiplying frequencies by the corresponding unit cost, including the intervention cost for experimental group participants, adding to that social assistance and other contributions by society to their income, and finally subtracting income earned. Discounting For each participant, costs as well as days of stable housing were estimated for a 2-year period. Costs and days of stable housing in the second year were discounted at a 3% rate, a common rate for a base case analysis. Statistical Analysis All analyses used multiple imputation with chained equations (20 imputations) to account for missing data. Mean costs per year after randomization, aggregated across sites but grouped into different categories, were compared between the HF and TAU groups at baseline and during each of the 2 years after baseline. Mean total costs per year were then compared site-by-site between the HF plus ICM and TAU groups. Confidence intervals for incremental cost-effectiveness ratios were computed via 21,22 bootstrapping, with 500 bootstrap resamples. We plotted the bootstrap resamples on the cost- effectiveness plane. We used the net-benefit approach to describe further the effect of sampling uncertainty. The intervention is deemed cost-effective if λμ –μ > 0, where λ is the threshold ratio (in dollars per ΔE ΔC additional day of stable housing) above which the decision-maker no longer finds the intervention cost-effective; μ , the mean difference in effectiveness between the 2 groups; and μ , the mean ΔE ΔC difference in costs. Using the bootstrap resamples, we plotted the cost-effectiveness acceptability curve, showing the estimated probability that the intervention is cost-effective as a function of λ. We then regressed, using values of λ ranging from $0 to $100, each individual’s net monetary benefit on several variables selected a priori as potentially relevant, including group assignment, site, JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 4/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness age, sex, presence of psychotic disorder, Multnomah Community Ability Scale score, duration of longest previous episode of homelessness, and number of hospital days in the year before study entry. Linear regression was used in each case. To evaluate how participant characteristics might 19,23 mediate the cost-effectiveness of HF, and in the absence of any strong a priori hypotheses about which characteristics might be relevant, we then tested, one by one, interactions between all these variables and the group assignment variable. Interaction terms with 2-sided P < .10 were retained for a final model with interactions. Fitted models were checked for misspecification by plotting the residuals against the fitted value of the dependent variable as well as continuous covariates. The Rubin rule was used to derive 95% CIs. Statistical analyses were performed using Stata, version 15 (StataCorp). Sensitivity Analyses We tested the robustness of the results to the choice of discount rate by using 0% and 5% instead of 3%. We also checked the effects of adjusting for baseline differences in costs using a regression- based method and performed a 2-way sensitivity analysis on these factors. Results Of 1198 individuals originally randomized (795 [66.4%] male, 390 [32.6%] female, and 13 [1.1%] other; 696 [58.1%] aged 30 to 49 years), 1160 (96.8%) provided usable data for this analysis. eFigure 1 in the Supplement describes the flow of participants into and through the trial and shows the available sample size by group and by site. Table 1 provides descriptive statistics for the sample at baseline. Values for other variables not Table 1. Baseline Characteristics of Participants, Stratified by Randomization Group Study Randomization Group Characteristic HF (n = 689) TAU (n = 509) Age group, y, No. (%) <30 118 (17.1) 91 (17.9) 30-49 398 (57.8) 298 (58.4) ≥50 173 (25.1) 120 (23.6) Sex, No. (%) Women 236 (34.3) 154 (30.3) Men 449 (65.2) 346 (68.0) Other 4 (0.6) 9 (1.8) Alcohol abuse or dependence, No. (%) 296 (43.0) 224 (44.0) Substance abuse or dependence, No. (%) 321 (46.6) 242 (47.5) Alcohol or substance abuse or dependence, No. (%) 424 (61.5) 321 (63.1) Hospitalization history, No. (%) 155 (22.5) 129 (25.3) Arrest history, No. (%) 200 (29.0) 154 (30.3) Longest period homeless, mo Mean (SD) 29.7 (46.4) 28.1 (37.0) Abbreviations: HF, Housing First intervention; IQR, Median (IQR) 12 (6-36) 12 (5-36) interquartile range; MCAS, Multnomah Community Ability Scale; TAU, treatment as usual. MCAS score Mean (SD) 64.7 (6.2) 64.7 (6.2) Evaluated using the Mini International Neuropsychiatric Interview. Median (IQR) 65.0 (63.0-68.0) 65.0 (63.0-68.0) Indicates 2 or more hospitalizations within 1 year Study site, No. (%) during the 5 years before baseline. Montreal, Québec 204 (29.6) 102 (20.0) Indicates 1 or more arrests or incarcerations during Toronto, Ontario 204 (29.6) 174 (34.2) the 6 months before baseline. Winnipeg, Manitoba 181 (26.3) 133 (26.1) Scores range from 17 to 85, with higher values Vancouver, British Columbia 100 (14.5) 100 (19.6) indicating better functioning. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 5/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness used in this analysis have been reported elsewhere. Their mean (SD) longest period of homelessness was 29.0 (42.6) months (median, 12 months [interquartile range, 5-36 months]). Table 2 shows baseline and first- and second-year costs by type of cost for the HF and TAU groups. During the 2-year follow-up period, meaningful cost offsets (mean reductions in costs attributable to the intervention) were observed for shelters (−$2627; 95% CI, −$3232 to −$2079), substance use treatment (−$1148; 95% CI, −$1658 to −$638), supportive housing (−$1861; 95% CI, −$2540 to −$1222), and ambulatory visits (−$2375; 95% CI, −$3226 to −$1523). For other cost categories, the 95% CIs for offsets for other cost categories included zero, or the point estimate was less than $1000. Excluding the intervention cost, the total mean cost offset was −$6629 (95% CI, −$10 199 to −$2969). However, after including the mean cost of the intervention ($14 496, inferred from Table 2), the mean total cost for HF participants exceeded that for TAU by $7868 (95% CI, $4409-$11 405). Thus, 46% of the cost of the intervention was offset. For most services as well as in total, the cost difference was less favorable to HF in the second year than in the first. Table 3 disaggregates costs by site rather than by cost category. The magnitude of the net cost, including the cost of the intervention, ranged from $5218 (95% CI, −$983 to $11 385) per person per year in Montreal to $11 702 (95% CI, $5196-$18 873) per person per year in Toronto. Days with stable housing were higher by 140.34 (95% CI, 128.14-153.31) days in the HF group, with a cost difference of $7867.73 (95% CI, $4408.81-$11 404.79). Thus, the incremental cost- effectiveness ratio was $56.08 (95% CI, $29.55-$84.78) per day of stable housing. eFigure 2 in the Supplement shows 500 bootstrap replicates of mean incremental cost and the corresponding mean incremental number of days of stable housing on the cost-effectiveness plane. All the points lie in the quadrant corresponding to higher effectiveness and higher costs, indicating that taking all sites together, the intervention unambiguously increases days of stable housing and costs. The cost-effectiveness acceptability curve shown in the Figure indicates that if the decision- maker is willing to pay $67 per night of stable housing, there is an 80% chance that HF is cost- effective compared with TAU. If the decision-maker is willing to pay approximately $100 per day of stable housing, then the probability that the intervention is cost-effective increases to 100%. eTable 1 in the Supplement shows the results of net benefit regressions that do not include interactions. As the decision-maker’s willingness to pay for an additional day of stable housing (represented by λ) rises from $0 to $100, the adjusted net benefit of receiving HF is initially negative (net cost of −$8604 per person per year; 95% CI, −$12 027 to −$5181) but increases quickly so that at $100 the net benefit is positive, reaching $5269 (95% CI, $1352-$9186). Only 1 other variable appeared to be associated with a meaningful difference in net benefit: people who had been arrested or incarcerated in the 6 months before baseline had a lower net benefit. Age, sex, alcohol or substance abuse or dependence, and level of functioning were not associated with net benefit, regardless of λ, after adjusting for site and the other factors. Table 4 shows the results of adding interactions between group assignment and the variables identified using the procedure described above. None of the site variables or interactions with site were meaningfully different from zero, suggesting that the cost-effectiveness of HF with ICM did not vary by site. Costs appeared to vary with arrest history; the addition of the interaction terms had little effect on estimated coefficients. A higher level of functioning was associated with a higher net benefit at higher levels of λ: at λ = $100, a (clinically meaningful) 10-point increase in the Multnomah Community Ability Scale score was associated with an increase in net benefit of $6901 (95% CI, $1839-$11 962) per person per year, indicating that a higher level of functioning was associated with more days of stable housing. The results suggest that HF yielded a net benefit lower by approximately $7000 for people who had had 2 or more hospitalizations for mental illness during a 1-year period during the previous 5 years; the amount varied from −$6820 (95% CI, −$12 673 to −$967) at λ = 0 to −$7456 (95% CI, −$14 065 to −$847) at λ = 100. None of the other interaction terms appeared to meaningfully alter costs at any value of λ. Thus, no individual-level baseline JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 6/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Table 2. Mean (Unadjusted) Costs per Person per Year by Time and Cost Category Study Randomization Group, Mean (95% CI), 2016 Can$ Cost Category TAU (n = 483) HF (n = 677) Difference (HF − TAU) Shelters Baseline 9595 (8680 to 10 434) 8915 (8204 to 9650) −679 (−1876 to 425) First year 5476 (4803 to 6184) 2244 (1940 to 2535) −3233 (−4037 to −2537) Second year 2879 (2348 to 3479) 857 (626 to 1084) −2022 (−2625 to −1404) Mean of first and second years 4177 (3684 to 4773) 1550 (1320 to 1762) −2627 (−3232 to −2079) Substance use treatment Baseline 3553 (2580 to 4750) 3320 (2358 to 4335) −233 (−1692 to 1264) First year 2400 (1724 to 3149) 986 (733 to 1279) −1414 (−2190 to −697) Second year 1666 (1130 to 2123) 785 (561 to 1074) −881 (−1377 to −304) Mean of first and second years 2033 (1580 to 2521) 886 (687 to 1105) −1148 (−1658 to −638) Supportive housing Baseline 2476 (1805 to 3195) 3461 (2823 to 4279) 985 (0 to 2073) First year 3353 (2727 to 4097) 1517 (1263 to 1812) −1835 (−2550 to −1137) Second year 2938 (2243 to 3656) 1052 (706 to 1476) −1886 (−2691 to −1081) Mean of first and second years 3145 (2549 to 3769) 1285 (1036 to 1573) −1861 (−2540 to −1222) Ambulatory visits Baseline 14 920 (12 580 to 17 358) 11 629 (10 146 to 13 586) −3291 (−6026 to −450) First year 7572 (6520 to 8663) 4545 (3904 to 5219) −3028 (−4237 to −1653) Second year 5708 (4833 to 6661) 3986 (3423 to 4709) −1722 (−2802 to −587) Mean of first and second years 6640 (5987 to 7435) 4266 (3809 to 4755) −2375 (−3226 to −1523) ED visits Baseline 2207 (1870 to 2590) 2092 (1789 to 2444) −115 (−611 to 377) First year 1862 (1500 to 2261) 1239 (1077 to 1418) −623 (−1055 to −237) Second year 1279 (1033 to 1572) 981 (856 to 1105) −299 (−641 to −22) Mean of first and second years 1571 (1325 to 1876) 1110 (995 to 1238) −461 (−775 to −186) Hospitalizations (physical) Baseline 1621 (624 to 2990) 1567 (612 to 2864) −54 (−1649 to 1688) First year 2493 (1533 to 3669) 2025 (1226 to 2943) −468 (−1906 to 975) Second year 2786 (1443 to 5106) 2421 (1456 to 3546) −365 (−2840 to 1376) Mean of first and second years 2640 (1722 to 4005) 2223 (1586 to 2939) −417 (−2060 to 799) Hospitalizations (psychiatric) Baseline 4285 (2153 to 6554) 4507 (2660 to 6516) 222 (−2776 to 3450) First year 3392 (1876 to 5328) 3670 (2442 to 5334) 278 (−2185 to 2579) Second year 1644 (975 to 2578) 4414 (2714 to 6443) 2770 (904 to 4890) Mean of first and second years 2518 (1600 to 3550) 4042 (2832 to 5700) 1524 (−80 to 3404) Other (eg, helplines, day centers) Baseline 3304 (2933 to 3761) 2986 (2669 to 3311) −317 (−902 to 200) First year 1638 (1442 to 1853) 1117 (980 to 1251) −521 (−786 to −290) Second year 1195 (1048 to 1348) 902 (784 to 1003) −293 (−512 to −109) Mean of first and second years 1417 (1276 to 1574) 1009 (896 to 1114) −407 (−616 to −231) Police contacts and court appearances Baseline 9222 (7571 to 11 062) 7987 (6634 to 9395) −1235 (−3310 to 996) First year 6925 (5300 to 8784) 6572 (5529 to 7720) −352 (−2474 to 1733) Second year 5871 (4600 to 7210) 4996 (4178 to 5994) −875 (−2496 to 679) Mean of first and second years 6398 (5149 to 7782) 5784 (4955 to 6627) −613 (−2247 to 977) Incarcerations Baseline 2084 (1210 to 3108) 2365 (1556 to 3452) 281 (−940 to 1529) First year 1675 (1076 to 2334) 2820 (2125 to 3672) 1146 (210 to 2159) Second year 3064 (2063 to 4192) 3963 (2980 to 5266) 899 (−544 to 2444) Mean of first and second years 2369 (1666 to 3131) 3392 (2642 to 4284) 1022 (−66 to 2198) (continued) JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 7/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Table 2. Mean (Unadjusted) Costs per Person per Year by Time and Cost Category (continued) Study Randomization Group, Mean (95% CI), 2016 Can$ Cost Category TAU (n = 483) HF (n = 677) Difference (HF − TAU) Welfare and disability benefits Baseline 2758 (2588 to 2911) 2869 (2761 to 2991) 111 (−94 to 322) First year 8641 (8233 to 9060) 9154 (8861 to 9489) 512 (−14 to 1053) Second year 9480 (9049 to 9956) 9574 (9298 to 9863) 94 (−449 to 619) Mean of first and second years 9061 (8679 to 9507) 9364 (9095 to 9661) 303 (−175 to 823) Income earned Baseline 343 (243 to 454) 146 (83 to 227) −197 (−329 to −70) First year 1129 (854 to 1399) 517 (395 to 669) −611 (−905 to −330) Second year 1111 (868 to 1375) 863 (671 to 1062) −248 (−579 to 75) Mean of first and second years 1120 (906 to 1360) 690 (553 to 835) −430 (−696 to −141) Total (excluding intervention cost) Baseline 53 015 (48 870 to 56 809) 49 062 (45 971 to 52 654) −3954 (−8843 to 1479) First year 44 299 (41 018 to 47 592) 35 372 (33 159 to 37 857) −8927 (−13 373 to −4895) Second year 37 398 (34 445 to 40 598) 33 068 (30 612 to 36 188) −4330 (−8157 to 53) Mean of first and second years 40 849 (38 374 to 43 538) 34 220 (32 175 to 36 695) −6629 (−10 199 to −2969) Total (including intervention cost) First year 44 299 (41 018 to 47 592) 50 554 (47 801 to 53 221) 6255 (1617 to 10 425) Second year 37 398 (34 445 to 40 598) 46 879 (44 243 to 50 135) 9480 (5772 to 13 888) Mean of first and second years 40 849 (38 374 to 43 538) 48 716 (46 593 to 51 072) 7868 (4409 to 11 405) Abbreviations: ED, emergency department; HF, Housing First; TAU, treatment as usual. This category includes rooms in buildings with on-site support staff and, notably for a Toronto, subsidized rooms in buildings without on-site support staff. Twenty-seven elements (1 per month and 3 before the baseline interview) were included for days of stable housing. Missing rates (addressed using multiple imputation) were 14.8% for the TAU group and 9.4% for the HF group. For costs, 279 elements were included; missing rates were 13.0% and 9.2%, respectively. variable, except possibly hospitalization history, and no site appeared to make HF with ICM more or less cost-effective. Sensitivity analyses shown in eTable 2 in the Supplement indicate that our results are robust to changes in the discount rate and only somewhat sensitive to the adjustment for baseline differences or a combination of both. Adjusting for baseline differences increases the incremental cost- effectiveness ratio from $56.08 to $60.18. Changes in the discount rate have a minimal effect. The largest change is obtained by adjusting for baseline differences, without altering the discount rate: the incremental cost-effectiveness ratio becomes $60.18 (95% CI, $35.27-$86.95). Discussion This cost-effectiveness analysis relies on data from the largest trial of scattered-site HF with ICM for people with mental illness and moderate needs, to our knowledge, conducted to date. The intervention costs a mean of $14 496 per person per year. Cost offsets on a wide range of other services reduced the net cost to $7868, a 46% reduction. An additional day of stable housing cost $56.08. Cost-effectiveness seemed to be about the same regardless of participant characteristics, with the possible exception of hospitalization history. 7,25 In previous reports of the At Home/Chez Soi study, the intervention cost was reported as Can$14 177 per participant annually (in 2011 dollars), and the mean net cost offset was Can $4849, or 34% of the cost of the intervention. Although qualitatively similar, the numerical estimates presented herein differ from the earlier ones for several reasons. Most important, in the present study, we did not adjust for baseline differences in costs, whereas the earlier reports used a relatively simple difference-in-differences method, applied to mean costs per person per site. Second, we allocated JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 8/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness the cost of the intervention to individual study participants. Third, we refined several unit cost calculations compared with the earlier report. Cost-effectiveness analyses, including for the treatment of mental health conditions, often use 19 26 quality-adjusted life-years as an outcome measure, despite their known limitations. In the present report, consistent with the only published cost-effectiveness analysis of a related intervention published to date, we used days of stable housing instead. Hierarchical linear models estimated on the EQ-5D, a common instrument from which to derive quality-adjusted life-years, showed no significant difference between the experimental and TAU groups. This finding is not surprising because HF is in significant measure a social care intervention, with health effects that may only become apparent during a longer period. Qualitative interviews conducted on a 10% sample of Table 3. Total Unadjusted Mean Costs per Person per Year by Site TAU Group HF Group No. of No. of Cost by Site Participants Mean Cost (95% CI), Can$ Participants Mean Cost (95% CI), Can$ Difference, Mean Cost (95% CI) ICM team Montreal NA NA 200 7375 (6679 to 8075) NA Toronto NA NA 200 6825 (5850 to 7914) NA Winnipeg NA NA 177 7613 (6194 to 9148) NA Vancouver NA NA 100 5533 (4199 to 7211) NA Housing team and rent supplements Montreal NA NA 200 7345 (7026 to 7702) NA Toronto NA NA 200 8752 (8248 to 9184) NA Winnipeg NA NA 177 5336 (4903 to 5797) NA Vancouver NA NA 100 9093 (8310 to 9848) NA Total without intervention Montreal 102 41 699 (36 752 to 47 040) 200 32 197 (28 598 to 36 031) −9502 (−16 072 to −3280) Toronto 159 41 108 (36 436 to 45 935) 200 37 234 (33 096 to 41 897) −3875 (−10 353 to 3136) Winnipeg 126 38 961 (34 248 to 43 498) 177 33 987 (30 590 to 37 551) −4975 (−10 365 to 740) Vancouver 96 41 992 (35 752 to 48 308) 100 32 653 (27 222 to 40 155) −9339 (−18 250 to 1008) Total with intervention Montreal 102 41 699 (36 752 to 47 040) 200 46 917 (43 389 to 50 542) 5218 (−983 to 11 385) Toronto 159 41 108 (36 436 to 45 935) 200 52 811 (48 171 to 57 341) 11 702 (5196 to 18 873) Winnipeg 126 38 961 (34 248 to 43 498) 177 46 935 (43 045 to 51 066) 7974 (1985 to 14 335) Vancouver 96 41 992 (35 752 to 48 308) 100 47 279 (41 497 to 55 015) 5287 (−3816 to 15 428) Abbreviations: HF, Housing First; ICM, Intensive Case Management; NA, not applicable; TAU, treatment as usual. Figure. Cost-effectiveness Acceptability Curve 1.0 0.8 0.6 0.4 0.2 The probability that the Housing First (HF) intervention is cost-effective compared with treatment as usual as a function of the value that the 0 50 100 150 200 250 decision-maker attributes to an additional day of Threshold Willingness to Pay, Can$ stable housing. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 9/15 Probability HF is Cost-effective JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 10/15 Table 4. Net Benefit Regression Results Assigning Different Values to an Additional Day of Stable Housing With Interaction Terms Estimated β Coefficient (95% CI), 2016 Can$ c c c c c c Term λ = Can$0 λ = Can$20 λ = Can$40 λ = Can$60 λ = Can$80 λ = Can$100 HF intervention 36 433 (−3860 to 76 726) 39 828 (−1193 to 80 850) 43 223 (1304 to 85 143) 46 618 (3643 to 89 594) 50 013 (5834 to 94 193) 53 409 (7890 to 98 927) Toronto 1088 (−6472 to 8649) 1575 (−6104 to 9254) 2062 (−5770 to 9894) 2548 (−5470 to 10 566) 3035 (−5200 to 11 270) 3522 (−4959 to 12 002) Winnipeg 1798 (−6198 to 9794) 1453 (−6688 to 9595) 1109 (−7215 to 9432) 764 (−7776 to 9304) 419 (−8370 to 9208) 74 (−8993 to 9142) Vancouver 1397 (−7020 to 9813) 620 (−7951 to 9192) −156 (−8920 to 8608) −932 (−9925 to 8061) −1708 (−10 964 to 7548) −2484 (−12 034 to 7065) Aged 30-49 2833 (−4575 to 10 241) 2781 (−4764 to 10 326) 2729 (−4985 to 10 444) 2677 (−5238 to 10 592) 2625 (−5519 to 10 770) 2574 (−5826 to 10 973) Aged ≥50 y 431 (−8243 to 9104) 276 (−8571 to 9124) 122 (−8937 to 9181) −32 (−9339 to 9275) −186 (−9773 to 9400) −341 (−10 237 to 9556) Female −4015 (−7765 to −265) −3818 (−7634 to −1) −3621 (−7520 to 278) −3424 (−7421 to 573) −3226 (−7335 to 882) −3029 (−7263 to 1205) Alcohol or substance 427 (−3477 to 4331) 457 (−3508 to 4423) 488 (−3556 to 4532) 519 (−3619 to 4656) 549 (−3697 to 4795) 580 (−3788 to 4947) abuse or dependence MCAS score/10 4859 (377 to 9341) 5267 (705 to 9830) 5676 (1013 to 10 338) 6084 (1304 to 10 864) 6492 (1579 to 11 405) 6901 (1839 to 11 962) Hospitalization −3730 (−7940 to 479) −3547 (−7834 to 741) −3363 (−7746 to 1021) −3179 (−7676 to 1317) −2996 (−7620 to 1629) −2812 (−7579 to 1956) history Arrest history −9895 (−13 836 to −5954) −10 467 (−14 481 to −6453) −11 038 (−15 143 to −6934) −11 610 (−15 820 to −7399) −12 181 (−16 513 to −7850) −12 753 (−17 219 to −8287) Longest period −13 (−54 to 28) −16 (−58 to 25) −19 (−62 to 23) −22 (−66 to 22) −25 (−70 to 20) −28 (−75 to 18) homeless Interaction terms Toronto × HF −5737 (−15 338 to 3864) −6198 (−15 966 to 3570) −6658 (−16 637 to 3321) −7119 (−17 349 to 3111) −7579 (−18 099 to 2940) −8040 (−18 884 to 2804) Winnipeg × HF −969 (−11 033 to 9095) −1755 (−12 008 to 8498) −2542 (−13 029 to 7946) −3328 (−14 091 to 7435) −4114 (−15 192 to 6964) −4901 (−16 329 to 6528) Vancouver × HF −1612 (−12 640 to 9415) −1218 (−12 457 to 10 021) −824 (−12 325 to 10 677) −429 (−12 239 to 11 380) −35 (−12 196 to 12 126) 359 (−12 192 to 12 911) Age 30-49 × HF 181 (−9395 to 9756) 683 (−9077 to 10 443) 1185 (-8803 to 11 173) 1687 (−8568 to 11 943) 2190 (−8371 to 12 750) 2692 (−8208 to 13 592) Age ≥50 × HF 5640 (−5515 to 16 795) 6454 (−4920 to 17 828) 7268 (−4374 to 18 911) 8082 (−3874 to 20 039) 8896 (−3417 to 21 209) 9710 (−2998 to 22 418) Hospitalization −6820 (−12 673 to −967) −6947 (−12 906 to −989) −7075 (−13 163 to −986) −7202 (−13 443 to −960) −7329 (−13 745 to −914) −7456 (−14 065 to −847) history × HF Constant −69 214 (−100 884 to −69 254 (−101 614 to −69 175 (−100 284 to −69 293 (−102 466 to −69 333 (−103 431 to −69 372 (−104 500 to −37 544) −36 893) −38 065) −36 120) −35 234) −34 244) Abbreviations: HF, Housing First intervention; MCAS, Multnomah Community Ability Scale. Decision-maker’s willingness to pay for an additional day of stable housing. a d Includes 1160 participants. Models estimated with net monetary benefit are not adjusted for baseline Coefficients indicate partial association with a 10-point increase in MCAS score. differences in costs. Dependent variable is (d × λ)–c , where λ is the threshold ratio (in Canadian dollars per e i i Indicates 2 or more hospitalizations for mental illness during a 1-year period within the 5 years before baseline. additional day of stable housing), d is participant i’s annualized number of days of stable housing, and c is the i i Indicates 1 or more arrests or incarcerations during the 6 months before baseline. corresponding total cost. Indicates during lifetime, in months. Reference categories include Montreal site, younger than 30 years, and no alcohol or substance abuse or dependence. JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness study participants showed that participants in the HF group were much more likely to experience positive changes in their life trajectories than those in the TAU group during the 2 years of the study. The only comparable cost-effectiveness analysis in the literature was performed at Veterans Affairs medical centers in 4 US cities using data collected in the early to middle 1990s. The most similar intervention in that study was a less intensive form of case management than herein, with as many as 25 participants per case manager. This intervention was combined with Section 8 vouchers (rent subsidies). Fully half of participants in that study had no psychiatric diagnosis other than alcohol or drug use disorder. The study found that, from a societal perspective, the intervention cost $45 more per additional day of housing, compared with standard care. Adjusting for the effects of 29 30 inflation and using purchasing power parity in 2016 to convert US into Canadian dollars, that amount is equivalent to about Can$79. Our somewhat lower estimate may reflect the greater potential for cost offsets with a group of participants with greater illness. In this trial, careful attention was paid to implementation fidelity. Fidelity was found to be fair to excellent across sites. Other work has reported an association between higher fidelity and 31 32,33 housing stability, quality of life, and community functioning as well as other positive outcomes. Not all HF implementations are as careful to follow the Pathways model as those of the At Home/ Chez Soi trial; for instance, caseloads may be increased or rent supplements may be reduced. Although such changes will reduce the cost of the intervention itself, the magnitude of the cost offsets observed herein may not remain the same. The fact that HF with ICM did not dominate the intervention—that it did not prove more effective and less costly—does not mean that it should not be implemented. Most health and social interventions do not pay for themselves. Rather, they yield benefits judged sufficient to merit their cost. The cost of the intervention itself, which was approximately $40 per participant per day, is well within the range of the costs of many currently funded forms of emergency shelter and supported housing. Allowing for some budgetary reallocations and reflecting the reductions in costs of these and other services in which the delivery of HF with ICM results, the overall budgetary impact of a significant expansion of HF with ICM capacity is likely to be quite reasonable. Our study found little evidence of HF being more or less cost-effective for different subgroups. This finding may be attributable to the fact that clinical teams adjust the nature and intensity of their interventions according to each participant’s needs and preferences. Cost-effectiveness may have been lower for people with more previous hospitalizations for mental illness, possibly because the teams expended more effort on clients more prone to prior hospitalizations but could not sufficiently alter participants’ propensity to be hospitalized more often. Our findings give no ground for any selection of participants on characteristics such as current alcohol or substance abuse or previous justice services involvement. Strengths and Limitations Our study presents several strengths. The sample size was large and drawn from several sites. It evaluated a carefully defined and implemented intervention. Attrition, and in particular differential attrition, was modest. Service use was measured in a much more comprehensive way than is typical in cost-effectiveness studies. Unit costs were carefully estimated. Several limitations need to be noted as well. Service use data were based on participant self- reports. Although these reports are subject to recall biases, the most costly components of costs are based on self-reports gathered at 3-month intervals, which have been shown to have good validity. 35,36 The validity of self-reports in the At Home/Chez Soi study has also been corroborated directly. The costs of medications were not included, owing to the difficulty of obtaining reliable and sufficiently detailed information on medications taken by participants by questionnaire and restrictions on sharing of participant-level administrative data, including on medication use, across provinces. The ICM teams, however, do not typically focus on increasing medication adherence. The follow-up period was 2 years, and we do not know how cost-effectiveness would evolve for a longer JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 11/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness duration. We did not estimate the administrative costs of transfer payments, but because most participants in both groups received social assistance payments, doing so would have had little effect. Conclusions In this large, multiple-site trial, we found that about half of the costs of an HF with ICM intervention were offset by reductions in the costs of shelters, ambulatory visits, emergency department visits, and other services. Even if these cost offsets do not result in reductions in budgetary outlays, they translate into greater availability of resources for others in need. The net cost was modest in relation to current expenditures on individuals who are homeless. Furthermore, we found little evidence of cost-effectiveness varying according to participant characteristics. These results support more widespread implementation of scattered-site HF with ICM programs for homeless people with characteristics comparable to those of the participants included in this trial. ARTICLE INFORMATION Accepted for Publication: June 28, 2019. Published: August 21, 2019. doi:10.1001/jamanetworkopen.2019.9782 Correction: This article was corrected on September 11, 2019, to fix 2 incorrect numbers in eFigure 1 in the Supplement. Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2019 Latimer EA et al. JAMA Network Open. Corresponding Author: Eric A. Latimer, PhD, Perry 3C, Douglas Research Centre, 6875 LaSalle Blvd, Montreal, QC H4H 1R3, Canada (eric.latimer@mcgill.ca). Author Affiliations: Department of Psychiatry, McGill University, Montreal, Quebec, Canada (Latimer); Douglas Research Centre, Montreal, Quebec, Canada (Latimer, Rabouin, Cao); Montreal West Island Integrated University Health and Social Services Centre, Montreal, Quebec, Canada (Ly); Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, Quebec, Canada (Powell, Moodie); Department of Psychiatry, University of Calgary, Calgary, Alberta, Canada (Adair); Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada (Adair); Department of Psychiatry, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba, Canada (Sareen); Faculty of Health Sciences, Simon Fraser University, Vancouver, British Columbia, Canada (Somers); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (Stergiopoulos); Centre for Addiction and Mental Health, University of Toronto, Toronto, Ontario, Canada (Stergiopoulos, Veldhuizen); Department of Family and Community Medicine, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada (Pinto); MAP Centre for Urban Health Solutions, Li Ka Shing Knowledge Institute, St Michael’s Hospital, Toronto, Ontario, Canada (Pinto). Author Contributions: Dr Latimer and Ms Cao had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Concept and design: Latimer, Ly, Adair, Sareen, Somers, Stergiopoulos, Pinto. Acquisition, analysis, or interpretation of data: Latimer, Rabouin, Cao, Powell, Adair, Sareen, Somers, Stergiopoulos, Moodie, Veldhuizen. Drafting of the manuscript: Latimer. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: Latimer, Rabouin, Cao, Powell, Moodie. Obtained funding: Latimer, Sareen, Somers, Stergiopoulos. Administrative, technical, or material support: Latimer, Ly, Adair, Sareen, Somers, Stergiopoulos, Pinto, Veldhuizen. Supervision: Latimer, Adair, Somers, Moodie. Conflict of Interest Disclosures: Dr Adair reported being engaged as a dedicated researcher at the national level for the duration and being paid by the study, not her academic institution, to devote time to the study; her role was the same as the academic researchers on the team and she retained academic freedom in all aspects. Dr Pinto reported support as a clinician scientist by the Department of Family and Community Medicine, Faculty of JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 12/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Medicine at the University of Toronto, St Michael’s Hospital, and the Li Ka Shing Knowledge Institute, St Michael’s Hospital; support by a fellowship from the Physicians’ Services Incorporated Foundation; and serving as the Associate Director for Clinical Research at the University of Toronto Practice-Based Research Network. No other disclosures were reported. Funding/Support: This study was supported by a financial contribution from Health Canada to the Mental Health Commission of Canada. Role of the Funder/Sponsor: The Mental Health Commission of Canada oversaw the conduct of the study, including ensuring that data collection timelines were met, and helped organize the management of the data set until it was complete. It also provided training and technical support to the service teams and research staff throughout the project. However, the sponsor had no role in the analysis and interpretation of the data and preparation, review, or approval of the manuscript, or in the decision to submit it for publication. Disclaimer: The views expressed herein solely represent those of the authors. Group Members: The following investigators participated in At Home/Chez Soi: National Team: Carol E. Adair, PhD; Tim Aubry, PhD; Paula N. Goering, RN, PhD; Geoffrey Nelson, PhD; Myra Piat, PhD; Sanjeev Sridharan, PhD; David Streiner, PhD; and Sam Tsemberis, PhD. Moncton: Saïd Bergheul, PhD; Jimmy Bourque, PhD; Paul-Émile Bourque, PhD; Pierre-Marcel Desjardins, PhD; Stefanie R. LeBlanc, MA; Danielle Nolin, PhD; Sarah Pakzad, PhD; and John Sylvestre, PhD. Montreal: Jean-Pierre Bonin, PhD; Anne G. Crocker, PhD; Henri Dorvil, PhD; Marie-Josée Fleury, PhD; Roch Hurtubise, PhD; Eric A. Latimer, PhD; Alain Lesage, MD; Christopher McAll, PhD; Catherine Vallée, PhD; and Helen-Maria Vasiliadis, PhD. Toronto: Ahmed M. Bayoumi, MD; Stephen W. Hwang, MD; Bonnie Kirsh, PhD; Maritt Kirst, PhD; Kwame McKenzie, MD; Rosane Nisenbaum, PhD; Patricia O’Campo, PhD; and Vicky Stergiopoulos, MD. Winnipeg: James M. Bolton, MD; Daniel G. Chateau, PhD; Jino Distasio, PhD; Murray W. Enns, MD; Laurence Y. Katz, MD; Patricia J. Martens, PhD; Jitender Sareen, MD; and Mark J. Smith, MSc. Vancouver: James Frankish, PhD; Michael R. Krausz, MD, PhD; Lawrence McCandless, PhD; Akm Moniruzzaman, PhD; Tonia L. Nicholls, PhD; Anita Palepu, MD; Michelle L. Patterson, PhD; Christian G. Schutz, MD, PhD; Julian M. Somers, PhD; Verena Strehlau, MD; and Denise Zabkiewicz, PhD. Additional Contributions: Jayne Barker, PhD (2008-2011), Cameron Keller, MC (2011-2012), and Catharine Hume, MHSc (2012-2014), served as the Mental Health Commission of Canada At Home/Chez Soi National Project Leads. We thank the National Research Team, the 5 site research teams, the site coordinators, and the numerous service and housing providers, as well as persons with lived experience, who contributed to this project and the research. The individuals named above received compensation from the Mental Health Commission of Canada for their role in the study. Paula N. Goering, RN, PhD, was the lead investigator for the At Home/Chez Soi project and as such led the design of the overall study and the process of data collection and contributed to the design of the economic analysis before her death May 26, 2016. Additional Information: The data set, code book and Stata syntax used for analysis are available to other investigators, on certain conditions related to protection of confidentiality and acknowledgment of contributions of those who prepared the data set, as well as with the acceptance of technical support provided at cost. (We judge such technical support essential to correct interpretation and analysis of the data.) Contact the corresponding author for details. REFERENCES 1. Fazel S, Khosla V, Doll H, Geddes J. The prevalence of mental disorders among the homeless in western countries: systematic review and meta-regression analysis. PLoS Med. 2008;5(12):e225. doi:10.1371/journal.pmed. 2. Aubry T, Nelson G, Tsemberis S. Housing First for people with severe mental illness who are homeless: a review of the research and findings from the At Home–Chez Soi demonstration project. Can J Psychiatry. 2015;60(11): 467-474. doi:10.1177/070674371506001102 3. Tsemberis S. Housing First: The Pathways Model to End Homelessness for People with Mental Illness and Addiction Manual. Center City, MN: Hazelden; 2010. 4. Ly A, Latimer E. Housing first impacts on costs and associated cost offsets: a review of the literature. Can J Psychiatry. 2015;60(11):475-487. doi:10.1177/070674371506001103 5. Rosenheck R, Kasprow W, Frisman L, Liu-Mares W. Cost-effectiveness of supported housing for homeless persons with mental illness. Arch Gen Psychiatry. 2003;60(9):940-951. doi:10.1001/archpsyc.60.9.940 6. Goering PN, Streiner DL, Adair C, et al. The At Home/Chez Soi trial protocol: a pragmatic, multi-site, randomised controlled trial of a Housing First intervention for homeless individuals with mental illness in five Canadian cities. BMJ Open. 2011;1(2):e000323. doi:10.1136/bmjopen-2011-000323 JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 13/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness 7. Stergiopoulos V, Hwang SW, Gozdzik A, et al; At Home/Chez Soi Investigators. Effect of scattered-site housing using rent supplements and intensive case management on housing stability among homeless adults with mental illness: a randomized trial. JAMA. 2015;313(9):905-915. doi:10.1001/jama.2015.1163 8. Aubry T, Goering P, Veldhuizen S, et al. A randomized controlled trial in five Canadian cities of the effectiveness of Housing First with assertive community treatment for persons with serious mental illness and a history of homelessness. Psychiatr Serv. 2016;67(3):275-281. doi:10.1176/appi.ps.201400587 9. Husereau D, Drummond M, Petrou S, et al; CHEERS Task Force. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMJ. 2013;346:f1049. doi:10.1136/bmj.f1049 10. Dickerson FB, Origoni AE, Pater A, Friedman BK, Kordonski WM. An expanded version of the Multnomah Community Ability Scale: anchors and interview probes for the assessment of adults with serious mental illness. Community Ment Health J. 2003;39(2):131-137. doi:10.1023/A:1022610620391 11. Frane JW. A method of biased coin randomization, its implementation, and its validation. Drug Inf J. 1998;32: 423-432. doi:10.1177/009286159803200213 12. Macnaughton E, Stefancic A, Nelson G, et al. Implementing Housing First across sites and over time: later fidelity and implementation evaluation of a pan-Canadian multi-site Housing First program for homeless people with mental illness. Am J Community Psychol. 2015;55(3-4):279-291. doi:10.1007/s10464-015-9709-z 13. Latimer E, Rabouin D, Cao Z, et al; At Home/Chez Soi Investigators. The costs of usual services for homeless people with mental illness in five Canadian cities: results from a large prospective follow-up study. Canadian Medical Association Journal Open. 2017;5(3):E576-E85. 14. Lecrubier Y, Weiller E, Amorim P, Bonora I, Sheehan KH, Janavs J. The Mini International Neuropsychiatric Interview (MINI): a short diagnostic structured interview: reliability and validity according to the CIDI. Eur Psychiatry. 1997;12(5):224-231. doi:10.1016/S0924-9338(97)83296-8 15. Frisman L, Rosenheck R. How transfer payments are treated in cost-effectiveness and cost-benefit analyses. Adm Policy Ment Health. 1996;23(6):533-546. doi:10.1007/BF02108689 16. Weisbrod BA, Test MA, Stein LI. Alternative to mental hospital treatment, II: economic benefit-cost analysis. Arch Gen Psychiatry. 1980;37(4):400-405. doi:10.1001/archpsyc.1980.01780170042004 17. Salkever D. Social costs of expanding access to evidence-based supported employment: concepts and interpretive review of evidence. Psychiatr Serv. 2013;64(2):111-119. doi:10.1176/appi.ps.201100499 18. Meltzer D. Accounting for future costs in medical cost-effectiveness analysis. J Health Econ. 1997;16(1):33-64. doi:10.1016/S0167-6296(96)00507-3 19. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. 4th ed. Oxford, UK: Oxford University Press; 2015. 20. Statistics Canada. Consumer Price Index, monthly, not seasonally adjusted. Table 326-0020. http://www5. statcan.gc.ca/cansim/a26?lang=eng&retrLang=eng&id=3260020&&pattern=&stByVal=1&p1=1&p2=37& tabMode=dataTable&csid=#customizeTab. Modified July 14, 2019. Accessed November 17, 2016. 21. Azur MJ, Stuart EA, Frangakis C, Leaf PJ. Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res. 2011;20(1):40-49. doi:10.1002/mpr.329 22. Shao J, Sitter RR. Bootstrap for imputed survey data. J Am Stat Assoc. 1996;91(435):1278-1288. doi:10.1080/ 01621459.1996.10476997 23. Hoch JS, Briggs AH, Willan AR. Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002;11(5): 415-430. doi:10.1002/hec.678 24. van Asselt AD, van Mastrigt GA, Dirksen CD, Arntz A, Severens JL, Kessels AG. How to deal with cost differences at baseline. Pharmacoeconomics. 2009;27(6):519-528. doi:10.2165/00019053-200927060-00007 25. Goering P, Veldhuizen S, Watson A, et al. National At Home/Chez Soi Final Report. Calgary, AB: Mental Health Commission of Canada; 2014. 26. Nord E, Daniels N, Kamlet M. QALYs: some challenges. Value Health. 2009;12(1)(suppl 1):S10-S15. doi:10.1111/j. 1524-4733.2009.00516.x 27. Euroqol Group. EQ-5D. https://euroqol.org/. Accessed January 5, 2018. 28. Nelson G, Patterson M, Kirst M, et al. Life changes among homeless persons with mental illness: a longitudinal study of housing first and usual treatment. Psychiatr Serv. 2015;66(6):592-597. doi:10.1176/appi.ps.201400201 29. Bureau of Labor Statistics. Databases, Tables & Calculators by Subject: CPI Inflation Calculator. https://www.bls. gov/data/inflation_calculator.htm. Accessed November 17, 2016. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 14/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness 30. Statistics Canada. Purchasing power parities, 2016. https://www150.statcan.gc.ca/n1/daily-quotidien/180424/ dq180424b-eng.htm. Posted April 24, 2018. Accessed July 9, 2018. 31. Goering P, Veldhuizen S, Nelson GB, et al. Further validation of the pathways Housing First Fidelity Scale. Psychiatr Serv. 2016;67(1):111-114. doi:10.1176/appi.ps.201400359 32. Davidson C, Neighbors C, Hall G, et al. Association of Housing First implementation and key outcomes among homeless persons with problematic substance use. Psychiatr Serv. 2014;65(11):1318-1324. doi:10.1176/appi.ps. 33. Gilmer TP, Stefancic A, Henwood BF, Ettner SL. Fidelity to the Housing First model and variation in health service use within permanent supportive housing. Psychiatr Serv. 2015;66(12):1283-1289. doi:10.1176/appi.ps. 34. Bhandari A, Wagner T. Self-reported utilization of health care services: improving measurement and accuracy. Med Care Res Rev. 2006;63(2):217-235. doi:10.1177/1077558705285298 35. Somers JM, Moniruzzaman A, Currie L, Rezansoff SN, Russolillo A, Parpouchi M. Accuracy of reported service use in a cohort of people who are chronically homeless and seriously mentally ill. BMC Psychiatry. 2016;16:41. doi:10.1186/s12888-016-0758-0 36. Lemieux AJ, Roy L, Martin MS, Latimer EA, Crocker AG. Justice involvement among homeless individuals with mental illnesses: are self-report and administrative measures comparable? Eval Program Plann.2017;61 (April):86-95. doi:10.1016/j.evalprogplan.2016.12.007 SUPPLEMENT. eFigure 1. Flowchart Showing Selection of Study Participants eFigure 2. Bootstrap Replicates on the Cost-effectiveness Plane eTable 1. Net Benefit Regression Results, Assigning Different Values to an Additional Day of Stable Housing Without Interaction Terms eTable 2. Two-Way Sensitivity Analysis: ICER and 95% CI as a Function of Discount Rate and Whether an Adjustment Is Made for Baseline Differences JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 15/15 Supplementary Online Content Latimer EA, Rabouin D, Cao Z, et al; At Home/Chez Soi Investigators. Cost-effectiveness of Housing First intervention with Intensive Case Management compared with treatment as usual for homeless adults with mental illness: secondary analysis of a randomized clinical trial. JAMA Netw Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 eFigure 1. Flowchart Showing Selection of Study Participants eFigure 2. Bootstrap Replicates on the Cost-effectiveness Plane eTable 1. Net Benefit Regression Results, Assigning Different Values to an Additional Day of Stable Housing Without Interaction Terms eTable 2. Two-Way Sensitivity Analysis: ICER and 95% CI as a Function of Discount Rate and Whether an Adjustment Is Made for Baseline Differences This supplementary material has been provided by the authors to give readers additional information about their work. © 2019 Latimer EA et al. JAMA Network Open eFigure 1. Flowchart Showing Selection of Study Participants Assessed for eligibility (n=2866) Excluded (n=611) Did not meet inclusion criteria (n=464) Declined to participate (n=107) Eligible, but study arm full (n=37) Incomplete baseline (n=3) Eligible for ACT (n=950) Eligible (n=2255) *described elsewhere Need level determined Eligible for ICM (n=1198) Allocation Allocated to TAU (n=509) Allocated to intervention (n= 689) Follow-Up Withdrew consent (discontinued usual Withdrew consent (discontinued care) (n=4) intervention) (n=4) Analysis Excluded due to missing all Health, Social Excluded due to missing all Health, Social and Justice Service Use data or all and Justice Service Use data or all Residential Time-Line Follow-Back data Residential Time-Line Follow-Back data (n=22) (n=8) Analysed (n=483) Analysed (n=677) Montreal=102 Montreal =200 Toronto=159 Toronto=200 Winnipeg=126 Winnipeg=177 Vancouver=96 Vancouver=100 Abbreviations: ACT, Assertive Community Treatment; ICM, Intensive Case Management; TAU, Treatment as usual. The number of participants assessed for eligibility is an estimate as some sites employed pre-screening and did not document those who were excluded through this process. © 2019 Latimer EA et al. JAMA Network Open eFigure 2. Bootstrap Replicates on the Cost-effectiveness Plane The original number of days stably housed and the total cost for each Housing First and Treatment as Usual participant are used to calculate the difference in average number of days stably housed between the Housing First and Treatment as Usual groups (Housing First minus Treatment as Usual), and the difference in average total costs. These two differences can be plotted on the cost-effectiveness plane; their ratio is the incremental cost-effectiveness ratio. To assess the variability in that ratio, 500 bootstrap samples are drawn. (A bootstrap sample is randomly drawn with replacement from the original set of cost-effect pairs, so that it has the same number of experimental and control group cost-effect pairs as in the original sample.) For each bootstrap sample, the difference in days stably housed and in total costs is computed and plotted. The cost-effectiveness acceptability curve (Figure 1) can then be derived from this figure. © 2019 Latimer EA et al. JAMA Network Open a b eTable 1. Net Benefit Regression Results, Assigning Different Values to an Additional Day of Stable Housing Without Interaction Terms =$0 b 95% C.I. b 95% C.I. b 95% C.I. HF -8,604 -12,027 -5,181 -5,830 -9,321 -2,338 -3,055 -6,631 522 Toronto -2,361 -7,085 2,363 -2,174 -6,977 2,629 -1,987 -6,891 2,916 Winnipeg 1,198 -3,793 6,189 375 -4,705 5,454 -449 -5,640 4,743 Vancouver 242 -5,332 5,815 -382 -6,068 5,304 -1,006 -6,829 4,816 Age 30-49 2,941 -1,877 7,759 3,158 -1,743 8,059 3,374 -1,631 8,380 Age 50+ 3,996 -1,655 9,647 4,304 -1,454 10,062 4,612 -1,278 10,502 Female -3,871 -7,617 -124 -3,682 -7,495 132 -3,492 -7,389 405 Alcohol or Substance abuse or dependence 647 -3,265 4,559 685 -3,290 4,659 722 -3,331 4,776 MCAS score/10 918 -1,910 3,746 1,260 -1,622 4,142 1,602 -1,346 4,550 Hospitalization history -3,639 -7,843 565 -3,447 -7,730 836 -3,255 -7,635 1,125 Arrest history -9,748 -13,678 -5,818 -10,334 -14,338 -6,330 -10,920 -15,015 -6,824 Longest period homeless -12 -53 29 -15 -57 27 -18 -61 25 Constant -43,338 -63,403 -23,273 -43,024 -63,470 -22,578 -42,709 -63,624 -21,795 HF -280 -3,957 3,396 2,494 -1,296 6,285 5,269 1,352 9,186 Toronto -1,801 -6,824 3,223 -1,614 -6,776 3,549 -1,427 -6,745 3,891 Winnipeg -1,272 -6,597 4,053 -2,095 -7,573 3,383 -2,918 -8,567 2,731 Vancouver -1,630 -7,612 4,352 -2,254 -8,416 3,909 -2,877 -9,239 3,484 Age 30-49 3,591 -1,539 8,721 3,807 -1,466 9,081 4,024 -1,411 9,459 Age 50+ 4,919 -1,126 10,965 5,227 -995 11,449 5,535 -884 11,953 Female -3,303 -7,299 693 -3,114 -7,222 995 -2,924 -7,159 1,310 Alcohol or Substance abuse or dependence 760 -3,389 4,909 798 -3,460 5,056 835 -3,545 5,216 MCAS score/10 1,944 -1,081 4,969 2,286 -827 5,400 2,629 -583 5,840 Hospitalization history -3,063 -7,557 1,431 -2,871 -7,495 1,752 -2,679 -7,446 2,088 Arrest history -11,506 -15,708 -7,303 -12,092 -16,416 -7,767 -12,678 -17,138 -8,217 Longest period homeless -21 -65 23 -24 -69 21 -27 -73 20 Constant -42,395 -63,861 -20,930 -42,081 -64,173 -19,989 -41,767 -64,554 -18,979 © 2019 Latimer EA et al. JAMA Network Open Abbreviations: C.I., confidence interval; MCAS, Multnomah Community Ability Scale. a b Notes: N=1160; data are given in 2016 Canadian dollars; Models estimated with net monetary benefit not adjusted for baseline differences in costs dependent variable is (d ) c , where d is participant of days stably housed and c the corresponding total cost; Decision- i i i i d e f stably housed; Montreal is the reference category; Age less than 30 is the reference category; No alcohol or substance abuse or dependence is the reference category; g h Coefficients indicate partial association with a 10-point increase in MCAS score; 2 or more hospitalizations for mental illness over a one-year period during the five years i j before baseline; one or more arrests or incarcerations in the 6 months before baseline; Over lifetime, in months. © 2019 Latimer EA et al. JAMA Network Open eTable 2. Two-Way Sensitivity Analysis: ICER and 95% CI as a Function of Discount Rate and Whether an Adjustment is Made for Baseline Differences Discount rate 0% 3% 5% No adjustment for baseline $55.84 (30.25, 84.59) $56.08 (29.55, 84.78) $55.41 (29.95, 84.09) differences Adjustment for baseline $59.67 (34.61, 87.08) $60.18 (35.27, 86.95) $59.27 (34.36, 85.88) differences © 2019 Latimer EA et al. JAMA Network Open http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png JAMA Network Open American Medical Association

Cost-effectiveness of Housing First Intervention With Intensive Case Management Compared With Treatment as Usual for Homeless Adults With Mental Illness

Download PDF
21 pages

Loading next page...
 
/lp/american-medical-association/cost-effectiveness-of-housing-first-intervention-with-intensive-case-6FuZsTg0ds

References (71)

Publisher
American Medical Association
Copyright
Copyright 2019 Latimer EA et al. JAMA Network Open.
eISSN
2574-3805
DOI
10.1001/jamanetworkopen.2019.9782
Publisher site
See Article on Publisher Site

Abstract

Key Points Question Is a Housing First intervention IMPORTANCE In the At Home/Chez Soi trial for homeless individuals with mental illness, the with Intensive Case Management for scattered-site Housing First (HF) with Intensive Case Management (ICM) intervention proved more homeless people with mental illness effective than treatment as usual (TAU). cost-effective compared with treatment as usual? OBJECTIVE To evaluate the cost-effectiveness of the HF plus ICM intervention compared with TAU. Findings In this economic evaluation study of data from the At Home/Chez DESIGN, SETTING, AND PARTICIPANTS This is an economic evaluation study of data from the At Soi randomized clinical trial with 1198 Home/Chez Soi randomized clinical trial. From October 2009 through July 2011, 1198 individuals initially homeless participants, the were randomized to the intervention (n = 689) or TAU (n = 509) and followed up for as long as 24 incremental cost-effectiveness ratio was months. Participants were recruited in the Canadian cities of Vancouver, Winnipeg, Toronto, and $56.08 per additional day of stable Montreal. Participants with a current mental disorder who were homeless and had a moderate level housing. At $67 per day of stable of need were included. Data were analyzed from 2013 through 2019, per protocol. housing, there was an 80% chance that the Housing First intervention with INTERVENTIONS Scattered-site HF (using rent supplements) with off-site ICM services was Intensive Case Management was cost- compared with usual housing and support services in each city. effective compared with treatment as usual. MAIN OUTCOMES AND MEASURES The analysis was performed from the perspective of society, with days of stable housing as the outcome. Service use was ascertained using questionnaires. Unit Meaning Expanding access to Housing costs were estimated in 2016 Canadian dollars. First with Intensive Case Management appears to be warranted from an RESULTS Of 1198 randomized individuals, 795 (66.4%) were men and 696 (58.1%) were aged 30 to economic point of view. 49 years. Almost all (1160 participants, including 677 in the HF group and 483 in the TAU group) contributed data to the economic analysis. Days of stable housing were higher by 140.34 days (95% Supplemental content CI, 128.14-153.31 days) in the HF group. The intervention cost $14 496 per person per year; reductions in costs of other services brought the net cost down by 46% to $7868 (95% CI, $4409-$11 405). Author affiliations and article information are listed at the end of this article. The incremental cost-effectiveness ratio was $56.08 (95% CI, $29.55-$84.78) per additional day of stable housing. In sensitivity analyses, adjusting for baseline differences using a regression-based method, without altering the discount rate, caused the largest change in the incremental cost- effectiveness ratio with an increase to $60.18 (95% CI, $35.27-$86.95). At $67 per day of stable housing, there was an 80% chance that HF was cost-effective compared with TAU. The cost- effectiveness of HF appeared to be similar for all participants, although possibly less for those with a higher number of previous psychiatric hospitalizations. (continued) Open Access. This is an open access article distributed under the terms of the CC-BY License. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 1/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Abstract (continued) CONCLUSIONS AND RELEVANCE In this study, the cost per additional day of stable housing was similar to that of many interventions for homeless individuals. Based on these results, expanding access to HF with ICM appears to be warranted from an economic standpoint. TRIAL REGISTRATION isrctn.org Identifier: ISRCTN42520374 JAMA Network Open. 2019;2(8):e199782. Corrected on September 11, 2019. doi:10.1001/jamanetworkopen.2019.9782 Introduction A significant proportion of homeless individuals experience mental illness. Housing First (HF), which provides immediate access to subsidized housing together with support services, has proven to be 2,3 the most effective approach at helping such individuals access and maintain permanent housing. Previous analyses, using mostly before-and-after comparisons or quasi-experimental designs, have reported significant cost offsets associated with the provision of HF. To our knowledge, only 1 cost- effectiveness analysis, conducted alongside a randomized clinical trial, has been published. The multiple-site At Home/Chez Soi trial compared outcomes of the scattered-site variant of HF, in which participants receive income-related rent supplements for private market apartments of their choice, with those of treatment as usual (TAU). The trial tested, in parallel, HF with Assertive Community Treatment for people who had more severe mental illness and functional difficulties and HF with Intensive Case Management (ICM) for those whose needs were less acute. Summary results 7,8 of cost analyses, but not cost-effectiveness analyses, were included in the main trial reports. Herein we report on the cost-effectiveness of HF with ICM compared with TAU. Methods The cost-effectiveness analysis was performed in conformity with the published protocol of the At Home/Chez Soi study. The analysis followed the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) reporting guideline. The analysis began in 2013 and underwent successive refinements until 2019. The study protocol is available elsewhere. The trial was conducted in the Canadian cities of Vancouver, British Columbia; Winnipeg, Manitoba; Toronto, Ontario; Montreal, Québec; and Moncton, New Brunswick. Ethics approval was obtained from the local ethics review board at each data-collection site and from the Centre for Addiction and Mental Health, where the coordinating center was based. Participants provided written informed consent after the screening interview. Participants 6,7 Details on sample recruitment are available elsewhere. Briefly, potential participants were referred from various sources or found through street outreach. Individuals were eligible if they were adults with legal status in their province of residence; had at least 1 of 6 current mental disorders, including psychotic disorder, major depressive disorder, or posttraumatic stress disorder; and were absolutely homeless or precariously housed with previous episodes of absolute homelessness. Individuals who were currently receiving services from an Assertive Community Treatment or ICM team (similar to what the experimental interventions offered, minus the access to rent supplements and dedicated housing staff) were not eligible. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 2/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Initial Assessment and Randomization Using data collected online during the baseline interview, a computerized algorithm classified individuals as high or moderate need. To be classified as high need, individuals needed to (1) have a lower level of functioning (score of 62 on the Multnomah Community Ability Scale) ; (2) have a diagnosis of current psychotic disorder or bipolar disorder; and (3) meet at least 1 of the following criteria: 2 or more hospitalizations for mental illness during a 1-year period within the previous 5 years; comorbid substance use; or 1 or more arrests or incarcerations in the past 6 months. Others were classified as moderate need. (In Moncton, high-need and moderate-need individuals were classified as high need, because of the relatively small pool of individuals eligible for the study. Accordingly, data from Moncton are not included in this analysis.) Moderate-need individuals were randomized to receive HF plus ICM or other services normally available to them (TAU). An adaptive randomization algorithm with allocation concealment was used. From October 2009 through June 2011, 1198 moderate-need individuals were recruited. Interventions Participants in the HF plus ICM group received recovery-oriented supports from an ICM team with about 17 participants per case manager. Each ICM team worked in collaboration with housing specialists, also paid by the project, to help participants find housing of their choice, usually an apartment on the private rental market, and respond to housing issues as they arose. Participants were required to pay 25% or 30% of their income toward the rent, depending on whether it covered heating costs. The project paid the remainder of the rent, with this supplement ranging from a mean of $375 in Montreal to $600 in Vancouver. Periodic evaluation of the fidelity of the interventions to the program model, combined with feedback and ongoing coaching, aided standardization of the interventions across sites. Although their intervention did not include HF, participants assigned to the TAU group had access to substantial supports, especially in the larger cities. These supports included emergency response services, such as shelters and hospital emergency departments, and some rehabilitative services, such as drug and alcohol rehabilitation centers and transitional housing. A small number of participants also were able to access ICM or Assertive Community Treatment services after they were recruited into the study. Data Collection Study participants were followed up for as long as 24 months. At baseline, interviewers used the Mini International Neuropsychiatric Interview and other sources such as medical records to ascertain diagnosis, assess whether abuse or dependence of alcohol or other substances was present, and document homelessness, hospitalization, and arrest history, among others. At baseline and every 6 months thereafter, a battery of standardized questionnaires was administered. The Multnomah Community Ability Scale, the only interviewer-rated measure, was completed at the end of the interview. Measures also included 3 questionnaires adapted for this study and designed to assess use 6,13 of services. Participants completed the Health Services and Justice Services Use questionnaire at baseline and every 6 months thereafter. The Health Services and Justice Services Use questionnaire documented all non–overnight health- and justice-related services. The Residential Time-Line Follow-Back instrument was administered every 3 months starting 3 months after baseline and asked participants where they had spent every night since the previous interview (or since 3 months before baseline). To enable estimation of costs associated with service use, the Residential Time-Line Follow-Back instrument allowed coding of simultaneous places of residence; for example, if a participant had a subsidized apartment and was hospitalized, costs were associated with both places concurrently. Finally, the Vocational Time-Line Follow-Back questionnaire asked about income received month by month and any regular or casual work obtained during the previous 3 months. Due to the nature of the intervention and the inclusion of measures on service use and housing, participants and interviewers could not be blinded. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 3/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Choice of Outcome Measure Days of stable housing (as assessed by the Residential Time-Line Follow-Back instrument) served as the outcome measure. Places where people stayed were classified as stable (own apartment, social housing, or staying with one’s family if this could be maintained for6 months) or unstable. Thus, all other housing situations, for this purpose, were deemed unstable. Perspective of the Economic Analysis As discussed in detail elsewhere, cost elements were collected and analyzed from the perspective 15 16 of society. We modified this perspective slightly, following Weisbrod et al, in that we included social assistance and disability benefits as costs. This modified societal perspective may be viewed as 17,18 consistent with a social cost impact analysis. Calculation of Costs per Individual We calculated many unit costs at a high level of specificity, distinguishing, for example, among supportive housing providers with different staffing levels. Whenever possible, we used financial statements and activity reports to estimate a fully allocated average cost of each service. The unit costs that we used and the methods that we used to derive them have been published. Unit costs for the intervention were based on reported expenses of each clinical team and housing provider. Program expenses were distributed among participants based on their own time receiving services from their clinical team, as estimated using the Health Services and Justice Services Use questionnaire, and on the number of nights that they had a subsidized apartment or housing unit provided by the project. All unit costs were originally in 2011 Canadian dollars or adjusted to 2011 Canadian dollars. For this analysis, we used the city-specific Consumer Price Index to convert costs into 2016 Canadian dollars. We calculated costs per individual by multiplying frequencies by the corresponding unit cost, including the intervention cost for experimental group participants, adding to that social assistance and other contributions by society to their income, and finally subtracting income earned. Discounting For each participant, costs as well as days of stable housing were estimated for a 2-year period. Costs and days of stable housing in the second year were discounted at a 3% rate, a common rate for a base case analysis. Statistical Analysis All analyses used multiple imputation with chained equations (20 imputations) to account for missing data. Mean costs per year after randomization, aggregated across sites but grouped into different categories, were compared between the HF and TAU groups at baseline and during each of the 2 years after baseline. Mean total costs per year were then compared site-by-site between the HF plus ICM and TAU groups. Confidence intervals for incremental cost-effectiveness ratios were computed via 21,22 bootstrapping, with 500 bootstrap resamples. We plotted the bootstrap resamples on the cost- effectiveness plane. We used the net-benefit approach to describe further the effect of sampling uncertainty. The intervention is deemed cost-effective if λμ –μ > 0, where λ is the threshold ratio (in dollars per ΔE ΔC additional day of stable housing) above which the decision-maker no longer finds the intervention cost-effective; μ , the mean difference in effectiveness between the 2 groups; and μ , the mean ΔE ΔC difference in costs. Using the bootstrap resamples, we plotted the cost-effectiveness acceptability curve, showing the estimated probability that the intervention is cost-effective as a function of λ. We then regressed, using values of λ ranging from $0 to $100, each individual’s net monetary benefit on several variables selected a priori as potentially relevant, including group assignment, site, JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 4/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness age, sex, presence of psychotic disorder, Multnomah Community Ability Scale score, duration of longest previous episode of homelessness, and number of hospital days in the year before study entry. Linear regression was used in each case. To evaluate how participant characteristics might 19,23 mediate the cost-effectiveness of HF, and in the absence of any strong a priori hypotheses about which characteristics might be relevant, we then tested, one by one, interactions between all these variables and the group assignment variable. Interaction terms with 2-sided P < .10 were retained for a final model with interactions. Fitted models were checked for misspecification by plotting the residuals against the fitted value of the dependent variable as well as continuous covariates. The Rubin rule was used to derive 95% CIs. Statistical analyses were performed using Stata, version 15 (StataCorp). Sensitivity Analyses We tested the robustness of the results to the choice of discount rate by using 0% and 5% instead of 3%. We also checked the effects of adjusting for baseline differences in costs using a regression- based method and performed a 2-way sensitivity analysis on these factors. Results Of 1198 individuals originally randomized (795 [66.4%] male, 390 [32.6%] female, and 13 [1.1%] other; 696 [58.1%] aged 30 to 49 years), 1160 (96.8%) provided usable data for this analysis. eFigure 1 in the Supplement describes the flow of participants into and through the trial and shows the available sample size by group and by site. Table 1 provides descriptive statistics for the sample at baseline. Values for other variables not Table 1. Baseline Characteristics of Participants, Stratified by Randomization Group Study Randomization Group Characteristic HF (n = 689) TAU (n = 509) Age group, y, No. (%) <30 118 (17.1) 91 (17.9) 30-49 398 (57.8) 298 (58.4) ≥50 173 (25.1) 120 (23.6) Sex, No. (%) Women 236 (34.3) 154 (30.3) Men 449 (65.2) 346 (68.0) Other 4 (0.6) 9 (1.8) Alcohol abuse or dependence, No. (%) 296 (43.0) 224 (44.0) Substance abuse or dependence, No. (%) 321 (46.6) 242 (47.5) Alcohol or substance abuse or dependence, No. (%) 424 (61.5) 321 (63.1) Hospitalization history, No. (%) 155 (22.5) 129 (25.3) Arrest history, No. (%) 200 (29.0) 154 (30.3) Longest period homeless, mo Mean (SD) 29.7 (46.4) 28.1 (37.0) Abbreviations: HF, Housing First intervention; IQR, Median (IQR) 12 (6-36) 12 (5-36) interquartile range; MCAS, Multnomah Community Ability Scale; TAU, treatment as usual. MCAS score Mean (SD) 64.7 (6.2) 64.7 (6.2) Evaluated using the Mini International Neuropsychiatric Interview. Median (IQR) 65.0 (63.0-68.0) 65.0 (63.0-68.0) Indicates 2 or more hospitalizations within 1 year Study site, No. (%) during the 5 years before baseline. Montreal, Québec 204 (29.6) 102 (20.0) Indicates 1 or more arrests or incarcerations during Toronto, Ontario 204 (29.6) 174 (34.2) the 6 months before baseline. Winnipeg, Manitoba 181 (26.3) 133 (26.1) Scores range from 17 to 85, with higher values Vancouver, British Columbia 100 (14.5) 100 (19.6) indicating better functioning. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 5/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness used in this analysis have been reported elsewhere. Their mean (SD) longest period of homelessness was 29.0 (42.6) months (median, 12 months [interquartile range, 5-36 months]). Table 2 shows baseline and first- and second-year costs by type of cost for the HF and TAU groups. During the 2-year follow-up period, meaningful cost offsets (mean reductions in costs attributable to the intervention) were observed for shelters (−$2627; 95% CI, −$3232 to −$2079), substance use treatment (−$1148; 95% CI, −$1658 to −$638), supportive housing (−$1861; 95% CI, −$2540 to −$1222), and ambulatory visits (−$2375; 95% CI, −$3226 to −$1523). For other cost categories, the 95% CIs for offsets for other cost categories included zero, or the point estimate was less than $1000. Excluding the intervention cost, the total mean cost offset was −$6629 (95% CI, −$10 199 to −$2969). However, after including the mean cost of the intervention ($14 496, inferred from Table 2), the mean total cost for HF participants exceeded that for TAU by $7868 (95% CI, $4409-$11 405). Thus, 46% of the cost of the intervention was offset. For most services as well as in total, the cost difference was less favorable to HF in the second year than in the first. Table 3 disaggregates costs by site rather than by cost category. The magnitude of the net cost, including the cost of the intervention, ranged from $5218 (95% CI, −$983 to $11 385) per person per year in Montreal to $11 702 (95% CI, $5196-$18 873) per person per year in Toronto. Days with stable housing were higher by 140.34 (95% CI, 128.14-153.31) days in the HF group, with a cost difference of $7867.73 (95% CI, $4408.81-$11 404.79). Thus, the incremental cost- effectiveness ratio was $56.08 (95% CI, $29.55-$84.78) per day of stable housing. eFigure 2 in the Supplement shows 500 bootstrap replicates of mean incremental cost and the corresponding mean incremental number of days of stable housing on the cost-effectiveness plane. All the points lie in the quadrant corresponding to higher effectiveness and higher costs, indicating that taking all sites together, the intervention unambiguously increases days of stable housing and costs. The cost-effectiveness acceptability curve shown in the Figure indicates that if the decision- maker is willing to pay $67 per night of stable housing, there is an 80% chance that HF is cost- effective compared with TAU. If the decision-maker is willing to pay approximately $100 per day of stable housing, then the probability that the intervention is cost-effective increases to 100%. eTable 1 in the Supplement shows the results of net benefit regressions that do not include interactions. As the decision-maker’s willingness to pay for an additional day of stable housing (represented by λ) rises from $0 to $100, the adjusted net benefit of receiving HF is initially negative (net cost of −$8604 per person per year; 95% CI, −$12 027 to −$5181) but increases quickly so that at $100 the net benefit is positive, reaching $5269 (95% CI, $1352-$9186). Only 1 other variable appeared to be associated with a meaningful difference in net benefit: people who had been arrested or incarcerated in the 6 months before baseline had a lower net benefit. Age, sex, alcohol or substance abuse or dependence, and level of functioning were not associated with net benefit, regardless of λ, after adjusting for site and the other factors. Table 4 shows the results of adding interactions between group assignment and the variables identified using the procedure described above. None of the site variables or interactions with site were meaningfully different from zero, suggesting that the cost-effectiveness of HF with ICM did not vary by site. Costs appeared to vary with arrest history; the addition of the interaction terms had little effect on estimated coefficients. A higher level of functioning was associated with a higher net benefit at higher levels of λ: at λ = $100, a (clinically meaningful) 10-point increase in the Multnomah Community Ability Scale score was associated with an increase in net benefit of $6901 (95% CI, $1839-$11 962) per person per year, indicating that a higher level of functioning was associated with more days of stable housing. The results suggest that HF yielded a net benefit lower by approximately $7000 for people who had had 2 or more hospitalizations for mental illness during a 1-year period during the previous 5 years; the amount varied from −$6820 (95% CI, −$12 673 to −$967) at λ = 0 to −$7456 (95% CI, −$14 065 to −$847) at λ = 100. None of the other interaction terms appeared to meaningfully alter costs at any value of λ. Thus, no individual-level baseline JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 6/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Table 2. Mean (Unadjusted) Costs per Person per Year by Time and Cost Category Study Randomization Group, Mean (95% CI), 2016 Can$ Cost Category TAU (n = 483) HF (n = 677) Difference (HF − TAU) Shelters Baseline 9595 (8680 to 10 434) 8915 (8204 to 9650) −679 (−1876 to 425) First year 5476 (4803 to 6184) 2244 (1940 to 2535) −3233 (−4037 to −2537) Second year 2879 (2348 to 3479) 857 (626 to 1084) −2022 (−2625 to −1404) Mean of first and second years 4177 (3684 to 4773) 1550 (1320 to 1762) −2627 (−3232 to −2079) Substance use treatment Baseline 3553 (2580 to 4750) 3320 (2358 to 4335) −233 (−1692 to 1264) First year 2400 (1724 to 3149) 986 (733 to 1279) −1414 (−2190 to −697) Second year 1666 (1130 to 2123) 785 (561 to 1074) −881 (−1377 to −304) Mean of first and second years 2033 (1580 to 2521) 886 (687 to 1105) −1148 (−1658 to −638) Supportive housing Baseline 2476 (1805 to 3195) 3461 (2823 to 4279) 985 (0 to 2073) First year 3353 (2727 to 4097) 1517 (1263 to 1812) −1835 (−2550 to −1137) Second year 2938 (2243 to 3656) 1052 (706 to 1476) −1886 (−2691 to −1081) Mean of first and second years 3145 (2549 to 3769) 1285 (1036 to 1573) −1861 (−2540 to −1222) Ambulatory visits Baseline 14 920 (12 580 to 17 358) 11 629 (10 146 to 13 586) −3291 (−6026 to −450) First year 7572 (6520 to 8663) 4545 (3904 to 5219) −3028 (−4237 to −1653) Second year 5708 (4833 to 6661) 3986 (3423 to 4709) −1722 (−2802 to −587) Mean of first and second years 6640 (5987 to 7435) 4266 (3809 to 4755) −2375 (−3226 to −1523) ED visits Baseline 2207 (1870 to 2590) 2092 (1789 to 2444) −115 (−611 to 377) First year 1862 (1500 to 2261) 1239 (1077 to 1418) −623 (−1055 to −237) Second year 1279 (1033 to 1572) 981 (856 to 1105) −299 (−641 to −22) Mean of first and second years 1571 (1325 to 1876) 1110 (995 to 1238) −461 (−775 to −186) Hospitalizations (physical) Baseline 1621 (624 to 2990) 1567 (612 to 2864) −54 (−1649 to 1688) First year 2493 (1533 to 3669) 2025 (1226 to 2943) −468 (−1906 to 975) Second year 2786 (1443 to 5106) 2421 (1456 to 3546) −365 (−2840 to 1376) Mean of first and second years 2640 (1722 to 4005) 2223 (1586 to 2939) −417 (−2060 to 799) Hospitalizations (psychiatric) Baseline 4285 (2153 to 6554) 4507 (2660 to 6516) 222 (−2776 to 3450) First year 3392 (1876 to 5328) 3670 (2442 to 5334) 278 (−2185 to 2579) Second year 1644 (975 to 2578) 4414 (2714 to 6443) 2770 (904 to 4890) Mean of first and second years 2518 (1600 to 3550) 4042 (2832 to 5700) 1524 (−80 to 3404) Other (eg, helplines, day centers) Baseline 3304 (2933 to 3761) 2986 (2669 to 3311) −317 (−902 to 200) First year 1638 (1442 to 1853) 1117 (980 to 1251) −521 (−786 to −290) Second year 1195 (1048 to 1348) 902 (784 to 1003) −293 (−512 to −109) Mean of first and second years 1417 (1276 to 1574) 1009 (896 to 1114) −407 (−616 to −231) Police contacts and court appearances Baseline 9222 (7571 to 11 062) 7987 (6634 to 9395) −1235 (−3310 to 996) First year 6925 (5300 to 8784) 6572 (5529 to 7720) −352 (−2474 to 1733) Second year 5871 (4600 to 7210) 4996 (4178 to 5994) −875 (−2496 to 679) Mean of first and second years 6398 (5149 to 7782) 5784 (4955 to 6627) −613 (−2247 to 977) Incarcerations Baseline 2084 (1210 to 3108) 2365 (1556 to 3452) 281 (−940 to 1529) First year 1675 (1076 to 2334) 2820 (2125 to 3672) 1146 (210 to 2159) Second year 3064 (2063 to 4192) 3963 (2980 to 5266) 899 (−544 to 2444) Mean of first and second years 2369 (1666 to 3131) 3392 (2642 to 4284) 1022 (−66 to 2198) (continued) JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 7/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Table 2. Mean (Unadjusted) Costs per Person per Year by Time and Cost Category (continued) Study Randomization Group, Mean (95% CI), 2016 Can$ Cost Category TAU (n = 483) HF (n = 677) Difference (HF − TAU) Welfare and disability benefits Baseline 2758 (2588 to 2911) 2869 (2761 to 2991) 111 (−94 to 322) First year 8641 (8233 to 9060) 9154 (8861 to 9489) 512 (−14 to 1053) Second year 9480 (9049 to 9956) 9574 (9298 to 9863) 94 (−449 to 619) Mean of first and second years 9061 (8679 to 9507) 9364 (9095 to 9661) 303 (−175 to 823) Income earned Baseline 343 (243 to 454) 146 (83 to 227) −197 (−329 to −70) First year 1129 (854 to 1399) 517 (395 to 669) −611 (−905 to −330) Second year 1111 (868 to 1375) 863 (671 to 1062) −248 (−579 to 75) Mean of first and second years 1120 (906 to 1360) 690 (553 to 835) −430 (−696 to −141) Total (excluding intervention cost) Baseline 53 015 (48 870 to 56 809) 49 062 (45 971 to 52 654) −3954 (−8843 to 1479) First year 44 299 (41 018 to 47 592) 35 372 (33 159 to 37 857) −8927 (−13 373 to −4895) Second year 37 398 (34 445 to 40 598) 33 068 (30 612 to 36 188) −4330 (−8157 to 53) Mean of first and second years 40 849 (38 374 to 43 538) 34 220 (32 175 to 36 695) −6629 (−10 199 to −2969) Total (including intervention cost) First year 44 299 (41 018 to 47 592) 50 554 (47 801 to 53 221) 6255 (1617 to 10 425) Second year 37 398 (34 445 to 40 598) 46 879 (44 243 to 50 135) 9480 (5772 to 13 888) Mean of first and second years 40 849 (38 374 to 43 538) 48 716 (46 593 to 51 072) 7868 (4409 to 11 405) Abbreviations: ED, emergency department; HF, Housing First; TAU, treatment as usual. This category includes rooms in buildings with on-site support staff and, notably for a Toronto, subsidized rooms in buildings without on-site support staff. Twenty-seven elements (1 per month and 3 before the baseline interview) were included for days of stable housing. Missing rates (addressed using multiple imputation) were 14.8% for the TAU group and 9.4% for the HF group. For costs, 279 elements were included; missing rates were 13.0% and 9.2%, respectively. variable, except possibly hospitalization history, and no site appeared to make HF with ICM more or less cost-effective. Sensitivity analyses shown in eTable 2 in the Supplement indicate that our results are robust to changes in the discount rate and only somewhat sensitive to the adjustment for baseline differences or a combination of both. Adjusting for baseline differences increases the incremental cost- effectiveness ratio from $56.08 to $60.18. Changes in the discount rate have a minimal effect. The largest change is obtained by adjusting for baseline differences, without altering the discount rate: the incremental cost-effectiveness ratio becomes $60.18 (95% CI, $35.27-$86.95). Discussion This cost-effectiveness analysis relies on data from the largest trial of scattered-site HF with ICM for people with mental illness and moderate needs, to our knowledge, conducted to date. The intervention costs a mean of $14 496 per person per year. Cost offsets on a wide range of other services reduced the net cost to $7868, a 46% reduction. An additional day of stable housing cost $56.08. Cost-effectiveness seemed to be about the same regardless of participant characteristics, with the possible exception of hospitalization history. 7,25 In previous reports of the At Home/Chez Soi study, the intervention cost was reported as Can$14 177 per participant annually (in 2011 dollars), and the mean net cost offset was Can $4849, or 34% of the cost of the intervention. Although qualitatively similar, the numerical estimates presented herein differ from the earlier ones for several reasons. Most important, in the present study, we did not adjust for baseline differences in costs, whereas the earlier reports used a relatively simple difference-in-differences method, applied to mean costs per person per site. Second, we allocated JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 8/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness the cost of the intervention to individual study participants. Third, we refined several unit cost calculations compared with the earlier report. Cost-effectiveness analyses, including for the treatment of mental health conditions, often use 19 26 quality-adjusted life-years as an outcome measure, despite their known limitations. In the present report, consistent with the only published cost-effectiveness analysis of a related intervention published to date, we used days of stable housing instead. Hierarchical linear models estimated on the EQ-5D, a common instrument from which to derive quality-adjusted life-years, showed no significant difference between the experimental and TAU groups. This finding is not surprising because HF is in significant measure a social care intervention, with health effects that may only become apparent during a longer period. Qualitative interviews conducted on a 10% sample of Table 3. Total Unadjusted Mean Costs per Person per Year by Site TAU Group HF Group No. of No. of Cost by Site Participants Mean Cost (95% CI), Can$ Participants Mean Cost (95% CI), Can$ Difference, Mean Cost (95% CI) ICM team Montreal NA NA 200 7375 (6679 to 8075) NA Toronto NA NA 200 6825 (5850 to 7914) NA Winnipeg NA NA 177 7613 (6194 to 9148) NA Vancouver NA NA 100 5533 (4199 to 7211) NA Housing team and rent supplements Montreal NA NA 200 7345 (7026 to 7702) NA Toronto NA NA 200 8752 (8248 to 9184) NA Winnipeg NA NA 177 5336 (4903 to 5797) NA Vancouver NA NA 100 9093 (8310 to 9848) NA Total without intervention Montreal 102 41 699 (36 752 to 47 040) 200 32 197 (28 598 to 36 031) −9502 (−16 072 to −3280) Toronto 159 41 108 (36 436 to 45 935) 200 37 234 (33 096 to 41 897) −3875 (−10 353 to 3136) Winnipeg 126 38 961 (34 248 to 43 498) 177 33 987 (30 590 to 37 551) −4975 (−10 365 to 740) Vancouver 96 41 992 (35 752 to 48 308) 100 32 653 (27 222 to 40 155) −9339 (−18 250 to 1008) Total with intervention Montreal 102 41 699 (36 752 to 47 040) 200 46 917 (43 389 to 50 542) 5218 (−983 to 11 385) Toronto 159 41 108 (36 436 to 45 935) 200 52 811 (48 171 to 57 341) 11 702 (5196 to 18 873) Winnipeg 126 38 961 (34 248 to 43 498) 177 46 935 (43 045 to 51 066) 7974 (1985 to 14 335) Vancouver 96 41 992 (35 752 to 48 308) 100 47 279 (41 497 to 55 015) 5287 (−3816 to 15 428) Abbreviations: HF, Housing First; ICM, Intensive Case Management; NA, not applicable; TAU, treatment as usual. Figure. Cost-effectiveness Acceptability Curve 1.0 0.8 0.6 0.4 0.2 The probability that the Housing First (HF) intervention is cost-effective compared with treatment as usual as a function of the value that the 0 50 100 150 200 250 decision-maker attributes to an additional day of Threshold Willingness to Pay, Can$ stable housing. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 9/15 Probability HF is Cost-effective JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 10/15 Table 4. Net Benefit Regression Results Assigning Different Values to an Additional Day of Stable Housing With Interaction Terms Estimated β Coefficient (95% CI), 2016 Can$ c c c c c c Term λ = Can$0 λ = Can$20 λ = Can$40 λ = Can$60 λ = Can$80 λ = Can$100 HF intervention 36 433 (−3860 to 76 726) 39 828 (−1193 to 80 850) 43 223 (1304 to 85 143) 46 618 (3643 to 89 594) 50 013 (5834 to 94 193) 53 409 (7890 to 98 927) Toronto 1088 (−6472 to 8649) 1575 (−6104 to 9254) 2062 (−5770 to 9894) 2548 (−5470 to 10 566) 3035 (−5200 to 11 270) 3522 (−4959 to 12 002) Winnipeg 1798 (−6198 to 9794) 1453 (−6688 to 9595) 1109 (−7215 to 9432) 764 (−7776 to 9304) 419 (−8370 to 9208) 74 (−8993 to 9142) Vancouver 1397 (−7020 to 9813) 620 (−7951 to 9192) −156 (−8920 to 8608) −932 (−9925 to 8061) −1708 (−10 964 to 7548) −2484 (−12 034 to 7065) Aged 30-49 2833 (−4575 to 10 241) 2781 (−4764 to 10 326) 2729 (−4985 to 10 444) 2677 (−5238 to 10 592) 2625 (−5519 to 10 770) 2574 (−5826 to 10 973) Aged ≥50 y 431 (−8243 to 9104) 276 (−8571 to 9124) 122 (−8937 to 9181) −32 (−9339 to 9275) −186 (−9773 to 9400) −341 (−10 237 to 9556) Female −4015 (−7765 to −265) −3818 (−7634 to −1) −3621 (−7520 to 278) −3424 (−7421 to 573) −3226 (−7335 to 882) −3029 (−7263 to 1205) Alcohol or substance 427 (−3477 to 4331) 457 (−3508 to 4423) 488 (−3556 to 4532) 519 (−3619 to 4656) 549 (−3697 to 4795) 580 (−3788 to 4947) abuse or dependence MCAS score/10 4859 (377 to 9341) 5267 (705 to 9830) 5676 (1013 to 10 338) 6084 (1304 to 10 864) 6492 (1579 to 11 405) 6901 (1839 to 11 962) Hospitalization −3730 (−7940 to 479) −3547 (−7834 to 741) −3363 (−7746 to 1021) −3179 (−7676 to 1317) −2996 (−7620 to 1629) −2812 (−7579 to 1956) history Arrest history −9895 (−13 836 to −5954) −10 467 (−14 481 to −6453) −11 038 (−15 143 to −6934) −11 610 (−15 820 to −7399) −12 181 (−16 513 to −7850) −12 753 (−17 219 to −8287) Longest period −13 (−54 to 28) −16 (−58 to 25) −19 (−62 to 23) −22 (−66 to 22) −25 (−70 to 20) −28 (−75 to 18) homeless Interaction terms Toronto × HF −5737 (−15 338 to 3864) −6198 (−15 966 to 3570) −6658 (−16 637 to 3321) −7119 (−17 349 to 3111) −7579 (−18 099 to 2940) −8040 (−18 884 to 2804) Winnipeg × HF −969 (−11 033 to 9095) −1755 (−12 008 to 8498) −2542 (−13 029 to 7946) −3328 (−14 091 to 7435) −4114 (−15 192 to 6964) −4901 (−16 329 to 6528) Vancouver × HF −1612 (−12 640 to 9415) −1218 (−12 457 to 10 021) −824 (−12 325 to 10 677) −429 (−12 239 to 11 380) −35 (−12 196 to 12 126) 359 (−12 192 to 12 911) Age 30-49 × HF 181 (−9395 to 9756) 683 (−9077 to 10 443) 1185 (-8803 to 11 173) 1687 (−8568 to 11 943) 2190 (−8371 to 12 750) 2692 (−8208 to 13 592) Age ≥50 × HF 5640 (−5515 to 16 795) 6454 (−4920 to 17 828) 7268 (−4374 to 18 911) 8082 (−3874 to 20 039) 8896 (−3417 to 21 209) 9710 (−2998 to 22 418) Hospitalization −6820 (−12 673 to −967) −6947 (−12 906 to −989) −7075 (−13 163 to −986) −7202 (−13 443 to −960) −7329 (−13 745 to −914) −7456 (−14 065 to −847) history × HF Constant −69 214 (−100 884 to −69 254 (−101 614 to −69 175 (−100 284 to −69 293 (−102 466 to −69 333 (−103 431 to −69 372 (−104 500 to −37 544) −36 893) −38 065) −36 120) −35 234) −34 244) Abbreviations: HF, Housing First intervention; MCAS, Multnomah Community Ability Scale. Decision-maker’s willingness to pay for an additional day of stable housing. a d Includes 1160 participants. Models estimated with net monetary benefit are not adjusted for baseline Coefficients indicate partial association with a 10-point increase in MCAS score. differences in costs. Dependent variable is (d × λ)–c , where λ is the threshold ratio (in Canadian dollars per e i i Indicates 2 or more hospitalizations for mental illness during a 1-year period within the 5 years before baseline. additional day of stable housing), d is participant i’s annualized number of days of stable housing, and c is the i i Indicates 1 or more arrests or incarcerations during the 6 months before baseline. corresponding total cost. Indicates during lifetime, in months. Reference categories include Montreal site, younger than 30 years, and no alcohol or substance abuse or dependence. JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness study participants showed that participants in the HF group were much more likely to experience positive changes in their life trajectories than those in the TAU group during the 2 years of the study. The only comparable cost-effectiveness analysis in the literature was performed at Veterans Affairs medical centers in 4 US cities using data collected in the early to middle 1990s. The most similar intervention in that study was a less intensive form of case management than herein, with as many as 25 participants per case manager. This intervention was combined with Section 8 vouchers (rent subsidies). Fully half of participants in that study had no psychiatric diagnosis other than alcohol or drug use disorder. The study found that, from a societal perspective, the intervention cost $45 more per additional day of housing, compared with standard care. Adjusting for the effects of 29 30 inflation and using purchasing power parity in 2016 to convert US into Canadian dollars, that amount is equivalent to about Can$79. Our somewhat lower estimate may reflect the greater potential for cost offsets with a group of participants with greater illness. In this trial, careful attention was paid to implementation fidelity. Fidelity was found to be fair to excellent across sites. Other work has reported an association between higher fidelity and 31 32,33 housing stability, quality of life, and community functioning as well as other positive outcomes. Not all HF implementations are as careful to follow the Pathways model as those of the At Home/ Chez Soi trial; for instance, caseloads may be increased or rent supplements may be reduced. Although such changes will reduce the cost of the intervention itself, the magnitude of the cost offsets observed herein may not remain the same. The fact that HF with ICM did not dominate the intervention—that it did not prove more effective and less costly—does not mean that it should not be implemented. Most health and social interventions do not pay for themselves. Rather, they yield benefits judged sufficient to merit their cost. The cost of the intervention itself, which was approximately $40 per participant per day, is well within the range of the costs of many currently funded forms of emergency shelter and supported housing. Allowing for some budgetary reallocations and reflecting the reductions in costs of these and other services in which the delivery of HF with ICM results, the overall budgetary impact of a significant expansion of HF with ICM capacity is likely to be quite reasonable. Our study found little evidence of HF being more or less cost-effective for different subgroups. This finding may be attributable to the fact that clinical teams adjust the nature and intensity of their interventions according to each participant’s needs and preferences. Cost-effectiveness may have been lower for people with more previous hospitalizations for mental illness, possibly because the teams expended more effort on clients more prone to prior hospitalizations but could not sufficiently alter participants’ propensity to be hospitalized more often. Our findings give no ground for any selection of participants on characteristics such as current alcohol or substance abuse or previous justice services involvement. Strengths and Limitations Our study presents several strengths. The sample size was large and drawn from several sites. It evaluated a carefully defined and implemented intervention. Attrition, and in particular differential attrition, was modest. Service use was measured in a much more comprehensive way than is typical in cost-effectiveness studies. Unit costs were carefully estimated. Several limitations need to be noted as well. Service use data were based on participant self- reports. Although these reports are subject to recall biases, the most costly components of costs are based on self-reports gathered at 3-month intervals, which have been shown to have good validity. 35,36 The validity of self-reports in the At Home/Chez Soi study has also been corroborated directly. The costs of medications were not included, owing to the difficulty of obtaining reliable and sufficiently detailed information on medications taken by participants by questionnaire and restrictions on sharing of participant-level administrative data, including on medication use, across provinces. The ICM teams, however, do not typically focus on increasing medication adherence. The follow-up period was 2 years, and we do not know how cost-effectiveness would evolve for a longer JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 11/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness duration. We did not estimate the administrative costs of transfer payments, but because most participants in both groups received social assistance payments, doing so would have had little effect. Conclusions In this large, multiple-site trial, we found that about half of the costs of an HF with ICM intervention were offset by reductions in the costs of shelters, ambulatory visits, emergency department visits, and other services. Even if these cost offsets do not result in reductions in budgetary outlays, they translate into greater availability of resources for others in need. The net cost was modest in relation to current expenditures on individuals who are homeless. Furthermore, we found little evidence of cost-effectiveness varying according to participant characteristics. These results support more widespread implementation of scattered-site HF with ICM programs for homeless people with characteristics comparable to those of the participants included in this trial. ARTICLE INFORMATION Accepted for Publication: June 28, 2019. Published: August 21, 2019. doi:10.1001/jamanetworkopen.2019.9782 Correction: This article was corrected on September 11, 2019, to fix 2 incorrect numbers in eFigure 1 in the Supplement. Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2019 Latimer EA et al. JAMA Network Open. Corresponding Author: Eric A. Latimer, PhD, Perry 3C, Douglas Research Centre, 6875 LaSalle Blvd, Montreal, QC H4H 1R3, Canada (eric.latimer@mcgill.ca). Author Affiliations: Department of Psychiatry, McGill University, Montreal, Quebec, Canada (Latimer); Douglas Research Centre, Montreal, Quebec, Canada (Latimer, Rabouin, Cao); Montreal West Island Integrated University Health and Social Services Centre, Montreal, Quebec, Canada (Ly); Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montreal, Quebec, Canada (Powell, Moodie); Department of Psychiatry, University of Calgary, Calgary, Alberta, Canada (Adair); Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada (Adair); Department of Psychiatry, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba, Canada (Sareen); Faculty of Health Sciences, Simon Fraser University, Vancouver, British Columbia, Canada (Somers); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (Stergiopoulos); Centre for Addiction and Mental Health, University of Toronto, Toronto, Ontario, Canada (Stergiopoulos, Veldhuizen); Department of Family and Community Medicine, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada (Pinto); MAP Centre for Urban Health Solutions, Li Ka Shing Knowledge Institute, St Michael’s Hospital, Toronto, Ontario, Canada (Pinto). Author Contributions: Dr Latimer and Ms Cao had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Concept and design: Latimer, Ly, Adair, Sareen, Somers, Stergiopoulos, Pinto. Acquisition, analysis, or interpretation of data: Latimer, Rabouin, Cao, Powell, Adair, Sareen, Somers, Stergiopoulos, Moodie, Veldhuizen. Drafting of the manuscript: Latimer. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: Latimer, Rabouin, Cao, Powell, Moodie. Obtained funding: Latimer, Sareen, Somers, Stergiopoulos. Administrative, technical, or material support: Latimer, Ly, Adair, Sareen, Somers, Stergiopoulos, Pinto, Veldhuizen. Supervision: Latimer, Adair, Somers, Moodie. Conflict of Interest Disclosures: Dr Adair reported being engaged as a dedicated researcher at the national level for the duration and being paid by the study, not her academic institution, to devote time to the study; her role was the same as the academic researchers on the team and she retained academic freedom in all aspects. Dr Pinto reported support as a clinician scientist by the Department of Family and Community Medicine, Faculty of JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 12/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness Medicine at the University of Toronto, St Michael’s Hospital, and the Li Ka Shing Knowledge Institute, St Michael’s Hospital; support by a fellowship from the Physicians’ Services Incorporated Foundation; and serving as the Associate Director for Clinical Research at the University of Toronto Practice-Based Research Network. No other disclosures were reported. Funding/Support: This study was supported by a financial contribution from Health Canada to the Mental Health Commission of Canada. Role of the Funder/Sponsor: The Mental Health Commission of Canada oversaw the conduct of the study, including ensuring that data collection timelines were met, and helped organize the management of the data set until it was complete. It also provided training and technical support to the service teams and research staff throughout the project. However, the sponsor had no role in the analysis and interpretation of the data and preparation, review, or approval of the manuscript, or in the decision to submit it for publication. Disclaimer: The views expressed herein solely represent those of the authors. Group Members: The following investigators participated in At Home/Chez Soi: National Team: Carol E. Adair, PhD; Tim Aubry, PhD; Paula N. Goering, RN, PhD; Geoffrey Nelson, PhD; Myra Piat, PhD; Sanjeev Sridharan, PhD; David Streiner, PhD; and Sam Tsemberis, PhD. Moncton: Saïd Bergheul, PhD; Jimmy Bourque, PhD; Paul-Émile Bourque, PhD; Pierre-Marcel Desjardins, PhD; Stefanie R. LeBlanc, MA; Danielle Nolin, PhD; Sarah Pakzad, PhD; and John Sylvestre, PhD. Montreal: Jean-Pierre Bonin, PhD; Anne G. Crocker, PhD; Henri Dorvil, PhD; Marie-Josée Fleury, PhD; Roch Hurtubise, PhD; Eric A. Latimer, PhD; Alain Lesage, MD; Christopher McAll, PhD; Catherine Vallée, PhD; and Helen-Maria Vasiliadis, PhD. Toronto: Ahmed M. Bayoumi, MD; Stephen W. Hwang, MD; Bonnie Kirsh, PhD; Maritt Kirst, PhD; Kwame McKenzie, MD; Rosane Nisenbaum, PhD; Patricia O’Campo, PhD; and Vicky Stergiopoulos, MD. Winnipeg: James M. Bolton, MD; Daniel G. Chateau, PhD; Jino Distasio, PhD; Murray W. Enns, MD; Laurence Y. Katz, MD; Patricia J. Martens, PhD; Jitender Sareen, MD; and Mark J. Smith, MSc. Vancouver: James Frankish, PhD; Michael R. Krausz, MD, PhD; Lawrence McCandless, PhD; Akm Moniruzzaman, PhD; Tonia L. Nicholls, PhD; Anita Palepu, MD; Michelle L. Patterson, PhD; Christian G. Schutz, MD, PhD; Julian M. Somers, PhD; Verena Strehlau, MD; and Denise Zabkiewicz, PhD. Additional Contributions: Jayne Barker, PhD (2008-2011), Cameron Keller, MC (2011-2012), and Catharine Hume, MHSc (2012-2014), served as the Mental Health Commission of Canada At Home/Chez Soi National Project Leads. We thank the National Research Team, the 5 site research teams, the site coordinators, and the numerous service and housing providers, as well as persons with lived experience, who contributed to this project and the research. The individuals named above received compensation from the Mental Health Commission of Canada for their role in the study. Paula N. Goering, RN, PhD, was the lead investigator for the At Home/Chez Soi project and as such led the design of the overall study and the process of data collection and contributed to the design of the economic analysis before her death May 26, 2016. Additional Information: The data set, code book and Stata syntax used for analysis are available to other investigators, on certain conditions related to protection of confidentiality and acknowledgment of contributions of those who prepared the data set, as well as with the acceptance of technical support provided at cost. (We judge such technical support essential to correct interpretation and analysis of the data.) Contact the corresponding author for details. REFERENCES 1. Fazel S, Khosla V, Doll H, Geddes J. The prevalence of mental disorders among the homeless in western countries: systematic review and meta-regression analysis. PLoS Med. 2008;5(12):e225. doi:10.1371/journal.pmed. 2. Aubry T, Nelson G, Tsemberis S. Housing First for people with severe mental illness who are homeless: a review of the research and findings from the At Home–Chez Soi demonstration project. Can J Psychiatry. 2015;60(11): 467-474. doi:10.1177/070674371506001102 3. Tsemberis S. Housing First: The Pathways Model to End Homelessness for People with Mental Illness and Addiction Manual. Center City, MN: Hazelden; 2010. 4. Ly A, Latimer E. Housing first impacts on costs and associated cost offsets: a review of the literature. Can J Psychiatry. 2015;60(11):475-487. doi:10.1177/070674371506001103 5. Rosenheck R, Kasprow W, Frisman L, Liu-Mares W. Cost-effectiveness of supported housing for homeless persons with mental illness. Arch Gen Psychiatry. 2003;60(9):940-951. doi:10.1001/archpsyc.60.9.940 6. Goering PN, Streiner DL, Adair C, et al. The At Home/Chez Soi trial protocol: a pragmatic, multi-site, randomised controlled trial of a Housing First intervention for homeless individuals with mental illness in five Canadian cities. BMJ Open. 2011;1(2):e000323. doi:10.1136/bmjopen-2011-000323 JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 13/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness 7. Stergiopoulos V, Hwang SW, Gozdzik A, et al; At Home/Chez Soi Investigators. Effect of scattered-site housing using rent supplements and intensive case management on housing stability among homeless adults with mental illness: a randomized trial. JAMA. 2015;313(9):905-915. doi:10.1001/jama.2015.1163 8. Aubry T, Goering P, Veldhuizen S, et al. A randomized controlled trial in five Canadian cities of the effectiveness of Housing First with assertive community treatment for persons with serious mental illness and a history of homelessness. Psychiatr Serv. 2016;67(3):275-281. doi:10.1176/appi.ps.201400587 9. Husereau D, Drummond M, Petrou S, et al; CHEERS Task Force. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMJ. 2013;346:f1049. doi:10.1136/bmj.f1049 10. Dickerson FB, Origoni AE, Pater A, Friedman BK, Kordonski WM. An expanded version of the Multnomah Community Ability Scale: anchors and interview probes for the assessment of adults with serious mental illness. Community Ment Health J. 2003;39(2):131-137. doi:10.1023/A:1022610620391 11. Frane JW. A method of biased coin randomization, its implementation, and its validation. Drug Inf J. 1998;32: 423-432. doi:10.1177/009286159803200213 12. Macnaughton E, Stefancic A, Nelson G, et al. Implementing Housing First across sites and over time: later fidelity and implementation evaluation of a pan-Canadian multi-site Housing First program for homeless people with mental illness. Am J Community Psychol. 2015;55(3-4):279-291. doi:10.1007/s10464-015-9709-z 13. Latimer E, Rabouin D, Cao Z, et al; At Home/Chez Soi Investigators. The costs of usual services for homeless people with mental illness in five Canadian cities: results from a large prospective follow-up study. Canadian Medical Association Journal Open. 2017;5(3):E576-E85. 14. Lecrubier Y, Weiller E, Amorim P, Bonora I, Sheehan KH, Janavs J. The Mini International Neuropsychiatric Interview (MINI): a short diagnostic structured interview: reliability and validity according to the CIDI. Eur Psychiatry. 1997;12(5):224-231. doi:10.1016/S0924-9338(97)83296-8 15. Frisman L, Rosenheck R. How transfer payments are treated in cost-effectiveness and cost-benefit analyses. Adm Policy Ment Health. 1996;23(6):533-546. doi:10.1007/BF02108689 16. Weisbrod BA, Test MA, Stein LI. Alternative to mental hospital treatment, II: economic benefit-cost analysis. Arch Gen Psychiatry. 1980;37(4):400-405. doi:10.1001/archpsyc.1980.01780170042004 17. Salkever D. Social costs of expanding access to evidence-based supported employment: concepts and interpretive review of evidence. Psychiatr Serv. 2013;64(2):111-119. doi:10.1176/appi.ps.201100499 18. Meltzer D. Accounting for future costs in medical cost-effectiveness analysis. J Health Econ. 1997;16(1):33-64. doi:10.1016/S0167-6296(96)00507-3 19. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. 4th ed. Oxford, UK: Oxford University Press; 2015. 20. Statistics Canada. Consumer Price Index, monthly, not seasonally adjusted. Table 326-0020. http://www5. statcan.gc.ca/cansim/a26?lang=eng&retrLang=eng&id=3260020&&pattern=&stByVal=1&p1=1&p2=37& tabMode=dataTable&csid=#customizeTab. Modified July 14, 2019. Accessed November 17, 2016. 21. Azur MJ, Stuart EA, Frangakis C, Leaf PJ. Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res. 2011;20(1):40-49. doi:10.1002/mpr.329 22. Shao J, Sitter RR. Bootstrap for imputed survey data. J Am Stat Assoc. 1996;91(435):1278-1288. doi:10.1080/ 01621459.1996.10476997 23. Hoch JS, Briggs AH, Willan AR. Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002;11(5): 415-430. doi:10.1002/hec.678 24. van Asselt AD, van Mastrigt GA, Dirksen CD, Arntz A, Severens JL, Kessels AG. How to deal with cost differences at baseline. Pharmacoeconomics. 2009;27(6):519-528. doi:10.2165/00019053-200927060-00007 25. Goering P, Veldhuizen S, Watson A, et al. National At Home/Chez Soi Final Report. Calgary, AB: Mental Health Commission of Canada; 2014. 26. Nord E, Daniels N, Kamlet M. QALYs: some challenges. Value Health. 2009;12(1)(suppl 1):S10-S15. doi:10.1111/j. 1524-4733.2009.00516.x 27. Euroqol Group. EQ-5D. https://euroqol.org/. Accessed January 5, 2018. 28. Nelson G, Patterson M, Kirst M, et al. Life changes among homeless persons with mental illness: a longitudinal study of housing first and usual treatment. Psychiatr Serv. 2015;66(6):592-597. doi:10.1176/appi.ps.201400201 29. Bureau of Labor Statistics. Databases, Tables & Calculators by Subject: CPI Inflation Calculator. https://www.bls. gov/data/inflation_calculator.htm. Accessed November 17, 2016. JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 14/15 JAMA Network Open | Psychiatry Housing First Intervention With Intensive Case Management for Homeless Adults With Mental Illness 30. Statistics Canada. Purchasing power parities, 2016. https://www150.statcan.gc.ca/n1/daily-quotidien/180424/ dq180424b-eng.htm. Posted April 24, 2018. Accessed July 9, 2018. 31. Goering P, Veldhuizen S, Nelson GB, et al. Further validation of the pathways Housing First Fidelity Scale. Psychiatr Serv. 2016;67(1):111-114. doi:10.1176/appi.ps.201400359 32. Davidson C, Neighbors C, Hall G, et al. Association of Housing First implementation and key outcomes among homeless persons with problematic substance use. Psychiatr Serv. 2014;65(11):1318-1324. doi:10.1176/appi.ps. 33. Gilmer TP, Stefancic A, Henwood BF, Ettner SL. Fidelity to the Housing First model and variation in health service use within permanent supportive housing. Psychiatr Serv. 2015;66(12):1283-1289. doi:10.1176/appi.ps. 34. Bhandari A, Wagner T. Self-reported utilization of health care services: improving measurement and accuracy. Med Care Res Rev. 2006;63(2):217-235. doi:10.1177/1077558705285298 35. Somers JM, Moniruzzaman A, Currie L, Rezansoff SN, Russolillo A, Parpouchi M. Accuracy of reported service use in a cohort of people who are chronically homeless and seriously mentally ill. BMC Psychiatry. 2016;16:41. doi:10.1186/s12888-016-0758-0 36. Lemieux AJ, Roy L, Martin MS, Latimer EA, Crocker AG. Justice involvement among homeless individuals with mental illnesses: are self-report and administrative measures comparable? Eval Program Plann.2017;61 (April):86-95. doi:10.1016/j.evalprogplan.2016.12.007 SUPPLEMENT. eFigure 1. Flowchart Showing Selection of Study Participants eFigure 2. Bootstrap Replicates on the Cost-effectiveness Plane eTable 1. Net Benefit Regression Results, Assigning Different Values to an Additional Day of Stable Housing Without Interaction Terms eTable 2. Two-Way Sensitivity Analysis: ICER and 95% CI as a Function of Discount Rate and Whether an Adjustment Is Made for Baseline Differences JAMA Network Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 (Reprinted) August 21, 2019 15/15 Supplementary Online Content Latimer EA, Rabouin D, Cao Z, et al; At Home/Chez Soi Investigators. Cost-effectiveness of Housing First intervention with Intensive Case Management compared with treatment as usual for homeless adults with mental illness: secondary analysis of a randomized clinical trial. JAMA Netw Open. 2019;2(8):e199782. doi:10.1001/jamanetworkopen.2019.9782 eFigure 1. Flowchart Showing Selection of Study Participants eFigure 2. Bootstrap Replicates on the Cost-effectiveness Plane eTable 1. Net Benefit Regression Results, Assigning Different Values to an Additional Day of Stable Housing Without Interaction Terms eTable 2. Two-Way Sensitivity Analysis: ICER and 95% CI as a Function of Discount Rate and Whether an Adjustment Is Made for Baseline Differences This supplementary material has been provided by the authors to give readers additional information about their work. © 2019 Latimer EA et al. JAMA Network Open eFigure 1. Flowchart Showing Selection of Study Participants Assessed for eligibility (n=2866) Excluded (n=611) Did not meet inclusion criteria (n=464) Declined to participate (n=107) Eligible, but study arm full (n=37) Incomplete baseline (n=3) Eligible for ACT (n=950) Eligible (n=2255) *described elsewhere Need level determined Eligible for ICM (n=1198) Allocation Allocated to TAU (n=509) Allocated to intervention (n= 689) Follow-Up Withdrew consent (discontinued usual Withdrew consent (discontinued care) (n=4) intervention) (n=4) Analysis Excluded due to missing all Health, Social Excluded due to missing all Health, Social and Justice Service Use data or all and Justice Service Use data or all Residential Time-Line Follow-Back data Residential Time-Line Follow-Back data (n=22) (n=8) Analysed (n=483) Analysed (n=677) Montreal=102 Montreal =200 Toronto=159 Toronto=200 Winnipeg=126 Winnipeg=177 Vancouver=96 Vancouver=100 Abbreviations: ACT, Assertive Community Treatment; ICM, Intensive Case Management; TAU, Treatment as usual. The number of participants assessed for eligibility is an estimate as some sites employed pre-screening and did not document those who were excluded through this process. © 2019 Latimer EA et al. JAMA Network Open eFigure 2. Bootstrap Replicates on the Cost-effectiveness Plane The original number of days stably housed and the total cost for each Housing First and Treatment as Usual participant are used to calculate the difference in average number of days stably housed between the Housing First and Treatment as Usual groups (Housing First minus Treatment as Usual), and the difference in average total costs. These two differences can be plotted on the cost-effectiveness plane; their ratio is the incremental cost-effectiveness ratio. To assess the variability in that ratio, 500 bootstrap samples are drawn. (A bootstrap sample is randomly drawn with replacement from the original set of cost-effect pairs, so that it has the same number of experimental and control group cost-effect pairs as in the original sample.) For each bootstrap sample, the difference in days stably housed and in total costs is computed and plotted. The cost-effectiveness acceptability curve (Figure 1) can then be derived from this figure. © 2019 Latimer EA et al. JAMA Network Open a b eTable 1. Net Benefit Regression Results, Assigning Different Values to an Additional Day of Stable Housing Without Interaction Terms =$0 b 95% C.I. b 95% C.I. b 95% C.I. HF -8,604 -12,027 -5,181 -5,830 -9,321 -2,338 -3,055 -6,631 522 Toronto -2,361 -7,085 2,363 -2,174 -6,977 2,629 -1,987 -6,891 2,916 Winnipeg 1,198 -3,793 6,189 375 -4,705 5,454 -449 -5,640 4,743 Vancouver 242 -5,332 5,815 -382 -6,068 5,304 -1,006 -6,829 4,816 Age 30-49 2,941 -1,877 7,759 3,158 -1,743 8,059 3,374 -1,631 8,380 Age 50+ 3,996 -1,655 9,647 4,304 -1,454 10,062 4,612 -1,278 10,502 Female -3,871 -7,617 -124 -3,682 -7,495 132 -3,492 -7,389 405 Alcohol or Substance abuse or dependence 647 -3,265 4,559 685 -3,290 4,659 722 -3,331 4,776 MCAS score/10 918 -1,910 3,746 1,260 -1,622 4,142 1,602 -1,346 4,550 Hospitalization history -3,639 -7,843 565 -3,447 -7,730 836 -3,255 -7,635 1,125 Arrest history -9,748 -13,678 -5,818 -10,334 -14,338 -6,330 -10,920 -15,015 -6,824 Longest period homeless -12 -53 29 -15 -57 27 -18 -61 25 Constant -43,338 -63,403 -23,273 -43,024 -63,470 -22,578 -42,709 -63,624 -21,795 HF -280 -3,957 3,396 2,494 -1,296 6,285 5,269 1,352 9,186 Toronto -1,801 -6,824 3,223 -1,614 -6,776 3,549 -1,427 -6,745 3,891 Winnipeg -1,272 -6,597 4,053 -2,095 -7,573 3,383 -2,918 -8,567 2,731 Vancouver -1,630 -7,612 4,352 -2,254 -8,416 3,909 -2,877 -9,239 3,484 Age 30-49 3,591 -1,539 8,721 3,807 -1,466 9,081 4,024 -1,411 9,459 Age 50+ 4,919 -1,126 10,965 5,227 -995 11,449 5,535 -884 11,953 Female -3,303 -7,299 693 -3,114 -7,222 995 -2,924 -7,159 1,310 Alcohol or Substance abuse or dependence 760 -3,389 4,909 798 -3,460 5,056 835 -3,545 5,216 MCAS score/10 1,944 -1,081 4,969 2,286 -827 5,400 2,629 -583 5,840 Hospitalization history -3,063 -7,557 1,431 -2,871 -7,495 1,752 -2,679 -7,446 2,088 Arrest history -11,506 -15,708 -7,303 -12,092 -16,416 -7,767 -12,678 -17,138 -8,217 Longest period homeless -21 -65 23 -24 -69 21 -27 -73 20 Constant -42,395 -63,861 -20,930 -42,081 -64,173 -19,989 -41,767 -64,554 -18,979 © 2019 Latimer EA et al. JAMA Network Open Abbreviations: C.I., confidence interval; MCAS, Multnomah Community Ability Scale. a b Notes: N=1160; data are given in 2016 Canadian dollars; Models estimated with net monetary benefit not adjusted for baseline differences in costs dependent variable is (d ) c , where d is participant of days stably housed and c the corresponding total cost; Decision- i i i i d e f stably housed; Montreal is the reference category; Age less than 30 is the reference category; No alcohol or substance abuse or dependence is the reference category; g h Coefficients indicate partial association with a 10-point increase in MCAS score; 2 or more hospitalizations for mental illness over a one-year period during the five years i j before baseline; one or more arrests or incarcerations in the 6 months before baseline; Over lifetime, in months. © 2019 Latimer EA et al. JAMA Network Open eTable 2. Two-Way Sensitivity Analysis: ICER and 95% CI as a Function of Discount Rate and Whether an Adjustment is Made for Baseline Differences Discount rate 0% 3% 5% No adjustment for baseline $55.84 (30.25, 84.59) $56.08 (29.55, 84.78) $55.41 (29.95, 84.09) differences Adjustment for baseline $59.67 (34.61, 87.08) $60.18 (35.27, 86.95) $59.27 (34.36, 85.88) differences © 2019 Latimer EA et al. JAMA Network Open

Journal

JAMA Network Open – American Medical Association

Published: Aug 21, 2019

There are no references for this article.