Cultivating Evidence-Based Clinical Reasoning and Action in Youth Mental Health Care: The Reaching Families Multisite Randomized TrialChorpita, Bruce F.; Becker, Kimberly D.; Park, Alayna L.; Lakind, Davielle; Guan, Karen; Boustani, Maya M.; Boyd, Meredith R.; Chu, Wendy; Wu, Eleanor G.; Knudsen, Kendra S.
doi: 10.1037/ccp0000939pmid: 39913484
Objective: Despite decades of policy emphasizing the role of evidence in guiding services, few studies have sought to improve the degree to which evidence is used in supervision and treatment. This study reports supervisor and therapist outcomes from the Reaching Families multisite cluster-randomized controlled trial, which tested the effects of a coordinated knowledge system (CKS) against practice guidelines (PG) on the use of evidence in supervision and treatment targeting low treatment engagement in publicly funded youth community mental health organizations located in two geographically distinct, underresourced communities where service inequities are common. Method: The sample included 121 mental health professionals (92.6% female; 81.0% Black, Indigenous, and people of color1) randomly assigned to a CKS or PG control condition. We recorded, transcribed, and coded 430 supervision and 208 treatment sessions involving 221 youth (Mage = 13.1 years, 46.2% female; 78.7% Black, Indigenous, and people of color) and/or their caregivers who reported engagement concerns during therapy. Results: CKS dyads showed uniformly greater use of evidence focused on specific client needs relative to dyads in the PG condition, with large effect sizes and no differences in the effect of condition across the sites. Secondary analyses showed that tools in the CKS condition were perceived significantly more positively than those in the PG condition in terms of effort and effectiveness, and supervisory workload was the same across both conditions. Conclusions: In routine clinical care delivered within highly representative community settings, a strategically designed knowledge resource can improve evidence-based reasoning and action and be perceived as easy to use and useful without negatively impacting workload.
Efficacy of Facilitative Interpersonal and Relational Skills Training for Teletherapy: A Randomized Controlled TrialLin, Tao; Anderson, Timothy; Antebi-Lerman, Eva; Bate, Jordan; Aafjes-van Doorn, Katie
doi: 10.1037/ccp0000934pmid: 39760736
Objective: Therapists report a lack of confidence and competence in teletherapy compared to in-person therapy. Training focusing on teletherapy skills is scarce. This study reports on (a) the development of a training workshop for facilitative interpersonal skills (FIS) in teletherapy (tele-FIRST) and (b) a randomized controlled trial assessing the efficacy of tele-FIRST. Tele-FIRST is a 2-hr online synchronous training workshop that incorporates didactics, deliberate practice, simulation of teletherapy challenges, modeling, and discussion. Method: A set of tele-FIS stimulus clips that depict four types of teletherapy challenges (e.g., emotional disconnection, distraction) was used to evaluate and train therapists’ teletherapy skills. A total of 182 licensed therapists and trainees were randomized into either the tele-FIRST or a waitlist group. Of these, 153 participants completed baseline assessment and were included in the final analyses (tele-FIRST: n = 82; waitlist: n = 71). At baseline, posttraining, and follow-up, participants were assessed on their observer-rated FIS for teletherapy, self-reported FIS, teletherapy skills, acceptance of teletherapy, and self-efficacy. Results: Therapists demonstrated increased teletherapy skills following the tele-FIRST workshop. After controlling for baseline scores, the tele-FIRST group demonstrated significantly higher observer-rated tele-FIS (ηp2 = .134), self-reported FIS (ηp2 = .106), teletherapy skills (ηp2 = .037), acceptance of teletherapy technology (ηp2 = .082), and self-efficacy (ηp2 = .036) compared to the waitlist group at posttraining. Conclusion: The tele-FIRST demonstrated significant short-term effects on enhancing therapists’ teletherapy skills as rated by both independent observers and therapists themselves. Tele-FIRST may improve the quality of teletherapy, though more research is needed to investigate its long-term effects.
Association of Machine-Learning-Rated Supportive Counseling Skills With Psychotherapy OutcomeZhang, Xinyao; Goldberg, Simon B.; Baldwin, Scott A.; Tanana, Michael J.; Weitzman, Lauren M.; Narayanan, Shrikanth S.; Atkins, David C.; Imel, Zac E.
doi: 10.1037/ccp0000935pmid: 39913486
Objective: This study applied a machine-learning-based skill assessment system to investigate the association between supportive counseling skills (empathy, open questions, and reflections) and treatment outcomes. We hypothesized that higher empathy and higher use of open questions and reflections would be associated with greater symptom reduction. Method: We used a data set with 2,974 sessions, 610 clients, and 48 therapists collected from a university counseling center, which included 845,953 rated therapist statements. Client outcome was routinely monitored by the Counseling Center Assessment of Psychological Symptoms Instruments. Therapists’ skills were measured via computer by a bidirectional-long-short-term-memory-based system that rated use of supportive counseling skills. We used multilevel modeling to separate the between-therapist and the within-therapist associations of the skills and outcome. Results: Use of open questions and reflections was associated with client symptom reduction between therapists but not within therapists. We did not find significant associations between therapist empathy and client symptom reduction but found that empathy was negatively associated with clients’ baseline symptom level within therapists. Conclusions: Therapist exploration of clients’ experience and expression of understanding may be important skills that are associated with clients’ better outcomes. This study highlights the importance of support counseling skills, as well as the potential of machine-learning-based measures in psychotherapy research. We discuss the limitations of the study, including the limitations related to the speaker recognition system and potential reasons for the lack of association between empathy and client outcome.
A Theoretically Based Experimental Manipulation of the Processing of Sudden Gains: Considering Reasons, Meaning, and Opportunities to Leverage the GainShalom, Jonathan G.; Strauss, Asher Y.; Huppert, Jonathan D.; Andersson, Gerhard; Aderka, Idan M.
doi: 10.1037/ccp0000941pmid: 39913487
Objective: Sudden gains in psychotherapy have been found to predict outcome, but the conditions under which this occurs remain understudied. In the present study, we experimentally examined the effects of processing sudden gains on treatment outcome. Method: As part of a large randomized controlled trial of internet-delivered cognitive behavior therapy for social anxiety disorder (n = 182), we experimentally manipulated therapists’ responses to sudden gains. Specifically, we randomized individuals who experienced a sudden gain (n = 52) to either receive (n = 26) or not receive (n = 26) processing of the gain. Results: We found that processed sudden gains were significantly less likely to be reversed compared to unprocessed sudden gains. We also found that individuals with processed sudden gains had lower symptom levels at posttreatment/follow-up compared to individuals with unprocessed sudden gains (Mdifference = 15.65, SE = 5.87, p = .023, Cohen’s d = 0.84; Mdifference = 16.68, SE = 6.36, p = .026, Cohen’s d = 1.05; respectively). In addition, individuals with unprocessed sudden gains did not have significantly different symptom levels at posttreatment/follow-up compared to individuals who did not experience a sudden gain during treatment. Conclusions: Our findings suggest that in internet-delivered cognitive behavior therapy for social anxiety disorder, the processing of sudden gains (rather than the gains themselves) leads to upward spirals of improvement that affect long-term outcomes. Replication of these findings in additional studies is needed, and, if replicated, such findings could provide the basis for adding processing of sudden gains to existing therapeutic protocols.