Observational Coding Training Methods for CBT Treatment Fidelity: A Systematic Review

Observational Coding Training Methods for CBT Treatment Fidelity: A Systematic Review Observational coding is the gold standard for coding treatment fidelity in Cognitive Behavioral Therapy (CBT). This method allows researchers to objectively assess therapist behaviors to determine if CBT was delivered as intended. However, there is no standard method or protocol that ensures reliability within and between research groups, compromising comparability between studies. The aim of this study was to evaluate procedures used to train raters to quantify CBT fidelity. A systematic review was conducted. PsycINFO and Web of Science databases were reviewed for articles up until July 2015; the parameters of the search included CBT, depression, treatment fidelity, and coding/rating. A total of 521 articles were screened for inclusion, which yielded 81 articles. Data was extracted across four categories (study characteristics, training process, inter-rater reliability, and rating), and 62 codes. The results revealed variability in training approaches (e.g., 25.9% of articles reported 10–50 h of training). Very little information was provided about the training process (i.e. only one study specified training duration). Training materials were: manuals (21.0%), videos (18.5%), audiotapes (2.4%), readings (1.2%), and lectures (1.2%). Almost all (90.1%) studies did not describe the trainer, and 28.4% did not describe raters. The relation between CBT fidelity and clinical outcomes is equivocal, perhaps because intra-team and inter-team reliability is difficult to achieve. This systematic review revealed variability in training others to rate CBT fidelity, of which some approaches might inform the field for future use. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Cognitive Therapy and Research Springer Journals

Observational Coding Training Methods for CBT Treatment Fidelity: A Systematic Review

Download PDF
11 pages
Read Article

Loading next page...
 
/lp/springer_journal/observational-coding-training-methods-for-cbt-treatment-fidelity-a-kbm0tycgXc
Publisher
Springer Journals
Copyright
Copyright © 2018 by Springer Science+Business Media, LLC, part of Springer Nature
Subject
Medicine & Public Health; Quality of Life Research; Clinical Psychology; Cognitive Psychology
ISSN
0147-5916
eISSN
1573-2819
DOI
10.1007/s10608-018-9898-5
Publisher site
See Article on Publisher Site

Abstract

Observational coding is the gold standard for coding treatment fidelity in Cognitive Behavioral Therapy (CBT). This method allows researchers to objectively assess therapist behaviors to determine if CBT was delivered as intended. However, there is no standard method or protocol that ensures reliability within and between research groups, compromising comparability between studies. The aim of this study was to evaluate procedures used to train raters to quantify CBT fidelity. A systematic review was conducted. PsycINFO and Web of Science databases were reviewed for articles up until July 2015; the parameters of the search included CBT, depression, treatment fidelity, and coding/rating. A total of 521 articles were screened for inclusion, which yielded 81 articles. Data was extracted across four categories (study characteristics, training process, inter-rater reliability, and rating), and 62 codes. The results revealed variability in training approaches (e.g., 25.9% of articles reported 10–50 h of training). Very little information was provided about the training process (i.e. only one study specified training duration). Training materials were: manuals (21.0%), videos (18.5%), audiotapes (2.4%), readings (1.2%), and lectures (1.2%). Almost all (90.1%) studies did not describe the trainer, and 28.4% did not describe raters. The relation between CBT fidelity and clinical outcomes is equivocal, perhaps because intra-team and inter-team reliability is difficult to achieve. This systematic review revealed variability in training others to rate CBT fidelity, of which some approaches might inform the field for future use.

Journal

Cognitive Therapy and Research – Springer Journals

Published: Feb 22, 2018

References

  • Handbook of infant development
    Bakeman, R; Gottman, JM
  • Handbook of psychotherapy and behavior change
    Baldwin, SA; Imel, ZE
  • Cognitive behavior therapy: Basics and beyond
    Beck, JS
  • The revised cognitive therapy scale (CTS-R): Psychometric properties
    Blackburn, I-M; James, IA; Milne, DL; Baker, C; Standart, S; Garland, A; Reichelt, FK
  • The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials
    Borrelli, B
  • Therapist adherence in individual cognitive-behavioral therapy for binge-eating disorder: Assessment, course, and predictors
    Brauhardt, A; Zwaan, M; Herpertz, S; Zipfel, S; Svaldi, J; Friederich, H-C; Hilbert, A
  • The process of rater training for observational instruments: Implications for interrater reliability
    Castorr, AH; Thompson, KO; Ryan, JW; Phillips, CY; Prescott, PA; Soeken, KL
  • Reliability in coding social interaction: A study of confirmation
    Cissna, KN; Garvin, BJ; Kennedy, CW
  • Easier said than done: What parents say they do and what they do during children’s immunizations
    Cohen, LL; Manimala, R; Blount, RL
  • Using behavior change frameworks to improve healthcare worker influenza vaccination rates: A systematic review
    Corace, KM; Srigley, JA; Hargadon, DP; Yu, D; MacDonald, TK; Fabrigar, LR; Garber, GE
  • Psychosocial treatments for cocaine dependence: National Institute on Drug Abuse collaborative cocaine treatment study
    Crits-Christoph, P; Siqueland, L; Blaine, J; Frank, A; Luborsky, L; Onken, LS; Gastfriend, DR
  • Cognitive-behavioral therapies: Achievements and challenges
    Gaudiano, BA
  • Cognitive–behavioral treatment for depression: Relapse prevention
    Gortner, ET; Gollan, JK; Dobson, KS; Jacobson, NS
  • Reliability of coding affective communication in family therapy sessions: Problems of measurement and interpretation
    Guttman, HA; Spector, RM; Sigal, JJ; Rakoff, V; Epstein, NB
  • Computing inter-rater reliability for observational data: An overview and tutorial
    Hallgren, KA
  • Reliability and validity of the severity of illness index
    Horn, SD; Horn, RA
  • Reliability in coding open-ended data: Lessons learned from HIV behavioral research
    Hruschka, DJ; Schwartz, D; John, DCS; Picone-Decaro, E; Jenkins, RA; Carey, JW
  • A component analysis of cognitive-behavioral treatment for depression
    Jacobson, NS; Dobson, KS; Truax, PA; Addis, ME; Koerner, K; Gollan, JK; Prince, SE
  • Therapist competence in cognitive-behavioural therapies: Review of the contemporary empirical evidence
    Kazantzis, N
  • A model and guide for evaluating supervision outcomes in cognitive–behavioral therapy-focused training programs
    Lewis, CC; Scott, KE; Hendricks, KE
  • Nurse-led psychological interventions to improve diabetes control: Assessing competencies
    Maissi, E; Ridge, K; Treasure, J; Chalder, T; Roche, S; Bartlett, J; Ismail, K
  • Treatment of depressive symptoms in human immunodeficiency virus-positive patients
    Markowitz, JC; Kocsis, JH; Fishman, B; Spielman, LA; Jacobsberg, LB; Frances, AJ; Perry, SW
  • The therapy process observational coding system-alliance scale: Measure characteristics and prediction of outcome in usual clinical practice
    McLeod, BD; Weisz, JR
  • An investigation of the accuracy of therapists’ self-assessment of cognitive-behaviour therapy skills
    McManus, F; Rakovshik, S; Kennerley, H; Fennell, M; Westbrook, D
  • A systematic review of methods for assessing competence in cognitive–behavioural therapy
    Muse, K; McManus, F
  • Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors
    Perepletchikova, F; Treat, TA; Kazdin, AE
  • Assessing treatment integrity in acceptance and commitment therapy: Strategies and suggestions
    Plumb, JC; Vilardaga, R
  • Cognitive Behavioral Therapy competency: Pilot data from a comparison of multiple perspectives
    Rozek, DC; Serrano, JL; Marriott, B; Hickman, LB; Lewis, CC; Brothers, BM; Simons, AD
  • Coding system of therapeutic focus on action and insight
    Samoilov, A; Goldfried, MR; Shapiro, DA
  • Development of an audiotape review system for supporting adherence to an evidence-based treatment
    Sheidow, AJ; Donohue, BC; Hill, HH; Henggeler, SW; Ford, JD
  • Training and dissemination of cognitive behavior therapy for depression in adults: A preliminary examination of therapist competence and client outcomes
    Simons, AD; Padesky, CA; Montemarano, J; Lewis, CC; Murakami, J; Lamb, K; Beck, AT
  • Wanted: Reliable and valid measures for the science of cognitive behavioral therapy dissemination and implementation
    Simons, AD; Rozek, DC; Serrano, JL
  • The process of change in cognitive therapy for depression: Predictors of early inter-session symptom gains
    Strunk, DR; Brotman, MA; DeRubeis, RJ
  • The Cognitive Therapy Scale: Psychometric properties
    Vallis, TM; Shaw, BF; Dobson, KS
  • Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
    Waltz, J; Addis, ME; Koerner, K; Jacobson, NS
  • Therapist adherence/competence and treatment outcome: A meta-analytic review
    Webb, CA; DeRubeis, RJ; Barber, JP
  • Assessment of adherence and competence in cognitive therapy: Comparing session segments with entire sessions
    Weck, F; Bohn, C; Ginzburg, DM; Stangier, U
  • Reliability of adherence and competence assessment in cognitive behavioral therapy: Influence of clinical experience
    Weck, F; Hilling, C; Schermelleh-Engel, K; Rudari, V; Stangier, U

You’re reading a free preview. Subscribe to read the entire article.

Try 2 weeks free now

DeepDyve is your
personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

Enjoy affordable access to
over 18 million articles from more than
15,000 peer-reviewed journals.

All for just $49/month

Explore the DeepDyve Library

or browse the journals available

Search

Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly

Organize

Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place.

Access

Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals.

Your journals are on DeepDyve

Read from thousands of the leading scholarly journals from SpringerNature, Wiley-Blackwell, Oxford University Press and more.

All the latest content is available, no embargo periods.

See the journals in your area

DeepDyve

Freelancer

DeepDyve

Pro

Price

FREE

$49/month
$360/year

Save searches from
Google Scholar,
PubMed

Create folders to
organize your research

Export folders, citations

Read DeepDyve articles

Abstract access only

Unlimited access to over
18 million full-text articles

Print

20 pages / month

Sign up
for free
Start 14 day
Free Trial