Psychological Assessment

Pangallo, Antonio; Zibarras, Lara; Lewis, Rachel; Flaxman, Paul

doi: 10.1037/pas0000024pmid: 25222438

This systematic review presents findings from a conceptual and methodological review of resilience measures using an interactionist theoretical framework. The review is also intended to update findings from previous systematic reviews. Two databases (EBSCOHost and Scopus) were searched to retrieve empirical studies published up until 2013, with no lower time limit. All articles had to meet specific inclusion criteria, which resulted in 17 resilience measures selected for full review. Measures were conceptually evaluated against an interactionist framework and methodologically reviewed using Skinner’s (1981) validity evidence framework. We conclude that inconsistencies associated with the definition and operationalization of resilience warrant further conceptual development to explain resilience as a dynamic and interactive phenomenon. In particular, measures of resilience may benefit from a greater focus on within-person variance typically associated with behavioral consistency across situations. The use of alternative measurement modalities to self-report scales, such as situational judgment tests, is proposed as a way of advancing knowledge in this area.

Pendergast, Laura L.; Youngstrom, Eric A.; Brown, Christopher; Jensen, Dane; Abramson, Lyn Y.; Alloy, Lauren B.

doi: 10.1037/pas0000020pmid: 25222430

In the United States, Black and White individuals show discrepant rates of diagnosis of bipolar disorder versus schizophrenia and antisocial personality disorder, as well as disparate access to and utilization of treatment for these disorders (e.g., Alegria, Chatterji, et al., 2008; Chrishon, Anderson, Arora, & Bailey, 2012). Such diagnostic discrepancies might stem from racially related cognitive biases in clinical judgment or from racial biases in measurements of bipolar disorder. The General Behavior Inventory (GBI) is among the most well-validated and widely used measures of bipolar mood symptoms, but the psychometric properties of the GBI have been examined primarily in predominantly White samples. In this study, we used multigroup confirmatory factor analyses (CFA) to examine the invariance of GBI scores across racial groups with a nonclinical sample. Fit was acceptable for tests of configural invariance, equal factor loadings, and equal intercepts, but not invariance of residuals. Findings indicate that GBI scores provide functionally invariant measurement of mood symptoms in both Black and White samples. The use of GBI scores may contribute consistent information to clinical assessments and could potentially reduce diagnostic discrepancies and associated differences in access to and utilization of mental health services.

Washburn, Jason J.; Potthoff, Lauren M.; Juzwin, K. R.; Styer, Denise M.

doi: 10.1037/pas0000021pmid: 25265415

The entry for nonsuicidal self-injury (NSI) disorder in the 5th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM–5) provides a criterion-based definition of clinically relevant NSI. NSI disorder is currently classified in the DSM–5 as a condition requiring further study. The present study aimed to examine the reliability, validity, and clinical utility of a self-report measure of NSI disorder, the Alexian Brothers Assessment of Self-Injury (ABASI). The sample included 511 patients admitted to an acute care treatment program designed to treat NSI. Patients were administered the ABASI as part of a clinical assessment and routine outcome evaluation. The sample included a broad age range, as well as sufficient numbers of males and Hispanics to examine sociodemographic differences. The ABASI demonstrated adequate internal consistency and test–retest reliability, and the factor structure reflects NSI disorder criteria. Among patients being treated for NSI, 74% met criteria for NSI disorder. No differences in the rate of NSI disorder were observed by sex, ethnicity, or age. Although NSI disorder is associated with a worse presentation of self-injurious behavior, NSI disorder provides limited clinical utility as a dichotomous diagnosis, at least when compared with common NSI characteristics such as number of methods of NSI and the urge to self-injure. Instead, findings support a dimensional approach to NSI disorder. Analyses of specific symptoms of NSI disorder indicate concerns with Criterion B as currently defined by the DSM–5. Recommendations for a more parsimonious revision of NSI disorder are discussed.

Wang, Kenneth T.; Wei, Meifen; Zhao, Ran; Chuang, Chih-Chun; Li, Feihan

doi: 10.1037/pas0000027pmid: 25222437

The Cross-Cultural Loss Scale (CCLS), a measure of loss associated with crossing national boundaries, was developed across 2 samples of international students. With Sample 1 (N = 262), exploratory factor analyses were used to select the 14 CCLS items and to determine 3 factors: Belonging-Competency (α = .87), National Privileges (α = .68), and Access to Home Familiarity (α = .72). With Sample 2, confirmatory factor analyses (N = 256) cross-validated the 3-factor oblique model as well as a bifactor model. Cronbach alphas of CCLS subscale scores in Sample 2 ranged from .73 to .87. The validity of the CCLS scores was supported by its associations with related variables in the expected directions. Perceived cross-cultural losses were positively associated with negative affect, migration grief and loss, and discrimination and were negatively associated with life satisfaction, positive affect, general self-efficacy, and social connection with mainstream society. Moreover, the CCLS total and 2 subscale scores added significant incremental variance in predicting subjective well-being over and above related constructs. The results indicated measurement invariance and validity equivalency for the CCLS scores between men and women. The overall results from these 2 samples support CCLS as a psychometrically strong measure.

Schaefer, Lauren M.; Burke, Natasha L.; Thompson, J. Kevin; Dedrick, Robert F.; Heinberg, Leslie J.; Calogero, Rachel M.; Bardone-Cone, Anna M.; Higgins, Mary K.; Frederick, David A.; Kelly, Mackenzie; Anderson, Drew A.; Schaumberg, Katherine; Nerini, Amanda; Stefanile, Cristina;

Dere, Jessica; Watters, Carolyn A.; Yu, Stephanie Chee-Min; Bagby, R. Michael; Ryder, Andrew G.; Harkness, Kate L.

doi: 10.1037/pas0000026pmid: 25314096

Given substantial rates of major depressive disorder among college and university students, as well as the growing cultural diversity on many campuses, establishing the cross-cultural validity of relevant assessment tools is important. In the current investigation, we examined the Beck Depression Inventory—Second Edition (BDI–II; Beck, Steer, & Brown, 1996) among Chinese-heritage (n = 933) and European-heritage (n = 933) undergraduates in North America. The investigation integrated 3 distinct lines of inquiry: (a) the literature on cultural variation in depressive symptom reporting between people of Chinese and Western heritage; (b) recent developments regarding the factor structure of the BDI–II; and (c) the application of advanced statistical techniques to the issue of cross-cultural measurement invariance. A bifactor model was found to represent the optimal factor structure of the BDI–II. Multigroup confirmatory factor analysis showed that the BDI–II had strong measurement invariance across both culture and gender. In group comparisons with latent and observed variables, Chinese-heritage students scored higher than European-heritage students on cognitive symptoms of depression. This finding deviates from the commonly held view that those of Chinese heritage somatize depression. These findings hold implications for the study and use of the BDI–II, highlight the value of advanced statistical techniques such as multigroup confirmatory factor analysis, and offer methodological lessons for cross-cultural psychopathology research more broadly.

Ellis, Thomas E.; Rufino, Katrina A.

doi: 10.1037/pas0000028pmid: 25285716

The cognitive model of suicide makes specific predictions about the role of cognition in suicide risk. This study examined psychometric properties of the Suicide Cognitions Scale (SCS), an instrument designed to measure suicide-specific cognitions, in a sample of 150 patients (age range, 18–75 years, SD = 14.42; 56% female, 94% White) hospitalized for suicide risk associated with multiple, treatment-resistant psychiatric conditions. Findings revealed strong psychometric properties, including internal consistency and test–retest reliability. Incremental validity beyond depression and hopelessness was demonstrated in the prediction of suicidal ideation. Confirmatory factor analysis examining previously reported factor solutions suggested more consistency with a three-factor solution (Unlovability, Unbearability, and Unsolvability) relative to a two-factor solution. Good sensitivity to treatment response over the course of hospitalization also was demonstrated. The hypothesis of residual risk, derived from cognitive theory and predicting that lack of change in suicide schemas would be associated with higher suicide risk at discharge, was supported. Overall, these findings suggest considerable promise for the SCS as a measure of suicide risk that adds predictive utility to measures of depression and hopelessness, with potential usefulness in planning and monitoring treatment for suicidal individuals.

Taylor, John M.

doi: 10.1037/a0038100pmid: 25346996

Although the 10-item Perceived Stress Scale (PSS-10) is a popular measure, a review of the literature reveals 3 significant gaps: (a) There is some debate as to whether a 1- or a 2-factor model best describes the relationships among the PSS-10 items, (b) little information is available on the performance of the items on the scale, and (c) it is unclear whether PSS-10 scores are subject to gender bias. These gaps were addressed in this study using a sample of 1,236 adults from the National Survey of Midlife Development in the United States II. Based on self-identification, participants were 56.31% female, 77% White, 17.31% Black and/or African American, and the average age was 54.48 years (SD = 11.69). Findings from an ordinal confirmatory factor analysis suggested the relationships among the items are best described by an oblique 2-factor model. Item analysis using the graded response model provided no evidence of item misfit and indicated both subscales have a wide estimation range. Although t tests revealed a significant difference between the means of males and females on the Perceived Helplessness Subscale (t = 4.001, df = 1234, p < .001), measurement invariance tests suggest that PSS-10 scores may not be substantially affected by gender bias. Overall, the findings suggest that inferences made using PSS-10 scores are valid. However, this study calls into question inferences where the multidimensionality of the PSS-10 is ignored.

Olatunji, Bunmi O.; Ebesutani, Chad; Kim, Eun Ha

doi: 10.1037/pas0000039pmid: 25402446

The current research evaluated a bifactor model for the Three Domains of Disgust Scale (TDDS) in 2 undergraduate samples. The goals were (a) to evaluate whether the TDDS should be scored as a unidimensional scale or whether subscales of pathogen, sex, and moral disgust should be additionally interpreted, and (b) to examine the utility of the TDDS subscales above and beyond the total score in predicting obsessive-compulsive disorder (OCD) symptoms. Results in Study 1 and Study 2 revealed that a bifactor model fit the TDDS data well and that all items were influenced by a general disgust dimension and by 1 of 3 content dimensions. However, model-based reliability estimated via omega hierarchical for the total score suggested that TDDS items are highly multidimensional. That is, the general disgust dimension only accounts for about half of the variability in the items of the total score, with the remaining variability accounted for by the specific disgust domains and other sources of variance. Despite the high degree of multidimensionality underlying the TDDS items, the pathogen and sex subscale scores were found to be relatively unreliable after controlling for the general disgust factor. Among the 3 domains, pathogen disgust had the most consistently significant relationship with an OCD symptom latent factor above and beyond the general disgust factor. The strengths and limitations of the TDDS are discussed in the context of these findings, and the implications for better understanding the structure of disgust and its relationship with OCD are outlined.

Marek, Ryan J.; Block, Andrew R.; Ben-Porath, Yossef S.

doi: 10.1037/pas0000035pmid: 25364871

A substantial proportion of individuals who undergo surgical procedures to relieve spine pain continue to report significant pain and dysfunction after recovery. Psychopathology and patient expectations have been linked to poor results, leading to an increasing reliance on presurgical psychological screening (PPS) as part of the surgical diagnostic process. The original Minnesota Multiphasic Personality Inventory (MMPI; Hathaway & McKinley, 1943) and the MMPI-2 (Butcher, Graham, Ben-Porath, Tellegen, & Dahlstrom, 2001) were among the measures most commonly used in PPS evaluations and research. This study focuses on the newest version of the test, the MMPI-2–Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011; Tellegen & Ben-Porath, 2008/2011) as a predictor of outcomes for spine surgery candidates. Using a sample of 172 men and 210 women who underwent a PPS, we examined the ability of MMPI-2-RF scale scores to predict early surgical outcomes independent of other presurgical risk factors identified by other means, as well as patients’ presurgical expectations. MMPI-2-RF results accounted for up to 11% of additional variance in measures of early postoperative functioning. MMPI-2-RF scales that assess for emotional/internalizing problems, specifically Demoralization, measures of somatoform dysfunction, and interpersonal problems contributed most to the prediction of diminished outcome.