Psychological Assessment

Blonigen, Daniel M.; Patrick, Christopher J.; Douglas, Kevin S.; Poythress, Norman G.; Skeem, Jennifer L.; Lilienfeld, Scott O.; Edens, John F.; Krueger, Robert F.

doi: 10.1037/a0017240pmid: 20230156

Research to date has revealed divergent relations across factors of psychopathy measures with criteria of internalizing (INT; anxiety, depression) and externalizing (EXT; antisocial behavior, substance use). However, failure to account for method variance and suppressor effects has obscured the consistency of these findings across distinct measures of psychopathy. Using a large correctional sample, the current study employed a multimethod approach to psychopathy assessment (self-report, interview and file review) to explore convergent and discriminant relations between factors of psychopathy measures and latent criteria of INT and EXT derived from the Personality Assessment Inventory (Morey, 2007). Consistent with prediction, scores on the affective–interpersonal factor of psychopathy were negatively associated with INT and negligibly related to EXT, whereas scores on the social deviance factor exhibited positive associations (moderate and large, respectively) with both INT and EXT. Notably, associations were highly comparable across the psychopathy measures when accounting for method variance (in the case of EXT) and when assessing for suppressor effects (in the case of INT). Findings are discussed in terms of implications for clinical assessment and evaluation of the validity of interpretations drawn from scores on psychopathy measures.

Jopp, Daniela S.; Hertzog, Christopher

doi: 10.1037/a0017662pmid: 20230157

Everyday leisure activities in adulthood and old age have been investigated with respect to constructs such as successful aging, an engaged lifestyle, and prevention of age-related cognitive decline. They also relate to mental health and have clinical value, as they can inform diagnosis and interventions. In the present study, the authors enhanced the content validity of the Victoria Longitudinal Study activity questionnaire by adding items on physical and social activities and validated a shortened version of the questionnaire. The proposed leisure activity model included 11 activity categories: 3 types of social activities (i.e., activities with close social partners, group-centered public activity, religious activities), physical activities, developmental activities, experiential activities, crafts, game playing, TV watching, travel, and technology use. Confirmatory factor analyses validated the proposed factor structure in 2 independent samples. A higher order model with a general activity factor fitted the activity factor correlations with relatively little loss of fit. Convergent and discriminant validity for the activity scales were supported by patterns of their correlations with education, health, depression, cognition, and personality. In sum, the scores derived from of the augmented Victoria Longitudinal Study activity questionnaire demonstrate good reliability, and validity evidence supports their use as measures of leisure activities in young, middle-aged, and older individuals.

Benson, Nicholas; Hulac, David M.; Kranzler, John H.

doi: 10.1037/a0017767pmid: 20230158

Published empirical evidence for the Wechsler Adult Intelligence Scale—Fourth Edition (WAIS–IV) does not address some essential questions pertaining to the applied practice of intellectual assessment. In this study, the structure and cross-age invariance of the latest WAIS–IV revision were examined to (a) elucidate the nature of the constructs measured and (b) determine whether the same constructs are measured across ages. Results suggest that a Cattell–Horn–Carroll (CHC)–inspired structure provides a better description of test performance than the published scoring structure does. Broad CHC abilities measured by the WAIS–IV include crystallized ability (Gc), fluid reasoning (Gf), visual processing (Gv), short-term memory (Gsm), and processing speed (Gs), although some of these abilities are measured more comprehensively than are others. Additionally, the WAIS–IV provides a measure of quantitative reasoning (QR). Results also suggest a lack of cross-age invariance resulting from age-related differences in factor loadings. Formulas for calculating CHC indexes and suggestions for interpretation are provided.

Jones, Jessica A. H.; Sponheim, Scott R.; MacDonald, Angus W.

doi: 10.1037/a0017828pmid: 20230159

The dot pattern expectancy (DPX) task was created to efficiently assess context-processing deficits in patients with schizophrenia. Three studies investigated the characteristics of the DPX relevant for clinical applications. To answer questions regarding the psychometric properties of the task, performance on this task was studied in 2 healthy samples. Acceptable reliability and internal consistency and retest reliability were found for most measures of context processing, but not for a difficulty control condition. These characteristics were also found in a suggested brief version (DPXbrf), which may be more practical for clinical purposes. In a 3rd study, schizophrenia patients showed a specific deficit in context processing, replicating previous findings. Findings of these studies indicated some promise for use of this task in measuring context processing and also identified characteristics of this task that need to be strengthened to increase reliability, feasibility, and single-subject interpretability.

Boccaccini, Marcus T.; Murrie, Daniel C.; Hawes, Samuel W.; Simpler, Amber; Johnson, Jeremy

doi: 10.1037/a0017818pmid: 20230160

We examined the ability of scores from the Personality Assessment Inventory (PAI; Morey, 1991) to predict postrelease (M = 4.90 years follow-up) arrests in a sample of 1,412 sex offenders. We focused on scores from 4 PAI measures conceptually relevant to offending, including the Antisocial Features (ANT), Aggression (AGG), and Dominance (DOM) scales, as well as the Violence Potential Index (VPI). Scores from several PAI measures demonstrated small- to medium-sized effects in predicting violent nonsexual recidivism, nonviolent recidivism, and sex offender registry violations, with the AGG scale being the strongest (d = 0.50 for violent nonsexual recidivism, d = 0.55 for sex offender registry violations) and most consistent predictor of recidivism.

Walters, Glenn D.; McGrath, Robert E.; Knight, Raymond A.

doi: 10.1037/a0017819pmid: 20230161

The taxometric method effectively distinguishes between dimensional (1-class) and taxonic (2-class) latent structure, but there is virtually no information on how it responds to polytomous (3-class) latent structure. A Monte Carlo analysis showed that the mean comparison curve fit index (CCFI; Ruscio, Haslam, & Ruscio, 2006) obtained with 3 taxometric procedures—mean above minus below a cut (MAMBAC), maximum covariance (MAXCOV), and latent mode factor analysis (L-Mode)—accurately identified 1-class (dimensional) and 2-class (taxonic) samples and produced taxonic results when applied to 3-class (polytomous) samples. From these results it is concluded that using the simulated data curve approach and averaging across procedures is an effective way of distinguishing between dimensional (1-class) and categorical (2 or more classes) latent structure.

Gresham, Frank M.; Elliott, Stephen N.; Cook, Clayton R.; Vance, Michael J.; Kettler, Ryan

doi: 10.1037/a0018124pmid: 20230162

One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants’ ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills Improvement System—Rating Scales (SSIS–RS; F. M. Gresham & S. N. Elliott, 2008). Two subsamples from the normative sample of the SSIS–RS were used. The first sample of participants consisted of 168 students who had all 3 informants (parent, teacher, and self) complete the SSIS–RS scales, which was necessary to assess agreement across different raters. The second sample consisted of 164 students who had raters in a similar or same role (father–mother, teacher–teacher). The results replicated an extensive literature showing that cross-informant agreements for social skills and problem behaviors are weak to moderate. The current study invoked multitrait–multimethod logic to interpret the correlations among raters derived from different informants and showed that the convergent validity coefficients were consistently stronger than the discriminant validity correlations. Implications for assessment practices and future research are discussed.

Olatunji, Bunmi O.; Sawchuk, Craig N.; Moretz, Melanie W.; David, Bieke; Armstrong, Thomas; Ciesielski, Bethany G.

doi: 10.1037/a0018125pmid: 20230163

The present investigation examined the factor structure and psychometric properties of the Injection Phobia Scale–Anxiety (IPS-Anx). Principal components analysis of IPS-Anx items in Study 1 (n = 498) revealed a 2-factor structure consisting of Distal Fear and Contact Fear. However, CFA results in Study 2 (n = 567) suggest that a 1-factor structure may be more parsimonious. IPS-Anx scores demonstrated excellent reliability including test–retest over a 12-week period in Study 3 (n = 195). Supportive evidence for convergent and divergent validity of IPS-Anx scores was also found in Study 4 (n = 319), with strong associations with disgust propensity and sensitivity and weak associations with positive affect. Further evidence of validity was found in Study 5 (n = 1,674) because IPS-Anx scores discriminated those who have experienced fainting symptoms or avoided medical procedures from those without a history of such symptoms. In Study 6, data from Studies 2 through 5 were pooled, and the findings of Study 2 were replicated. The 1-factor model also fit the data well for men and women in Study 6. Lastly, IPS-Anx scores differentiated those with blood-injection-injury phobia (n = 39) from those without this phobia (n = 43) in Study 7. These findings suggest that the IPS-Anx has excellent psychometric properties, making it suitable for use in programmatic research on injection phobia. However, future research examining the validity of a short form of the scale with only the Contact Fear items may further improve the efficiency and utility of the IPS-Anx.

Abramowitz, Jonathan S.; Deacon, Brett J.; Olatunji, Bunmi O.; Wheaton, Michael G.; Berman, Noah C.; Losardo, Diane; Timpano, Kiara R.; McGrath, Patrick B.; Riemann, Bradley C.; Adams, Thomas; Björgvinsson, Thröstur; Storch, Eric A.; Hale, Lisa R.

Steinmetz, Jean-Paul; Brunner, Martin; Loarer, Even; Houssemand, Claude

doi: 10.1037/a0017661pmid: 20230165

The Wisconsin Card Sorting Test (WCST) assesses executive and frontal lobe function and can be administered manually or by computer. Despite the widespread application of the 2 versions, the psychometric equivalence of their scores has rarely been evaluated and only a limited set of criteria has been considered. The present experimental study (N = 100 healthy adults) therefore examined the psychometric equivalence of 4 scores (i.e., Total Correct, Percentage of Errors, Perseverative Errors, and Failure-to-Maintain-Set) obtained on the 2 versions of the WCST in terms of 4 key criteria identified within the framework of classical test theory. The results showed considerable differences in variances, small to modest parallel-forms reliability coefficients, and small to modest temporal stability coefficients. Taken together, our results suggest that scores on the manual version and the computer version of the WCST show incomplete psychometric equivalence.