Psychological Assessment

Soubelet, Andrea; Salthouse, Timothy A.

doi: 10.1037/a0023401pmid: 21480725

The goal of the current project was to determine (a) the cognitive abilities assessed by the Mini Mental State Examination (MMSE; M. F. Folstein, S. E. Folstein, & P. R. McHugh, 1975), (b) whether the same abilities are associated with MMSE performance among people of different ages, and (c) whether the same abilities are involved in changes within the same people over time. The authors therefore examined whether the initial levels of 5 cognitive ability constructs (vocabulary, reasoning, memory, space, and speed) predicted initial levels of MMSE performance and whether the initial levels or the changes in these 5 cognitive abilities predicted change in the MMSE performance. The major findings were that 3 cognitive constructs (vocabulary, reasoning, and memory) contribute to performance in the MMSE but that their respective contributions to the MMSE vary as a function of age and time. In particular, individual differences and change in the MMSE are primarily related to individual differences in reasoning among adults younger than about 70 years, whereas both initial level of MMSE performance and longitudinal change in MMSE performance primarily related to initial level and change in memory ability among adults older than 70 years. The results therefore imply that both the level of performance on the MMSE at a single point in time and the change in MMSE over time may represent somewhat different cognitive abilities at different ages.

Cole, David A.; Cai, Li; Martin, Nina C.; Findling, Robert L.; Youngstrom, Eric A.; Garber, Judy; Curry, John F.; Hyde, Janet S.; Essex, Marilyn J.; Compas, Bruce E.; Goodyer, Ian M.; Rohde, Paul; Stark, Kevin D.; Slattery, Marcia J.; Forehand, Rex

Kupersmidt, Janis B.; Stelter, Rebecca; Dodge, Kenneth A.

doi: 10.1037/a0023621pmid: 21534693

The purpose of this study was to evaluate the psychometric properties of an audio computer-assisted self-interviewing Web-based software application called the Social Information Processing Application (SIP-AP) that was designed to assess social information processing skills in boys in 3rd through 5th grades. This study included a racially and ethnically diverse sample of 244 boys ages 8 through 12 (M = 9.4) from public elementary schools in 3 states. The SIP-AP includes 8 videotaped vignettes, filmed from the first-person perspective, that depict common misunderstandings among boys. Each vignette shows a negative outcome for the victim and ambiguous intent on the part of the perpetrator. Boys responded to 16 Web-based questions representing the 5 social information processing mechanisms, after viewing each vignette. Parents and teachers completed measures assessing boys' antisocial behavior. Confirmatory factor analyses revealed that a model positing the original 5 cognitive mechanisms fit the data well when the items representing prosocial cognitions were included on their own factor, creating a 6th factor. The internal consistencies for each of the 16 individual cognitions as well as for the 6 cognitive mechanism scales were excellent. Boys with elevated scores on 5 of the 6 cognitive mechanisms exhibited more antisocial behavior than boys whose scores were not elevated. These findings highlight the need for further research on the measurement of prosocial cognitions or cognitive strengths in boys in addition to assessing cognitive deficits. Findings suggest that the SIP-AP is a reliable and valid tool for use in future research of social information processing skills in boys.

Valen, Jakob; Ryum, Truls; Svartberg, Martin; Stiles, Tore C.; McCullough, Leigh

doi: 10.1037/a0023649pmid: 21517190

This study examined interrater reliability and sensitivity to change of the Achievement of Therapeutic Objectives Scale (ATOS; McCullough, Larsen, et al., 2003) in short-term dynamic psychotherapy (STDP) and cognitive therapy (CT). The ATOS is a process scale originally developed to assess patients' achievements of treatment objectives in STDP, but further operational definitions have led to a theoretically neutral assessment device, making it applicable to other treatment modalities as well. Videotapes from a randomized controlled trial comparing the effectiveness of STDP and CT for patients with Cluster C personality disorders were rated by independent raters, typically at Sessions 6 and 36. The results indicated good to excellent interrater reliability, as well as adequate sensitivity to change in theoretically expected ways, in both STDP and CT. The results lend further support to the psychometric soundness of the ATOS and show promise for its use when comparing STDP and CT.

Williams, J. Michael; Cottle, Cindy C.

doi: 10.1037/a0023651pmid: 21534698

Normative comparisons are an integral component of neuropsychological test interpretation and provide the basis for an inference of abnormal function and impairment. In order to remedy a deficit of normative standards for a large number of neuropsychology tests, Mitrushina, Boone, Razani, and D'Elia (2005) used the meta-analysis of studies that incorporated normal volunteers to create a type of normative standard for many tests in neuropsychology that were not adequately normed in the past. The present study examined this method by contrasting meta-analysis norms of the Wechsler Adult Intelligence Scale—Revised (WAIS–R; Wechsler, 1981) with its published quota norms. The study examined 12 experimental studies of the WAIS–R that included normal, control volunteers (N = 2,147). These were combined by meta-analysis, and the summary scores were compared. The meta-analysis revealed a significant sampling bias with studies recruiting more White and higher educated respondents than indicated by the U.S. Census. This bias was successfully corrected using Monte Carlo simulation and adjustments for quota sampling. The corrections could be applied to all meta-analysis norms currently in use and bring them in line with the U.S. Census demographics.

Reynolds, Cecil R.

doi: 10.1037/a0025502pmid: N/A

Knabb, Joshua J.; Vogt, Ronald G.; Newgren, Kevin P.

doi: 10.1037/a0023681pmid: 21534692

In the current study, we investigated Minnesota Multiphasic Personality Inventory–2 (MMPI-2) characteristics in an Old Order Amish nonclinical sample (N = 84), comparing these data with both the United States normative sample (N = 2,600) and a sample of Old Order Amish outpatients (N = 136). Consistent with our hypothesis, the Old Order Amish nonclinical group scored similarly to the United States normative sample and lower than the Old Order Amish outpatients on most scales. Thus, overall, the MMPI-2 appears to be sensitive to psychopathology, especially depression and psychosis, among Old Order Amish test takers. Still, several Validity, Clinical, Supplementary, Content, and Personality Psychopathology Five (PSY-5) scale score differences materialized between the Old Order Amish nonclinical group and the United States group, suggesting that certain MMPI-2 scales may need to be interpreted differently for Old Order Amish test takers. Further MMPI-2 research is needed with the Old Order Amish to replicate and generalize our findings.

Chao, Ruth Chu-Lien; Green, Kathy E.

doi: 10.1037/a0023710pmid: 21517192

Effectively and efficiently diagnosing African Americans' mental health has been a chronically unresolved challenge. To meet this challenge we developed a tool to better understand African Americans' mental health: the Multiculturally Sensitive Mental Health Scale (MSMHS). Three studies reporting the development and initial validation of the MSMHS were conducted with African American student samples. First, an exploratory factor analysis of an initial item pool yielded 5 factors assessing subscales of perceived racism, depression, well-being, anxiety, and suicidal thoughts. Second, a confirmatory factor analysis supported the MSMHS's 5-dimensional factor structure. Third, test–retest reliability, internal consistency, and validity coefficients supported the viability, use, and potential for continued development of this new instrument. Implications for theory and research on multicultural mental health scales are discussed.

Crawford, John R.; Garthwaite, Paul H.; Sutherland, David; Borland, Nicola

doi: 10.1037/a0023712pmid: 21574720

Supplementary methods for the analysis of the Delis–Kaplan Executive Function System (Delis, Kaplan, & Kramer, 2001) are made available, including (a) quantifying the number of abnormally low achievement scores exhibited by an individual and accompanying this with an estimate of the percentage of the normative population expected to exhibit at least this number of low scores; (b) estimating the overall abnormality of an individual's achievement score profile with the Mahalanobis distance index; (c) calculating a composite executive function index score for an individual and providing accompanying confidence limits; and (d) providing the percentile ranks for an individual's achievement scores and executive index score (in the latter case, confidence limits on scores are also expressed as percentile ranks). With the exception of the Mahalanobis distance index, all the methods can be obtained with the equations and tables provided in this article. However, for the convenience of clinicians and to reduce the possibility of clerical error, the methods have also been implemented in a computer program. More important, the program allows the methods to be applied when only a subset of scores is available. The program can be downloaded (as a zip file) from this article's supplemental materials or from www.abdn.ac.uk/~psy086/dept/DKEFS_Supplementary_Analysis.htm.

Ang, Rebecca P.; Lowe, Patricia A.; Yusof, Noradlin

doi: 10.1037/a0023891pmid: 21668124

The present study investigated the factor structure, reliability, convergent and discriminant validity, and U.S. norms of the Revised Children's Manifest Anxiety Scale, Second Edition (RCMAS-2; C. R. Reynolds & B. O. Richmond, 2008a) scores in a Singapore sample of 1,618 school-age children and adolescents. Although there were small statistically significant differences in the average RCMAS-2 T scores found across various demographic groupings, on the whole, the U.S. norms appear adequate for use in the Asian Singapore sample. Results from item bias analyses suggested that biased items detected had small effects and were counterbalanced across gender and ethnicity, and hence, their relative impact on test score variation appears to be minimal. Results of factor analyses on the RCMAS-2 scores supported the presence of a large general anxiety factor, the Total Anxiety factor, and the 5-factor structure found in U.S. samples was replicated. Both the large general anxiety factor and the 5-factor solution were invariant across gender and ethnic background. Internal consistency estimates ranged from adequate to good, and 2-week test–retest reliability estimates were comparable to previous studies. Evidence providing support for convergent and discriminant validity of the RCMAS-2 scores was also found. Taken together, findings provide additional cross-cultural evidence of the appropriateness and usefulness of the RCMAS-2 as a measure of anxiety in Asian Singaporean school-age children and adolescents.