Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You and Your Team.

Learn More →

Influence of prior acquaintance with the ratee on rater accuracy and halo

Influence of prior acquaintance with the ratee on rater accuracy and halo Purpose – The purpose of this paper is to examine the effect of acquaintance on performance rating accuracy and halo. Design/methodology/approach – After expert ratings were obtained, US Air Force Officers ( n =104) with an average of six years experience rated the performance of four officers who delivered 6‐7 minute briefings on their research projects; 26 raters reported being acquainted with one or more of the briefers. Raters were randomly assigned to use a rating format designed to encourage between‐ratee comparisons on each dimension or a format in which each ratee was separately rated on all dimensions. Findings – Ratings made by acquainted raters were more accurate than ratings by unacquainted raters. Accuracy was positively correlated with halo for both sets of ratings. Rating format had no discernible effect on accuracy or halo. Research limitations/implications – One limitation of this study is that the measure of acquaintance was not designed as a surrogate for familiarity. Development of a multi‐item, psychometrically‐valid measure of acquaintance should be the first step in pursuing this research. The use of a laboratory design where only a small percentage of the sample was acquainted with those being rated also limits the study's generalizability. Practical implications – The results show that prior acquaintance with the ratee results in more accurate ratings. Ratings were also more positive when raters had prior contact with the person they rated. Originality/value – The hypothesis is that the cognitive processes used to produce ratings are different for raters who have had no prior contact with a ratee and raters who are in some manner acquainted with a ratee. In the past, a positive halo effect from acquaintance between raters and ratees has been a concern. However, this limited study indicates that acquaintance may actually result in more accurate ratings. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Journal of Management Development Emerald Publishing

Influence of prior acquaintance with the ratee on rater accuracy and halo

Loading next page...
 
/lp/emerald-publishing/influence-of-prior-acquaintance-with-the-ratee-on-rater-accuracy-and-fjEaEue6b9
Publisher
Emerald Publishing
Copyright
Copyright © 2007 Emerald Group Publishing Limited. All rights reserved.
ISSN
0262-1711
DOI
10.1108/02621710710777282
Publisher site
See Article on Publisher Site

Abstract

Purpose – The purpose of this paper is to examine the effect of acquaintance on performance rating accuracy and halo. Design/methodology/approach – After expert ratings were obtained, US Air Force Officers ( n =104) with an average of six years experience rated the performance of four officers who delivered 6‐7 minute briefings on their research projects; 26 raters reported being acquainted with one or more of the briefers. Raters were randomly assigned to use a rating format designed to encourage between‐ratee comparisons on each dimension or a format in which each ratee was separately rated on all dimensions. Findings – Ratings made by acquainted raters were more accurate than ratings by unacquainted raters. Accuracy was positively correlated with halo for both sets of ratings. Rating format had no discernible effect on accuracy or halo. Research limitations/implications – One limitation of this study is that the measure of acquaintance was not designed as a surrogate for familiarity. Development of a multi‐item, psychometrically‐valid measure of acquaintance should be the first step in pursuing this research. The use of a laboratory design where only a small percentage of the sample was acquainted with those being rated also limits the study's generalizability. Practical implications – The results show that prior acquaintance with the ratee results in more accurate ratings. Ratings were also more positive when raters had prior contact with the person they rated. Originality/value – The hypothesis is that the cognitive processes used to produce ratings are different for raters who have had no prior contact with a ratee and raters who are in some manner acquainted with a ratee. In the past, a positive halo effect from acquaintance between raters and ratees has been a concern. However, this limited study indicates that acquaintance may actually result in more accurate ratings.

Journal

Journal of Management DevelopmentEmerald Publishing

Published: Aug 21, 2007

Keywords: Performance appraisal; Assessment; Cognition

References