Access the full text.
Sign up today, get DeepDyve free for 14 days.
Sylvia Roch, Laurel McNall (2007)
An Investigation of Factors Influencing Accountability and Performance RatingsThe Journal of Psychology, 141
R. Randall, Daniel Sharples (2012)
The impact of rater agreeableness and rating context on the evaluation of poor performanceJournal of Occupational and Organizational Psychology, 85
Jisoo Ock (2014)
Why do raters pursue different rating goals? The role of rater personality and accountability context
Andrew Tenbrink, Andrew Speer (2022)
Accountability during Performance Appraisals: The Development and Validation of the Rater Accountability ScaleHuman Performance, 36
J. Colquitt, J. Rodell (2011)
Justice, Trust, and Trustworthiness: A Longitudinal Analysis Integrating Three Theoretical PerspectivesAcademy of Management Journal, 54
P. Levy, Jane Williams (2004)
The Social Context of Performance Appraisal: A Review and Framework for the FutureJournal of Management, 30
W. Giles, K. Mossholder (1990)
Employee reactions to contextual and session components of performance appraisalJournal of Applied Psychology, 75
J. Pletzer, D. Balliet, J. Joireman, D. Kuhlman, S. Voelpel, P. Lange, M. Back (2018)
Social Value Orientation, Expectations, and Cooperation in Social Dilemmas: A Meta–AnalysisEuropean Journal of Personality, 32
H. Bernardin, C. Tyler, P. Villanova (2009)
Rating Level and Accuracy as a Function of Rater PersonalityWiley-Blackwell: International Journal of Selection & Assessment
W. Borman (1977)
Consistency of rating accuracy and rating errors in the judgment of human performance.Organizational behavior and human performance, 20 2
I. Jawahar, Charles Williams (1997)
WHERE ALL THE CHILDREN ARE ABOVE AVERAGE: THE PERFORMANCE APPRAISAL PURPOSE EFFECTPersonnel Psychology, 50
S. Adler, M. Campion, Alan Colquitt, A. Grubb, Kevin Murphy, Rob Ollander-Krane, E. Pulakos (2016)
Getting Rid of Performance Ratings: Genius or Folly? A DebateIndustrial and Organizational Psychology, 9
Ami Curtis, Richard Harvey, Daran Ravden (2005)
Sources of Political Distortions in Performance AppraisalsGroup & Organization Management, 30
Zainab Baloch, Muhammad Iqbal, Malik Ikramullah, Jan‐Willem Prooijen, Tamania Khan (2021)
Getting Ratees to Accept Performance Feedback: A Relational ApproachSocial Justice Research, 34
(1992)
A due process metaphor for performance appraisal system
P. Lange (1999)
The pursuit of joint outcomes and equality in outcomes: An integrative model of social value orientation.Journal of Personality and Social Psychology, 77
Xiaoye Wang, Kin Wong, Jessica Kwong (2010)
The roles of rater goals and ratee performance levels in the distortion of performance ratings.The Journal of applied psychology, 95 3
Sylvia Roch, John Lane, Charles Samuelson, Scott Allison, Jennifer Dent (2000)
Cognitive Load and the Equality Heuristic: A Two-Stage Model of Resource Overconsumption in Small Groups.Organizational behavior and human decision processes, 83 2
Michael Harari, C. Rudolph, Andrew Laginess (2015)
Does rater personality matter? A meta‐analysis of rater Big Five–performance rating relationshipsJournal of Occupational and Organizational Psychology, 88
Brian Hoffman, C. Gorman, C. Blair, John Meriac, Benjamin Overstreet, E. Atchley (2012)
Evidence for the Effectiveness of an Alternative Multisource Performance Rating MethodologyPersonnel Psychology, 65
P. Villanova, H. Bernardin, Sue Dahmus, Randi Sims (1993)
Rater Leniency and Performance Appraisal DiscomfortEducational and Psychological Measurement, 53
Research in Personnel and Human Resources Management, 10
G. Ferris, T. Munyon, Kevin Basik, M. Buckley (2008)
The performance evaluation context: Social, emotional, cognitive, political, and relationship componentsHuman Resource Management Review, 18
Amiel Sharon, C. Bartlett (1969)
Effect of instructional conditions in producing leniency on two types of rating scales.Personnel Psychology, 22
H. Bernardin, Donna Cooke, P. Villanova (2000)
Conscientiousness and agreeableness as predictors of rating leniency.The Journal of applied psychology, 85 2
K. Murphy, R. DeShon (2000)
INTERRATER CORRELATIONS DO NOT ESTIMATE THE RELIABILITY OF JOB PERFORMANCE RATINGSPersonnel Psychology, 53
Deidra Schleicher, H. Baumann, D. Sullivan, P. Levy, Darel Hargrove, Brenda Barros-Rivera (2018)
Putting the System Into Performance Management Systems: A Review and Agenda for Performance Management ResearchJournal of Management, 44
T. Chesney, Swee-Hoon Chuah, R. Hoffmann, Wendy Hui, Jeremy Larner (2016)
How user personality and social value orientation influence avatar-mediated friendshipInf. Technol. People, 29
Lin Tao, W. Au (2014)
Values, self and other-regarding behavior in the dictator gameRationality and Society, 26
Gunna Yun, L. Donahue, Nicole Dudley, L. McFarland (2005)
Rater Personality, Rating Format, and Social Context: Implications for Performance Appraisal RatingsInternational Journal of Selection and Assessment, 13
Steven Scullen, M. Mount, Maynard Goff (2000)
Understanding the latent structure of job performance ratings.The Journal of applied psychology, 85 6
P. Hanel, Katia Vione (2016)
Do Student Samples Provide an Accurate Estimate of the General Public?PLoS ONE, 11
Deidra Schleicher, H. Baumann, D. Sullivan, Junhyok Yim (2019)
Evaluating the effectiveness of performance management: A 30-year integrative conceptual review.The Journal of applied psychology
Neal Mero, Rebecca Guidice, Amy Brownlee (2007)
Accountability in a Performance Appraisal Context: The Effect of Audience and Form of Accounting on Rater Response and BehaviorJournal of Management, 33
Qiangqiang Li, Gengdan Hu, D. Pan (2021)
Do agreeableness and social value orientation predict altruistic behavior under time pressure?Social Behavior and Personality: an international journal
Mickey Smith, J. Wallace, Patti Jordan (2016)
When the dark ones become darker: How promotion focus moderates the effects of the dark triad on supervisor performance ratingsJournal of Organizational Behavior, 37
Michael Harari, C. Rudolph (2017)
The effect of rater accountability on performance ratings: A meta-analytic reviewHuman Resource Management Review, 27
K. Murphy (2019)
Performance evaluation will not die, but it shouldHuman Resource Management Journal
J. Spence, L. Keeping (2011)
Conscious rating distortion in performance appraisal: A review, commentary, and proposed framework for researchHuman Resource Management Review, 21
Aharon Tziner, K. Murphy, J. Cleveland (2005)
Contextual and Rater Factors Affecting Rating BehaviorGroup & Organization Management, 30
Kai Bauch, Barbara Weißenberger (2020)
The Effects of Accountability on Likeability Bias in Subjective Performance Evaluations: An Eye-Tracking StudySocial Science Research Network
Marie Waung, Scott Highhouse (1997)
Fear of conflict and empathic buffering : Two explanations for the inflation of performance feedbackOrganizational Behavior and Human Decision Processes, 71
M. Iqbal, S. Akbar, P. Budhwar, S. Shah (2019)
Effectiveness of performance appraisal: Evidence on the utilization criteriaJournal of Business Research
K. Murphy, J. Cleveland, Amie Skattebo, Ted Kinney (2004)
Raters who pursue different goals give different ratings.The Journal of applied psychology, 89 1
Beatrice Rammstedt, O. John (2007)
Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and GermanJournal of Research in Personality, 41
Con Stough, M. Anguera, Riccardo Sartori, Kevin Cheng, Harry Hui, W. Cascio (2017)
Leniency Bias in Performance Ratings: The Big-Five CorrelatesFrontiers in Psychology, 8
Judgment and Decision Making, 6
R. Murphy, K. Ackermann, Michel Handgraaf (2011)
Measuring Social Value OrientationSSRN Electronic Journal
Lori Goler, J. Gale, Adam Grant (2016)
Let’s Not Kill Performance Evaluations Yet.Harvard Business Review, 94
A. Bandura (1991)
Social cognitive theory of self-regulation☆Organizational Behavior and Human Decision Processes, 50
Christopher Rosen, K. Kacmar, Kenneth Harris, M. Gavin, Wayne Hochwarter (2017)
Workplace Politics and Performance AppraisalJournal of Leadership & Organizational Studies, 24
C. Fletcher (1990)
The Relationships Between Candidate Personality, Self-Presentation Strategies, and Interviewer Assessments in Selection Interviews: An Empirical StudyHuman Relations, 43
Inchul Cho, S. Payne (2016)
Other Important Questions: When, How, and Why Do Cultural Values Influence Performance Management?Industrial and Organizational Psychology, 9
A. Kruglanski (1989)
The Psychology of Being "Right": The Problem of Accuracy in Social Perception and CognitionPsychological Bulletin, 106
C. Dreu, Terry Boles (1998)
Share and Share Alike or Winner Take All?: The Influence of Social Value Orientation upon Choice and Recall of Negotiation Heuristics.Organizational behavior and human decision processes, 76 3
Charles Gorman (2009)
Evaluating frame-of-reference rater training effectiveness using performance schema accuracy.The Journal of applied psychology, 94 5
M. Iqbal, S. Akbar, P. Budhwar (2015)
Effectiveness of Performance Appraisal: An Integrated FrameworkChange Management Strategy eJournal
Aharon Tziner, Edna Rabenu (2018)
Improving Performance Appraisal at Work
J. Ellington, Mark Wilson (2017)
The Performance Appraisal Milieu: A Multilevel Analysis of Context Effects in Performance RatingsJournal of Business and Psychology, 32
Kin Wong, Jessica Kwong (2007)
Effects of rater goals on rating patterns: evidence from an experimental field study.The Journal of applied psychology, 92 2
J. Lerner, P. Tetlock (1999)
Accounting for the effects of accountability.Psychological bulletin, 125 2
D. Balliet, C. Parks, J. Joireman (2009)
Social Value Orientation and Cooperation in Social Dilemmas: A Meta-AnalysisGroup Processes & Intergroup Relations, 12
Inchul Cho, Biyun Hu, Christopher Berry (2022)
A matter of when, not whether: A meta-analysis of modesty bias in East Asian self-ratings of job performance.The Journal of applied psychology
M. Benedict, E. Levine (1988)
Delay and distortion: Tacit influences on performance appraisal effectiveness.Journal of Applied Psychology, 73
Sumrina Razzaq, M. Iqbal, Malik Ikramullah, J. Prooijen (2016)
Occurrence of rating distortions and ratees’ fairness perceptions per raters’ mood and affectCareer Development International, 21
T. Higgins (1997)
Beyond pleasure and pain.The American psychologist, 52 12
Andrew Speer, Andrew Tenbrink, Michael Schwendeman (2019)
Let’s Talk it Out: The Effects of Calibration Meetings on Performance RatingsHuman Performance, 32
Patrick Brady, Matt Nobles, Leana Bouffard (2017)
Are college students really at a higher risk for stalking? Exploring the generalizability of student samples in victimization researchJournal of Criminal Justice, 52
Ted Shore, J. Adams, Armen Tashchian (1998)
Effects of Self-Appraisal Information, Appraisal Purpose, and Feedback Target on Performance Appraisal RatingsJournal of Business and Psychology, 12
K. Murphy (2005)
Why Don't Measures of Broad Dimensions of Personality Perform Better As Predictors of Job Performance?Human Performance, 18
K. Murphy (2008)
Explaining the Weak Relationship Between Job Performance and Ratings of Job PerformanceIndustrial and Organizational Psychology, 1
C. Dreu, P. Lange (1995)
The impact of social value orientations on negotiator cognition and behaviorPersonality and Social Psychology Bulletin, 21
R. Klimoski, Lawrence Inks (1990)
Accountability forces in performance appraisalOrganizational Behavior and Human Decision Processes, 45
(2013)
Social value orientation: theoretical and measurement issues in the study of social preferences
H. Bernardin, S. Thomason, M. Buckley, J. Kane (2016)
Rater Rating‐Level Bias and Accuracy in Performance Appraisals: The Impact OF Rater Personality, Performance Management Competence, and Rater AccountabilityHuman Resource Management, 55
R. Peterson (2001)
On the Use of College Students in Social Science Research: Insights from a Second‐Order Meta‐analysisJournal of Consumer Research, 28
VU Research, Portal, van Lange, P.A.M. Otten, W. Bruin, E.N.M. Joireman, P. Lange, W. Otten, E. Bruin, J. Joireman, Hal Kelley, C. Rusbult, Ben Slugoski, A. Lange (1997)
Development of prosocial, individualistic, and competitive orientations: theory and preliminary evidence.Journal of personality and social psychology, 73 4
Recent performance appraisal (PA) literature suggests that alongside cognitive biases, rating distortions may stem from rater disposition and PA context. The study investigated the role of social value orientation (rater disposition), PA purposes and rater accountability (PA context) toward rating distortions at both performance levels, i.e. good and poor.Design/methodology/approachThe authors designed an experimental study and elicited data from N = 110 undergraduate students about two video-taped performances of good and poor performers. In these videos, two managers conducted assessment interviews of two different employees for the job of a sales representative at an information technology organization. To ensure the validity of performance ratings, the authors invited 10 senior managers to provide benchmark ratings of the video-taped performances. While being placed in two separate groups, the study participants gave performance ratings on both the video-taped performances. The authors used repeated-measures analysis to analyze data.FindingsThe results revealed that rating distortions took place not because of rater social value orientation, but the PA context. Different rating distortion patterns emerged for different levels of ratees' performance.Originality/valueThis study’s findings furnish new insights for assessing rating distortions for poor as well as good performers. Moreover, the results support previous findings that for good performers, accountable raters are tempted toward accurate ratings and refrained from deflation. Similarly, for poor performers, accountable raters do not inflate ratings. The findings will open research avenues to examine the role of PA purposes in rating distortions for different performance levels.
Management Decision – Emerald Publishing
Published: Jan 17, 2023
Keywords: Performance appraisal; Rating distortion; PA purposes; Rater accountability; Social value orientation
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.