Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

The effect of relative performance feedback on judgmental forecasting accuracy

The effect of relative performance feedback on judgmental forecasting accuracy Forecasting processes in organizational settings largely rely on human judgment, which makes it important to examine ways to improve the accuracy of these judgmental forecasts. The purpose of this paper is to test the effect of providing relative performance feedback on judgmental forecasting accuracy.Design/methodology/approachThis paper is based on a controlled laboratory experiment.FindingsThe authors show that feedback that ranks the forecasting performance of participants improves their accuracy compared with the forecasting accuracy of participants who do not get such feedback. The authors also find that the effectiveness of such relative performance feedback depends on the content of the feedback information as well as on whether accurate forecasting performance is linked to additional financial rewards. Relative performance feedback becomes more effective when subjects are told they rank behind other participants than when they are told they rank higher than other participants. This finding is consistent with loss aversion: low-ranked individuals view their performance as a loss and work harder to avoid it. By contrast, top performers tend to slack off. Finally, the authors find that the addition of monetary rewards for top performers reduces the effectiveness of relative performance feedback, particularly for individuals whose performance ranks near the bottom.Originality/valueOne way to improve forecasting accuracy when forecasts rely on human judgment is to design an effective incentive system. Despite the crucial role of judgmental forecasts in organizations, little attention has been devoted to this topic. The aim of this study is to add to the literature in this field. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Management Decision Emerald Publishing

The effect of relative performance feedback on judgmental forecasting accuracy

Kim, Hyo Young; Lee, Yun Shin; Jun, Duk Bin
Management Decision , Volume 57 (7): 17 – Jul 5, 2019
Download PDF
17 pages

Loading next page...
 
/lp/emerald-publishing/the-effect-of-relative-performance-feedback-on-judgmental-forecasting-cf4OLSa3A1
Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
0025-1747
DOI
10.1108/md-06-2017-0549
Publisher site
See Article on Publisher Site

Abstract

Forecasting processes in organizational settings largely rely on human judgment, which makes it important to examine ways to improve the accuracy of these judgmental forecasts. The purpose of this paper is to test the effect of providing relative performance feedback on judgmental forecasting accuracy.Design/methodology/approachThis paper is based on a controlled laboratory experiment.FindingsThe authors show that feedback that ranks the forecasting performance of participants improves their accuracy compared with the forecasting accuracy of participants who do not get such feedback. The authors also find that the effectiveness of such relative performance feedback depends on the content of the feedback information as well as on whether accurate forecasting performance is linked to additional financial rewards. Relative performance feedback becomes more effective when subjects are told they rank behind other participants than when they are told they rank higher than other participants. This finding is consistent with loss aversion: low-ranked individuals view their performance as a loss and work harder to avoid it. By contrast, top performers tend to slack off. Finally, the authors find that the addition of monetary rewards for top performers reduces the effectiveness of relative performance feedback, particularly for individuals whose performance ranks near the bottom.Originality/valueOne way to improve forecasting accuracy when forecasts rely on human judgment is to design an effective incentive system. Despite the crucial role of judgmental forecasts in organizations, little attention has been devoted to this topic. The aim of this study is to add to the literature in this field.

Journal

Management Decision – Emerald Publishing

Published: Jul 5, 2019

Keywords: Decision making; Laboratory experiment; Judgemental forecasting; Nonfinancial incentives; Rank feedback

References

  • Awards unbundled: evidence from a natural field experiment
    Ashraf, N.; Bandiera, O.; Lee, S.S.
  • Status and incentives
    Auriol, E.; Renault, R.
  • The importance of relative performance feedback information: evidence from a natural experiment using high school students
    Azmat, G.; Iriberri, N.
  • Blissful ignorance a natural experiment on the effect of feedback on students’ performance
    Bandiera, O.; Larcinese, V.; Rasul, I.
  • Can losing lead to winning
    Berger, J.; Pope, D.
  • Status incentives
    Besley, T.; Ghatak, M.
  • The effects of feedback on judgmental interval predictions
    Bolger, F.; Önkal, D.
  • Managers and students as newsvendors
    Bolton, G.E.; Ockenfels, A.; Thonemann, U.W.
  • Relative payoffs and happiness: an experimental study
    Charness, G.; Grosskopf, B.
  • Understanding social preferences with simple tests
    Charness, G.; Rabin, M.
  • The dark side of competition for status
    Charness, G.; Masclet, D.; Villeval, M.C.
  • Sales forecasting practices: results from a United States survey
    Dalrymle, D.J.
  • Effects of externally mediated rewards on intrinsic motivation
    Deci, E.L.
  • Changes in intrinsic motivation as a function of negative feedback and threats
    Deci, E.L.; Cascio, W.F.
  • Deception and incentives: how dishonesty undermines effort provision
    Ederer, F.; Fehr, E.
  • Feedback and incentives: experimental evidence
    Eriksson, T.; Poulsen, A.; Villeval, M.C.
  • A theory of social comparison processes
    Festinger, L.
  • Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning
    Fildes, R.; Goodwin, P.; Lawrence, M.
  • z-Tree: Zurich toolbox for ready-made economic experiments
    Fischbacher, U.
  • Awards: a view from psychological economics
    Frey, B.S.; Neckermann, S.
  • Private versus public feedback – the incentive effects of symbolic awards
    Gerhards, L.; Siemer, N.
  • Class size and student performance: 1984–94
    Gibbs, G.; Lucas, L.; Simonite, V.
  • Forecasting: trials and tribulations
    Golden, J.; Milewicz, J.; Herbig, P.
  • Expectations, use and judgmental adjustment of external financial and economic forecasts: an empirical investigation
    Gönül, S.; Önkal, D.; Goodwin, P.
  • Judgmental forecasts of time series affected by special events: Does providing a statistical forecast improve accuracy
    Goodwin, P.; Fildes, R.
  • The effect of relative performance information on performance and effort allocation in a multi-task environment
    Hannan, R.L.; McPhee, G.P.; Newman, A.H.; Tafkov, I.D.
  • Forecasting regime switches to assist decision making
    Huarng, K.H.; Yu, H.T.
  • Grades and rank: impacts of nonfinancial incentives on test performance
    Jalava, N.; Joensen, J.S.; Pellas, E.
  • Choices, values, and frames
    Kahneman, D.; Tversky, A.
  • The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory
    Kluger, A.N.; DeNisi, A.
  • Demand forecasting behavior: system neglect and change detection
    Kremer, M.; Moritz, B.; Siemsen, E.
  • Feedback, self-esteem, and performance in organizations
    Kuhnen, C.M.; Tymula, A.
  • Judgmental forecasting: a review of progress over the last 25years
    Lawrence, M.; Goodwin, P.; O’Connor, M.; Önkal, D.
  • The effect of financial rewards on students’ achievement: evidence from a randomized experiment
    Leuven, E.; Oosterbeek, H.; Klaauw, B.
  • Judgemental adjustment of initial forecasts: its effectiveness and biases
    Lim, J.S.; O’Connor, M.
  • The impact of presentation media on decision making: does multimedia improve the effectiveness of feedback
    Lim, K.; O’Connor, M.; Remus, W.
  • Toward a theory of task motivation and incentives
    Locke, E.A.
  • The M3-Competition: results, conclusions and implications
    Makridakis, S.; Hibon, M.
  • A model of the determinants of achieved forecast accuracy
    Mentzer, J.T.; Cox, J.E.
  • Contests for status
    Moldovanu, B.; Sela, A.; Shi, X.
  • Judgmental forecasting: cognitive reflection and decision speed
    Moritz, B.; Siemsen, E.; Kremer, M.
  • Workaholics and dropouts in organizations
    Müller, W.; Schotter, A.
  • Top of the class: the importance of rank position
    Murphy, R.; Weinhardt, F.
  • Optimal properties of exponentially weighted forecasts
    Muth, J.F.
  • Going up–going down: how good are people at forecasting trends and changes in trends
    O’Connor, M.; Remus, W.; Griggs, K.
  • Judgmental adjustments of previously adjusted forecasts
    Önkal, D.; Gönül, M.S.; Lawrence, M.
  • Influence of differentiated roles on group forecasting accuracy
    Önkal, D.; Lawrence, M.; Sayım, K.Z.
  • Judgmental forecasting
    Önkal, D.; Thomson, M.; Pollock, A.C.; Clements, M.P.; Hendry, D.F.
  • Using a rolling training approach to improve judgmental extrapolations elicited from forecasters with technical knowledge
    Petropoulos, F.; Goodwin, P.; Fildes, R.
  • Does feedback improve the accuracy of recurrent judgmental forecasts
    Remus, W.; O’Connor, M.; Griggs, K.
  • The impact of incentives on the accuracy of subjects in judgmental forecasting experiments
    Remus, W.; O’Connor, M.; Griggs, K.
  • Effectiveness of sales forecasting methods
    Rothe, J.
  • Accuracy of judgemental forecasts: a comparison
    Sanders, N.
  • Forecasting software in practice: use, satisfaction, and performance
    Sanders, N.R.; Manrodt, K.B.
  • Closing the productivity gap: Improving worker productivity through public relative performance feedback and validation of best practices
    Song, H.; Tucker, A.L.; Murrell, K.L.; Vinson, D.R.
  • Awareness and use of forecasting techniques in British industry
    Sparkes, J.R.; McHugh, A.K.
  • A model of financial incentive effects in decision making
    Stone, D.N.; Ziebart, D.A.
  • Training to improve calibration and discrimination: the effects of performance and environmental feedback
    Stone, E.; Opel, R.
  • Self-definition: the impact of the relative performance and similarity of others
    Tesser, A.; Campbell, J.
  • Rank as an inherent incentive: evidence from a field experiment
    Tran, A.; Zeckhauser, R.
  • Forecasting: the key to managerial decision making
    Waddell, D.; Sohal, A.S.
  • Accuracy of judgmental extrapolation of time series data. Characteristics, causes, and remediation strategies for forecasting
    Welch, E.; Bretschneider, S.; Rohrbaugh, J.
  • Forecasting practice: a review of the empirical literature and an agenda for future research
    Winklhofer, H.; Diamantopoulos, A.; Witt, S.F.
  • A quantile regression forecasting model for ICT development
    Yu, H.T.
  • Rank Incentives: evidence from a randomized workplace experiment
    Barankay, I.