Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

What do practitioners expect from an evaluation report? A qualitative analysis of Dutch crisis management professionals' expectations

What do practitioners expect from an evaluation report? A qualitative analysis of Dutch crisis... This paper seeks to overcome the mismatch between evaluation reports and the expectations of the target audience, by identifying crisis management professionals' expectations.Design/methodology/approachAn adapted stakeholder information analysis was used to survey the expectations of 84 crisis management professionals in the Netherlands. A general inductive analysis was applied to qualitative data, from which five main themes emerged: purpose; object or focus; reasoning and (meta) analysis; result or conclusion, and the overall design of the evaluation.FindingsCurrently, evaluation reports are seen merely as a way to share experience and support thinking about how to avoid repeating mistakes. However, most respondents expected them to contribute to learning and support improvement. They should provide actionable feedback on what could be done differently or better, and indicate how this can be achieved. Respondents emphasised the need to focus on the human factor and not neglect the context. The wide variety of views underlined that it is difficult to create one evaluation product that meets all expectations.Research limitations/implicationsAlthough some major themes clearly emerged from the data, it is unclear how they relate to each other, and their relative importance. In addition, no distinction is made between evaluations of real events and simulations.Practical implicationsUsers should be encouraged to provide input into the evaluation process by clarifying their needs and how they use evaluation reports.Originality/valueThis research is the first attempt to identify user expectations regarding what constitutes an effective evaluation. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png International Journal of Emergency Services Emerald Publishing

What do practitioners expect from an evaluation report? A qualitative analysis of Dutch crisis management professionals' expectations

Download PDF
25 pages

Loading next page...
 
/lp/emerald-publishing/what-do-practitioners-expect-from-an-evaluation-report-a-qualitative-SX1FHNzosJ

References (41)

Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
2047-0894
DOI
10.1108/ijes-12-2019-0063
Publisher site
See Article on Publisher Site

Abstract

This paper seeks to overcome the mismatch between evaluation reports and the expectations of the target audience, by identifying crisis management professionals' expectations.Design/methodology/approachAn adapted stakeholder information analysis was used to survey the expectations of 84 crisis management professionals in the Netherlands. A general inductive analysis was applied to qualitative data, from which five main themes emerged: purpose; object or focus; reasoning and (meta) analysis; result or conclusion, and the overall design of the evaluation.FindingsCurrently, evaluation reports are seen merely as a way to share experience and support thinking about how to avoid repeating mistakes. However, most respondents expected them to contribute to learning and support improvement. They should provide actionable feedback on what could be done differently or better, and indicate how this can be achieved. Respondents emphasised the need to focus on the human factor and not neglect the context. The wide variety of views underlined that it is difficult to create one evaluation product that meets all expectations.Research limitations/implicationsAlthough some major themes clearly emerged from the data, it is unclear how they relate to each other, and their relative importance. In addition, no distinction is made between evaluations of real events and simulations.Practical implicationsUsers should be encouraged to provide input into the evaluation process by clarifying their needs and how they use evaluation reports.Originality/valueThis research is the first attempt to identify user expectations regarding what constitutes an effective evaluation.

Journal

International Journal of Emergency Services – Emerald Publishing

Published: Apr 6, 2021

Keywords: Crisis; Disaster; Emergency; Response; Exercise; Simulation; Evaluation; Survey; Expectations; The Netherlands; Usefulness; Evaluation design; Evaluation report

There are no references for this article.