Evaluation: turning technology Report of the Working Vicki L. Almstrum (joint chair), Nell Dale The University of Texas at Austin, USA from toy to tool Diane M. Miller Group on Evaluation University of Southern Mississippi, USA {almstrum, ndale}@cs.utexas. Anders Berglund Uppsala University, Sweden edu dmmiller@medea. gp.usm.edu Marian Petre (joint chair) Open University, UK andersb@docs. uu.se Mary Granger The George Washington University, USA M. Petre@open.ac.uk Paul Schragger Villanova University, USA granger@gwuvm.gwu .edu Joyce Currie Little Towson State University, USA schragge@monet. vilI.edul Fred Springsteel University of Missouri, USA jclittle @midget. towson.edu Abstract Evaluation is an educational process, not an end in itselfi we learn in order to help our students learn. This paper presents a pragmatic perspective on evaluation, viewing it as a matter of trade-offs. The space of possible evaluation approaches is analysed in terms of trade-offs among desired evidence, costs, and other constraints. This approach is illustrated with example scenarios and a list of selected resources is provided. csfreds @mizzoul .missouri.edu seen as an expensive, time-consuming, esoteric process with little practical relevance. But principled, practical evaluation empirical study of actual practice, perhaps within a tightly focused question or a particular task can identify crucial issues, debunk inappropriate
/lp/association-for-computing-machinery/evaluation-turning-technology-from-toy-to-tool-report-of-the-working-lmBHc8Eyc0