Trip Report Evaluation of Human Computer Interfaces A Reportfrom an ARPAWorkshop Lynette Hirschmanand DonnaCuomo This report summarizes a two and a half day workshop sponsored by Dr Craig Wier, Program Manager fbr the ARPA HCI program and organized and chaired by the authors (both of MITRE Corporation). The workshop took place~om March 30 through April 1, 1994 at the MITRE Corporation in Bed~brd, Massachusetts. different perspectives and different evaluation methodologies. Empirical evaluation metrics have been a major driver behind the recent rapid advances in various ARPA programs, particularly in the speech and language understanding areas. As language understanding technologies are increasingly combined with graphics-based and visual technologies to support human-computer interaction, an enormous challenge emerges. There are no agreed upon evaluation methodologies or supporting technologies for such complex interactive interfaces, and it is not obvious how to evaluate them. We suspect that some existing evaluation methods can work with adaptations, but is not yet clear what coverage such methods will provide, nor which methods will prove most useful. Interdisciplinary skills are required for proposing candidate evaluation methodologies. This workshop was intended as a first step towards establishing such methodologies and the appropriate infrastructure supports. To prepare for the
/lp/association-for-computing-machinery/evaluation-of-human-computer-interfaces-a-report-from-an-arpa-workshop-D6sTjK1Ufq