TREC-8 Interactive Track William Hersh hersh@ohsu.edu Division of Medical Informatics & Outcomes Research Oregon Health Sciences University Portland, OR 97201, USA Paul Over over@nist.gov Natural Language Processing and Information Retrieval Group Information Access and User Interfaces Division National Institute of Standards and Technology Gaithersburg, MD 20899, USA April 5, 2000 For T R E C - 8 the high-level goal of the Interactive Track remained the investigation of searching as an interactive task by examining the process as well as the outcome. To this end a common experimental framework was designed with the following features: ¢ an interactive search task - a form of question answering ¢ 6 topics - brief statements of information need ¢ 12 searchers - a minimum, more if possible ¢ a document collection to be searched: Financial Times of London 1991-4 with 210,158 articles totaling 564 megabytes. ¢ a required set of searcher questionnaires ¢ 5 classes of data to be collected at each site and submitted to NIST ¢ 3 summary measures to be calculated by NIST for use by participating groups The experimental design allowed groups to estimate the effect of their experimental manipulation free and clear of the main (additive)
/lp/association-for-computing-machinery/trec-8-interactive-track-cvelzSWWLy