Information retrieval evaluation in practice: A case study approach
作者:
Highlights:
•
摘要
The evaluation of information retrieval systems is an important yet difficult operation. This paper describes an exploratory evaluation study that takes an interpretive approach to evaluation. The longitudinal study examines evaluation through the information-seeking behaviour of 22 case studies of ‘real’ users. The eclectic approach to data collection produced behavioral data that is compared with relevance judgments and satisfaction ratings. The study demonstrates considerable variation among the cases, among different evaluation measures within the same case, and among the same measures at different stages within a single case. It is argued that those involved in evaluation should be aware of the difficulties, and base any evaluation on a good understanding of the cases in question.
论文关键词:
论文评审过程:Received 14 September 1992, Accepted 29 April 1993, Available online 18 July 2002.
论文官网地址:https://doi.org/10.1016/0306-4573(94)90065-5