Evaluating document filtering systems over time
作者：
Highlights：
• We propose a new way of measuring document filtering system performance over time.
• Performance is calculated per batch and a trend line is fitted to the results.
• Systems are compared by their performance at the end of the evaluation period.
• Important insights emerge by re-evaluating TREC KBA CCR runs of 2012 and 2013.
摘要
•We propose a new way of measuring document filtering system performance over time.•Performance is calculated per batch and a trend line is fitted to the results.•Systems are compared by their performance at the end of the evaluation period.•Important insights emerge by re-evaluating TREC KBA CCR runs of 2012 and 2013.
论文关键词：Time-aware information retrieval,Evaluation,Significance testing
论文评审过程：Received 22 September 2014, Revised 8 February 2015, Accepted 27 March 2015, Available online 12 June 2015, Version of Record 27 October 2015.
论文官网地址：https://doi.org/10.1016/j.ipm.2015.03.005
