Evaluation of text summaries without human references based on the linear optimization of content metrics using a genetic algorithm

作者:

Highlights:

• The proposed evaluation provides a better correlation than state-of-the-art methods.

• 31 state-of-the-art metrics are combined to generate an optimized evaluation metric.

• The proposed evaluation method enables a balanced correlation improvement.

• The relevance of evaluation metrics presents a direct relation of individual correlation.

• State-of-the-art metrics with higher correlations improve the resultant final rank.

摘要

•The proposed evaluation provides a better correlation than state-of-the-art methods.•31 state-of-the-art metrics are combined to generate an optimized evaluation metric.•The proposed evaluation method enables a balanced correlation improvement.•The relevance of evaluation metrics presents a direct relation of individual correlation.•State-of-the-art metrics with higher correlations improve the resultant final rank.

论文关键词:Evaluation of text summaries,Linear optimization of content metrics,Genetic algorithm,ROUGE-C,Latent semantic analysis,Jensen-Shannon divergence

论文评审过程:Received 24 June 2019, Revised 30 July 2020, Accepted 31 July 2020, Available online 8 August 2020, Version of Record 10 February 2021.

论文官网地址:https://doi.org/10.1016/j.eswa.2020.113827