Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

作者:

Highlights:

• We propose a deep collaborative multi-task learning framework for hierarchical classification, where each prediction problem in the hierarchy is regarded as a sub-task to obtain multi-granularity intermediate predictions.

• To well utilize the relations among different sub-tasks, a novel fusion function is designed based on the confidence degree and the uncertainty degree, which can adaptively adjust the weights of the intermediate predictions from all the sub-tasks, acquiring better final predictions.

• We evaluate the performance of the proposed model on three image datasets. The experimental results demonstrate that considering the relations among different sub-tasks can improve the classification results, and our proposed model can achieve state-of-the-art performance.

摘要

•We propose a deep collaborative multi-task learning framework for hierarchical classification, where each prediction problem in the hierarchy is regarded as a sub-task to obtain multi-granularity intermediate predictions.•To well utilize the relations among different sub-tasks, a novel fusion function is designed based on the confidence degree and the uncertainty degree, which can adaptively adjust the weights of the intermediate predictions from all the sub-tasks, acquiring better final predictions.•We evaluate the performance of the proposed model on three image datasets. The experimental results demonstrate that considering the relations among different sub-tasks can improve the classification results, and our proposed model can achieve state-of-the-art performance.

论文关键词:Hierarchical image classification,Deep multi-task network,Collaborative learning,Decision uncertainty evaluation

论文评审过程:Received 20 November 2020, Revised 2 August 2021, Accepted 22 November 2021, Available online 25 November 2021, Version of Record 3 December 2021.

论文官网地址:https://doi.org/10.1016/j.patcog.2021.108449