Iterative rule-guided reasoning over sparse knowledge graphs with deep reinforcement learning

作者:

Highlights:

• To the best of our knowledge, our proposed SparKGR constitutes the first iterative inference framework for sparse knowledge graph reasoning with reinforcement learning.

• SparKGR tightly integrates the embedding-based, rule-based, and path-based methods to perform effective reasoning over knowledge graphs.

• With our proposed dynamic path completion and iterative rule guidance strategies, the reinforcement learning agent in SparKGR explores efficiently in the process of interacting with knowledge graphs, and compensate for their incompleteness and sparsity.

摘要

•To the best of our knowledge, our proposed SparKGR constitutes the first iterative inference framework for sparse knowledge graph reasoning with reinforcement learning.•SparKGR tightly integrates the embedding-based, rule-based, and path-based methods to perform effective reasoning over knowledge graphs.•With our proposed dynamic path completion and iterative rule guidance strategies, the reinforcement learning agent in SparKGR explores efficiently in the process of interacting with knowledge graphs, and compensate for their incompleteness and sparsity.

论文关键词:Knowledge graphs,Deep reinforcement learning,Rule guidance,Iterative reasoning strategy

论文评审过程:Received 4 February 2022, Revised 15 July 2022, Accepted 20 July 2022, Available online 22 August 2022, Version of Record 22 August 2022.

论文官网地址:https://doi.org/10.1016/j.ipm.2022.103040