Poisson kernel: Avoiding self-smoothing in graph convolutional networks
作者:
Highlights:
• To the best of our knowledge, our work is the first to reveal the self-smoothing phenomenon of graph convolutional kernels in graph convolutional networks, which is a major vulnerability to reduce accuracy, robustness, and adaptability of trained models.
• We theoretically study how exactly different graph structures influence the performance of graph convolutional kernels, and several theorems about the properties and effects are given.
• By building an eigenvalue mapping of the symmetrically normalized adjacency matrix, we skillfully propose the Poisson kernel to avoid self-smoothing in graph convolutional networks without being sensitive to the parameter and dataset selections.
• Our results are evidently superior to state-of-the-art kernels on synthetic datasets with specific structures, where they will lead to severe self-smoothing inevitably. And in most situations, such as on three benchmark datasets (Cora, Citeseer and Pubmed), our Poisson kernel still works well and almost better without training any adaptive kernel.
摘要
•To the best of our knowledge, our work is the first to reveal the self-smoothing phenomenon of graph convolutional kernels in graph convolutional networks, which is a major vulnerability to reduce accuracy, robustness, and adaptability of trained models.•We theoretically study how exactly different graph structures influence the performance of graph convolutional kernels, and several theorems about the properties and effects are given.•By building an eigenvalue mapping of the symmetrically normalized adjacency matrix, we skillfully propose the Poisson kernel to avoid self-smoothing in graph convolutional networks without being sensitive to the parameter and dataset selections.•Our results are evidently superior to state-of-the-art kernels on synthetic datasets with specific structures, where they will lead to severe self-smoothing inevitably. And in most situations, such as on three benchmark datasets (Cora, Citeseer and Pubmed), our Poisson kernel still works well and almost better without training any adaptive kernel.
论文关键词:Graph convolutional kernel,Graph convolutional network,Graph neural network,Graph structure,Self-smoothing
论文评审过程:Received 13 July 2020, Revised 9 November 2021, Accepted 18 November 2021, Available online 22 November 2021, Version of Record 3 December 2021.
论文官网地址:https://doi.org/10.1016/j.patcog.2021.108443