ES-GNN: Generalizing Graph Neural Networks Beyond Homophily With Edge Splitting

Jingwei Guo, Kaizhu Huang*, Rui Zhang, Xinping Yi

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Plum Print visual indicator of research metrics
  • Captures
    • Readers: 8
  • Mentions
    • News Mentions: 1
see details

Abstract

While Graph Neural Networks (GNNs) have achieved enormous success in multiple graph analytical tasks, modern variants mostly rely on the strong inductive bias of homophily. However, real-world networks typically exhibit both homophilic and heterophilic linking patterns, wherein adjacent nodes may share dissimilar attributes and distinct labels. Therefore, GNNs smoothing node proximity holistically may aggregate both task-relevant and irrelevant (even harmful) information, limiting their ability to generalize to heterophilic graphs and potentially causing non-robustness. In this work, we propose a novel Edge Splitting GNN (ES-GNN) framework to adaptively distinguish between graph edges either relevant or irrelevant to learning tasks. This essentially transfers the original graph into two subgraphs with the same node set but complementary edge sets dynamically. Given that, information propagation separately on these subgraphs and edge splitting are alternatively conducted, thus disentangling the task-relevant and irrelevant features. Theoretically, we show that our ES-GNN can be regarded as a solution to a disentangled graph denoising problem, which further illustrates our motivations and interprets the improved generalization beyond homophily. Extensive experiments over 11 benchmark and 1 synthetic datasets not only demonstrate the effective performance of ES-GNN but also highlight its robustness to adversarial graphs and mitigation of the over-smoothing problem.

Original languageEnglish
Pages (from-to)11345-11360
Number of pages16
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume46
Issue number12
DOIs
Publication statusPublished - 2024

Keywords

  • disentangled representation learning
  • graph mining
  • Graph neural networks
  • heterophilic graphs

Fingerprint

Dive into the research topics of 'ES-GNN: Generalizing Graph Neural Networks Beyond Homophily With Edge Splitting'. Together they form a unique fingerprint.

Cite this

Guo, J., Huang, K., Zhang, R., & Yi, X. (2024). ES-GNN: Generalizing Graph Neural Networks Beyond Homophily With Edge Splitting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(12), 11345-11360. https://doi.org/10.1109/TPAMI.2024.3459932