IC-1440GCN, GAT, GraphSAGE, and SGC exhibit structure-dependent generalization in transductive node classification: test nodes with shorter paths to training nodes are classified more accurately

Jiawei Sun, Kailai Li, Ruoxin Chen, Jie LI, Chentao Wu, Yue Ding, Junchi Yan

SourceInterpGNN: Understand and Improve Generalization Ability of Transdutive GNNs through the Lens of Interplay between Train and Test Nodes

The paper groups test nodes by their shortest path length to the nearest training node (l-hop interplay) and measures classification accuracy per group. Across Cora, Citeseer, and PubMed, all four message-passing GNNs show a monotonic increase in accuracy as interplay increases (i.e., as test nodes get closer to training nodes). The same trend holds when grouping by node degree, with lower-degree nodes (fewer interactions with training nodes) performing worse. This empirical pattern is used to validate the paper's PAC-Bayesian bound linking generalization error to l-hop interplay.

Evidence
observational
Caveat
The specific per-group accuracy values are reported only in figures (Figures 1 and 2), not in the text or tables. The trend is described qualitatively in the text as 'for test nodes exhibiting stronger interplay with training nodes, the generalization error is smaller.'
Model
GCN, GAT, GraphSAGE, SGC
Concepts
Failure mode
Datasets
Cora [eval], Citeseer [eval], PubMed [eval]
Methods
PAC-Bayesian Analysis [primary]
Related findings
IC-1441
Extraction
automatic-extraction