IC-1602ResNet18, ResNet34, and MobileNetV2 pre-trained on CIFAR10 have decision functions well-approximated by a kernel machine using the trace NTK, with Kendall-τ correlations of 0.776, 0.786, and 0.700

Andrew William Engel, Zhichao Wang, Natalie Frank, Ioana Dumitriu, Sutanay Choudhury, Anand Sarwate, Tony Chiang

SourceFaithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models

The paper computes the trace neural tangent kernel (trntk) for three pre-trained CIFAR10 classifiers and trains a kernel general linear model (KGLM) on the same training data. Faithfulness is measured by Kendall-τ rank correlation between the KGLM's and the NN's softmax probabilities for the correct class, plus test accuracy differential. All three models show high correlation (0.700–0.786) and near-zero accuracy differentials (−0.28% to −0.4%), indicating the trntk KGLM faithfully reproduces the NN's decision function. Among six kernel functions compared for ResNet18, the trntk achieves the highest τk (0.776) versus trntk0 (0.658), proj-trntk (0.737), proj-pntk (0.407), embedding kernel (0.768), and conjugate kernel (0.630).

Evidence
correlational
Key metric
τk = 0.776 (ResNet18), 0.786 (ResNet34), 0.700 (MobileNetV2); TAD = −0.28%, −0.29%, −0.4%; ResNet18 kernel comparison: trntk 0.776, trntk0 0.658, proj-trntk 0.737, proj-pntk 0.407, em 0.768, ck 0.630
Caveat
The trntk computation for ResNet18 took 389 GPU-hours; the paper notes the layerwise computation may be sub-optimal. Kendall-τ only uses the correct-class logit, not the full softmax vector.
Model
ResNet / ResNet-152 / ResNet-101 / ResNet-50-BN ResNet-18, ResNet-34, MobileNetV2
Concepts
Explanation faithfulness
Datasets
CIFAR-10 [eval]
Related work
TRAK [builds-on]
Related findings
IC-1603
Extraction
automatic-extraction