SourceNeurFlow: Interpreting Neural Networks through Neuron Groups and Functional Interactions
Using NeurFlow to identify neuron groups in layer 4.2 of ResNet50 for the 'bee' class, the authors find three concept groups: 'pink petals', 'green background', and 'bee'. Most false-positive images (non-bee images classified as bee) score high on the 'petal' and 'green background' groups. Masking all neurons in the petal or green-background groups drastically distorts the prediction probability away from 'bee', while masking an equal number of random neurons yields negligible changes. This causally confirms the flower-petal bias previously identified correlationaly by Kim et al. (2024) and additionally reveals a 'green background' bias not reported in that prior work.