SourceOne Hundred Neural Networks and Brains Watching Videos: Lessons from Alignment
Comparing the same four models trained on Kinetics-400 versus Something-Something-V2, a significant advantage of Kinetics-400 training is observed in FFA and OFA, with a similar pattern in LOC. This effect appears in both shallow and deep layers. Since Something-Something-V2 never shows faces and FFA is the functionally selective region for faces, this demonstrates that a training dataset bias (absence of a stimulus category) transfers to model-brain alignment in the corresponding functionally selective brain area. By contrast, training on Kinetics-710 (an extended version of Kinetics-400) largely has no effect on brain alignment.