Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Where We Have Arrived in Proving the Emergence of Sparse Interaction Primitives in DNNs
2024-01-16
· ICLR 2024 poster ·
anchor
Findings
IC-663
OPT-1.3B, LLaMA-7B, and Aquila-7B encode sparse Harsanyi interactions, with only 29-51 salient interactions out of 1024 possible on SQuAD sentences