Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Mechanistic Permutability: Match Features Across Layers
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-205
Gemma 2's SAE features exhibit depth-dependent organization, with polysemantic features in early layers and persistent, matchable features in later layers