Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian Distribution
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-122
Concept representations in Llama-2-7B, Gemma-7B, and Llama-2-13B become more consistent in deeper layers
IC-123
Llama-2-7B, Gemma-7B, and Llama-2-13B organize 16 concepts into hierarchical clusters in their representation space that reflect real-world category structure