Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
The Geometry of Categorical and Hierarchical Concepts in Large Language Models
2025-01-22
· ICLR 2025 Oral ·
anchor
Findings
IC-346
Hierarchical and categorical concepts from WordNet are linearly represented in the final-layer space of Gemma-2b and Llama-3-8B, with semantic hierarchy encoded as orthogonality and categorical concepts as polytopes