Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Language Models Represent Space and Time
2024-01-16
· ICLR 2024 poster ·
anchor
Findings
IC-1317
Llama-2 and Pythia models contain linear representations of space and time that improve with depth and model scale
IC-1318
Individual space and time neurons in Llama-2-7B causally contribute to spatial and temporal predictions