TM-012Longitude and time-of-year planes become circular in deeper encoder blocks

S. Kiedrzyński, M. Nowicki, M. Woliński

SourceGeometry of Geophysical Knowledge in TerraMind's Latent Space

GeoEx-extracted planes for longitude and time of year show increasingly circular organisation in deeper encoder blocks rather than displaying the same structure from the start.

Evidence
correlational
Caveat
Longitude and year progression were supplied to GeoEx as sine and cosine targets, so the experiment does not fully separate native latent circularity from structure selected by the supervised extraction. Random planes provide a partial control.
Model
TerraMind
Concepts
Circular representation, Depth-dependent structure
Methods
GeoEx feature-plane extraction [primary], Circular correlation [primary]
Related work
Not all language model features are one-dimensionally linear [builds-on]
Related findings
TM-011
Extraction
automatic-extraction