Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Tracing Representation Progression: Analyzing and Enhancing Layer-Wise Similarity
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-547
Llama3.2 3B and Llama3.1 8B exhibit saturation events in which the top prediction, once it appears at a given layer, remains unchanged through all subsequent layers
IC-548
CLIP-B/32 exhibits progressively increasing layer-wise representation similarity in both its vision encoder and text encoder, and the pattern also holds across modalities