Mutual Nearest-Neighbor Kernel Alignment

Findings

IC-578LLMs encode input text as linearly separable representations in forerunner token hidden states, emerging in early layers and enhanced by in-context demonstrations [primary]