Spectral Clustering

Findings

• IC-1283CLIP's InfoNCE training objective is mathematically equivalent to performing generalized spectral clustering on the bipartite image-text pair graph [primary]
• IC-358GPT-2-small and Mistral 7B contain circular representations of days of the week and months of the year in their internal activations, discovered via SAE dictionary element clustering [supporting]
• IC-766Multiple Real-SR methods fail to outperform a small FSRCNN network on the majority of 100 representative degradation cases [supporting]