SourceThe Hidden Language of Diffusion Models
Conceptor decompositions reveal that SD links concepts based on visual properties rather than purely textual or semantic relationships. Examples include 'sweet peppers' linked to 'fingers' (common shape), 'camel' borrowing skin texture and color from 'cashmere,' 'snake' constructed as a 'twisted gecko,' 'bee' linked to 'wasp' and 'honey,' and 'corn' linked to 'maize' and 'comb.' These associations go beyond what would be expected from lexical or encyclopedic knowledge, suggesting the model's internal geometry is organised by visual features. The authors describe these as 'profound learned connections between concepts that transcend textual correlations.'