SourceInterpretable Diffusion via Information Decomposition
The paper applies an information-theoretic score (pointwise mutual information i^o) to Stable Diffusion v2.1 on the ARO benchmark and obtains substantially higher accuracy than the MMSE-based DiffITM score. On VG-A, VG-R, COCO, and Flickr30k the information score yields 72.0, 69.1, 40.1, and 49.3 percent, compared to 62.9, 50.0, 23.5, and 33.2 for DiffITM. Because the text encoder is frozen and shared with OpenCLIP, the authors attribute the improvement over OpenCLIP (64.6, 51.4, 32.8, 40.5) to the denoising objective and visual component. The authors conclude that previous work using MMSE as a proxy for alignment systematically underestimates diffusion models' compositional understanding.