SourceNeuron-based Multifractal Analysis of Neuron Interaction Dynamics in Large Models
The paper extends NeuroMFA to non-transformer architectures. ResNet-18's spectral graph lacks a regular bell-shaped structure, indicating no clear multifractal structure or self-organization. ResNet-152 displays a noticeable multifractal structure but with irregular horizontal shifts, suggesting a stable self-organized structure did not form. A 160M diffusion model (Stable Diffusion) shows a lower degree of emergence than Pythia 160M at the same parameter size, indicating a lower level of emergent abilities for the CV task compared to the NLP task.