The paper measures ImageNet top-1 accuracy of ResNet 18 and ViT B/16 after compressing their weights with JLCM at two compression rates. At 5.33x compression (approximately 3 bits), ResNet 18 achieves 62.939% and ViT B/16 achieves 80.558%. At 7.5x compression (approximately 2 bits), ResNet 18 drops to 41.779% and ViT B/16 to 69.996%. The authors report that JLCM reaches over 99% of the original ViT B/16 accuracy in its data-driven variant at 5.33x.
Evidence
correlational
Key metric
ResNet 18: 62.939% at 5.33x, 41.779% at 7.5x; ViT B/16: 80.558% at 5.33x, 69.996% at 7.5x
Caveat
Results depend on the calibration set size and the specific JLCM hyperparameters; the data-free initialization alone performs substantially worse than the full data-driven JLCM.