Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Reassessing How to Compare and Improve the Calibration of Machine Learning Models
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-295
The ViT model's ECE can be reduced to near-zero by trivial mean-replacement recalibration while maintaining test accuracy, but NLL increases from 65.35 to 144.66, demonstrating that ECE and accuracy alone are an insufficient reporting standard for calibration