Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
On the Variance of Neural Network Training with respect to Test Sets and Distributions
2024-01-16
· ICLR 2024 poster ·
anchor
Findings
IC-1431
BERT-base fine-tuning has negligible distribution-wise variance (0.21%) while BERT-large fine-tuning has substantial distribution-wise variance (2.08%) on MRPC