Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression
2024-01-16
· ICLR 2024 spotlight ·
anchor
Findings
IC-746
RoBERTa-Large pretrained with different mask ratios exhibits a sweet spot in downstream accuracy on QNLI and SST-2