Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Teaching Arithmetic to Small Transformers
2024-01-16
· ICLR 2024 poster ·
anchor
Findings
IC-1205
GPT-3 models (ada, curie, davinci) achieve near-zero accuracy on zero-shot arithmetic tasks but learn them rapidly with 1000 fine-tuning samples