Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Can In-context Learning Really Generalize to Out-of-distribution Tasks?
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-164
Llama-3-8B and Llama-2-7B fail to learn out-of-distribution functions through in-context learning, defaulting to in-distribution predictions
IC-165
Llama-3-8B performs algorithm selection during in-context learning, selecting the classification criterion with the lowest test error on ambiguous natural language tasks