Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability
2024-01-16
· ICLR 2024 poster ·
anchor
Findings
IC-985
LLaMA-2-7B plateaus in ICL accuracy and fails to override semantic priors when in-context labels are flipped on a simple happy/sad classification task