Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Eliminating Position Bias of Language Models: A Mechanistic Approach
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-391
Llama-3 and Qwen-1.5 models exhibit position bias in LM-as-a-judge, retrieval-augmented QA, and math reasoning, with larger models showing less bias
IC-392
Fuyu-8B and GPT-4V exhibit position bias in visual recognition, with model performance depending on where the target object appears in the image