IC-476GPT-4 and GPT-3.5 show strong positional bias in Chinese idiom character completion

Zeyuan Allen-Zhu, Yuanzhi Li

SourcePhysics of Language Models: Part 3.2, Knowledge Manipulation

The paper tests GPT-4 and GPT-3.5 on a task where a 4-character Chinese idiom has one character masked and the model must fill it in. The accuracy depends dramatically on which position is masked: for GPT-4, accuracy ranges from 17.6% (position 1) to 90.6% (position 4); for GPT-3.5, from 9.4% to 56.7%. The same three visible characters serve as evidence in all four cases, but the model's ability to recover the missing character depends on where the gap sits in the sequence. This demonstrates that the model's response to the same evidence depends on its position in the input.

Evidence
correlational
Key metric
GPT-4: 17.6% (pos 1), 36.1% (pos 2), 76.7% (pos 3), 90.6% (pos 4). GPT-3.5: 9.4% (pos 1), 29.5% (pos 2), 32.0% (pos 3), 56.7% (pos 4).
Caveat
The task uses a small set of common 4-character Chinese idioms; the paper does not report the number of test items or variance. The effect may partly reflect the autoregressive nature of the architecture (later positions have more context) rather than a general positional bias.
Model
GPT-4 / ChatGPT4 / GPT-4 Code Interpreter / GPT-4 Technical Report, GPT-3.5 / ChatGPT-3.5
Concepts
Positional bias
Related findings
IC-474, IC-475
Extraction
automatic-extraction