Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Contribute
Light
Dark
A Grammar of Kalamang
Report a problem with this record
anchor
Findings
IC-1508
LLMs with in-context learning translate Kalamang-English at 44.7/45.8 CHRF, falling short of the human baseline of 51.6/57.0 CHRF
[source]
IC-1510
Without retrieved context, LLMs are unable to translate Kalamang, and among context types, retrieved parallel sentences are most beneficial, followed by word list entries, then grammar book passages
[source]