Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Contribute
Light
Dark
Proof-Pile
Report a problem with this record
anchor
Findings
IC-1558
Code LLaMA 13B maintains 99.4% passkey retrieval at 128k context despite perplexity rising from 2.37 to 2.54 between 98304 and 131072 tokens
[eval]