Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
WebQuestions / Complex WebQuestions
anchor
Note
no anchor recorded: the extractor captured no citation for this entry, and the citing paper's reference entry was never read. The paper does cite it, so this is a gap in our extraction rather than in the source
Findings
IC-034
Benefit and detriment in RAG can be traded off at token level for Llama-2, OPT and Mistral using representation similarity
[eval]
IC-1386
Fact recall in OPT and LLaMA models degrades by more than 5% relative accuracy when more than 30% of weights are pruned, and similarly when moving from the 30B to the 13B dense model
[eval]