Tok-RAG

anchor

Token-level comparison of the generation with and without retrieval, used to decide per token whether retrieval helped or hurt.

Note

introduced by a paper already held in sources.yaml, so the anchor is that paper: "A Theory for Token-Level Harmonization in Retrieval-Augmented Generation", whose abstract proposes Tok-RAG as the paper's own method

Findings

• IC-034Benefit and detriment in RAG can be traded off at token level for Llama-2, OPT and Mistral using representation similarity [primary]