Info-RAG

anchor

Unsupervised training that teaches a model to use retrieved passages as information rather than as answers to copy.

Findings

• IC-034Benefit and detriment in RAG can be traded off at token level for Llama-2, OPT and Mistral using representation similarity [compared-to]