Weight orthogonalization

anchor

Remove a direction from a model's weights so the behaviour it mediates cannot be expressed, used in the corpus to suppress refusal.

Findings

• IC-012Sparse autoencoders uncover entity recognition directions in Gemma 2 and Llama 3.1 models that are causally relevant for knowledge refusal. [primary]