Multi-task Distributed Alignment Search / MDAS

anchor

Distributed Alignment Search fitted across several tasks at once, so the subspace found has to account for more than one behaviour.

Findings

• IC-003HyperDAS dynamically selects intervention tokens and learns linear subspaces in Llama3-8b that mediate entity attributes. [compared-to]