Attention knockout

anchor

Block attention from one set of positions to another and measure the loss of information flow, used to locate which positions a prediction depends on.

Findings

• IC-020LLaVA-1.5 extracts object information directly from visual tokens to the last token in mid-late layers [primary]