Safely Partial-Parameter Fine-Tuning / SPPFT (Safely Partial Parameter Fine-Tuning)

anchor

Fine-tuning restricted to a subset of parameters chosen so that safety behaviour learned earlier is not overwritten.

Findings

• IC-022Safety layers in Llama-2-chat-7b show substantial divergence during VL adaptation, correlating with safety degradation [validation]