Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Capability Localization: Capabilities Can be Localized rather than Individual Knowledge
2025-01-22
· ICLR 2025 Poster ·
anchor
Findings
IC-381
Individual knowledge is not parameter-localizable in GPT-J: existing localization methods (KN, ROME, KC) are neither faithful nor reliable
IC-382
Data commonalities are localizable to a small set of capability neurons in Llama2-7B, Llama2-13B, and GPT-J-6B, and these neurons enhance or degrade performance when manipulated