Structural Probing

anchor

Findings

• IC-426MultiBERTs exhibit a pushdown phenomenon where syntactic information migrates from later to earlier layers as training progresses [primary]