Modelpedia
Work in progress
About
Findings
Models
Concepts
Methods
Datasets
Sources
Light
Dark
Data-independent Module-aware Pruning for Hierarchical Vision Transformers
2024-01-16
· ICLR 2024 poster ·
anchor
Findings
IC-709
Swin Transformer parameter redundancy is depth-dependent, with higher layers retaining fewer parameters than lower layers under module-aware pruning