FairerCLIP: Debiasing CLIP's Zero-Shot Predictions using Functions in RKHSs

2024-01-16 · ICLR 2024 poster · anchor

Findings

IC-834CLIP zero-shot predictions exhibit high equal opportunity difference when target and sensitive attributes are intrinsically dependent
IC-835CLIP zero-shot predictions exhibit large worst-group accuracy gaps due to spurious correlations on Waterbirds and CelebA
IC-836CLIP zero-shot predictions exhibit demographic bias on FairFace when using attribute-unrelated text prompts
IC-837CLIP ViT-L/14 embeds more target-attribute information and less sensitive-attribute information than CLIP ResNet-50 on Waterbirds