ImageNet-V2

Findings

• IC-1469Progress on standard ImageNet generalization benchmarks is 2.5x faster than progress on crowdsourced global data (DollarStreet, GEODE) across 98 vision models [eval]
• IC-147CLIP's OOD performance on rendition domains is largely an artifact of domain contamination in its web-scale training data [eval]
• IC-643Conditioning CLIP on correct contextual attributes in the text prompt improves zero-shot classification accuracy across 13 image transformations [eval]