StackExchange

anchor

Findings

• IC-930StackLLama, when used as a reward model, achieves near-random consistency on contrast instructions for the Stack Exchange task [source]
• IC-931GPT-4 achieves approximately 95% accuracy on contrast instructions, far exceeding human performance without tools [source]