AlpacaEval 2

anchor

Findings

• IC-169BT-based, DPO-based reward models, and GPT-4 as judge all exhibit significant length bias, with their scores correlating with output length rather than quality [eval]