Vicuna Bench

anchor

Findings

• IC-717Llama-2-Chat's evaluation capability does not improve monotonically with model size [eval]
• IC-718GPT-4 achieves 0.882 Pearson correlation with human evaluators on 45 customized score rubrics while GPT-3.5-Turbo achieves only 0.392 [eval]