SourceDailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Life
The paper compares Llama-3-70B base and instruct models on the DailyDilemmas dataset. The instruct model shows a stronger preference for positive emotion values (joy, anticipation, optimism) and a weaker preference for negative emotion values (sadness) compared to the base model, likely due to RLHF during post-training. However, cultural preferences (World Values Survey dimensions) remain nearly identical between base and instruct: the base model prefers traditional values at 3.64% while the instruct model prefers them at 0.08%, with other dimensions showing similar distributions. Additionally, Llama-2-70B and Mixtral-8x7B base models fail to answer dilemmas at all, while Llama-3-70B base can follow the instruction.