SourceDailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Life
The paper designs specialized system prompts for each of the 16 OpenAI ModelSpec principles, instructing GPT-4-turbo to prioritize either supporting or opposing values. Across all 16 principles, the model's value preferences do not shift in the intended direction. For example, under principle 13, the model favors supporting values (openness, respect) regardless of whether the prompt steers toward supporting or opposing values. Under principle 5, both modulations lead to a stronger preference toward supporting values (privacy) regardless of steering purpose. The model's inherent value tendencies resist prompt-based override.