SourceLarge Language Models Cannot Self-Correct Reasoning Yet
The paper replicates the constrained generation task from Madaan et al. (2023) using GPT-3.5-turbo-0613. With the original prompt that omits the instruction to include all concepts, self-correction appears to improve concept coverage from 44.0 to 67.0. However, when the constraint is explicitly stated in the initial prompt, standard prompting already achieves 81.8, and applying the same self-correction procedure drops performance to 75.1. The authors conclude the reported improvement was due to the feedback prompt supplying missing task information, not to the model's self-correction ability.