IC-798GPT-4 achieves 61.6% on MATH with tool-integrated reasoning prompting, exceeding PaL (51.8%) and CoT (42.5%)

Zhibin Gou, Zhihong Shao, Yeyun Gong, yelong shen, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen

SourceToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving

The paper evaluates GPT-4 on the MATH benchmark under three prompting strategies: chain-of-thought (CoT), program-aided language (PaL), and the tool-integrated reasoning format proposed by the authors. GPT-4's accuracy on MATH is 42.5% with CoT, 51.8% with PaL, and 61.6% with the tool-integrated format that interleaves natural language rationales with program execution. The tool-integrated format yields a 19.1-point improvement over CoT and a 9.8-point improvement over PaL. The paper states that 'the tool-integrated reasoning method used by tora significantly outperforms pal prompting when directly applied to the closed-source gpt-4.'

Evidence
correlational
Key metric
GPT-4 on MATH: 42.5% (CoT), 51.8% (PaL), 61.6% (tool-integrated reasoning); improvements of 19.1% and 9.8% respectively
Caveat
The tool-integrated reasoning format is the paper's own contribution applied via few-shot prompting; the 61.6% figure uses the paper's specific prompt design and up to 3 tool execution rounds.
Model
GPT-4 / ChatGPT4 / GPT-4 Code Interpreter / GPT-4 Technical Report
Datasets
MATH [eval]
Related work
GPT-4 / ChatGPT4 / GPT-4 Code Interpreter / GPT-4 Technical Report [context]
Related findings
IC-799
Extraction
automatic-extraction