ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving

By Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen. 2023

314 citations recorded by the source corpus.

Large language models have made significant progress in various language tasks, yet they still struggle with complex mathematics. In this paper, we propose ToRA a series of Tool-integrated Reasoning Agents designed to solve challenging mathematical problems by seamlessly integrating natural language reasoning with the utilization of external tools (e.g., computation libraries and symbolic solvers), thereby amalgamating the analytical prowess of language and the computational efficiency of tools. To train ToRA, we curate interactive tool-use trajectories on mathematical datasets, apply imitation learning on the annotations, and propose output space shaping to further refine models' reasoning behavior. As a result, ToRA models significantly outperform open-source models on 10 mathematical reasoning datasets across all scales with 13%-19% absolute improvements on average. Notably, ToRA-7B reaches 44.6% on the competition-level dataset MATH, surpassing the best open-source model WizardMath-70B by 22% absolute. ToRA-Code-34B is also the first open-source model that achieves an accuracy exceeding 50% on MATH, which significantly outperforms GPT-4's CoT result, and is competitive with GPT-4 solving problems with programs. Additionally, we conduct a comprehensive analysis of the benefits and remaining challenges of tool interaction for mathematical reasoning, providing valuable insights for future research.

Subfields: Artificial Intelligence, Developmental and Educational Psychology, Prompting & Reasoning, LLM Agents & Tool Use

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Can Xu
  2. Tianyi Zhou
  3. Damai Dai
  4. Tao Shen
  5. Dacheng Tao
  6. Peiyi Wang
  7. Zhihong Shao
  8. Bo Zhang

In Developmental and Educational Psychology

  1. Dacheng Tao
  2. Yu Wu

In Prompting & Reasoning

  1. Damai Dai
  2. Zhihong Shao
  3. Daya Guo
  4. Zhifang Sui
  5. Lei Li

Citations in the corpus