Gorilla: Large Language Model Connected with Massive APIs

By Shishir G. Patil, Tianjun Zhang, Xin Wang, Joseph E. Gonzalez. 2023

1,419 citations recorded by the source corpus.

Large Language Models (LLMs) have seen an impressive wave of advances recently, with models now excelling in a variety of tasks, such as mathematical reasoning and program synthesis. However, their potential to effectively use tools via API calls remains unfulfilled. This is a challenging task even for today's state-of-the-art LLMs such as GPT-4, largely due to their inability to generate accurate input arguments and their tendency to hallucinate the wrong usage of an API call. We release Gorilla, a finetuned LLaMA-based model that surpasses the performance of GPT-4 on writing API calls. When combined with a document retriever, Gorilla demonstrates a strong capability to adapt to test-time document changes, enabling flexible user updates or version changes. It also substantially mitigates the issue of hallucination, commonly encountered when prompting LLMs directly. To evaluate the model's ability, we introduce APIBench, a comprehensive dataset consisting of HuggingFace, TorchHub, and TensorHub APIs. The successful integration of the retrieval system with Gorilla demonstrates the potential for LLMs to use tools more accurately, keep up with frequently updated documentation, and consequently increase the reliability and applicability of their outputs. Gorilla's code, model, data, and demo are available at https://gorilla.cs.berkeley.edu

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Cultural Studies, Large Language Models, LLM Agents & Tool Use

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Zhiyuan Liu
  2. Maosong Sun
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Dacheng Tao
  6. Percy Liang
  7. Luke S. Zettlemoyer
  8. Graham Neubig

In Computer Vision and Pattern Recognition

  1. Dacheng Tao
  2. Luc Van Gool
  3. Jie Zhou
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Ming-Hsuan Yang
  7. Bernt Schiele
  8. Jitendra Malik

In Cultural Studies

  1. Amirhossein Nadiri
  2. Yashar Talebirad

In Large Language Models

  1. Amirhossein Nadiri
  2. Yashar Talebirad
  3. Maosong Sun
  4. Ion Stoica
  5. Naman Jain
  6. Tianjun Zhang
  7. Zhiyuan Liu
  8. Huan Sun

In LLM Agents & Tool Use

  1. Amirhossein Nadiri
  2. Yashar Talebirad
  3. Maosong Sun
  4. Oriana Riva
  5. Timothy P. Lillicrap
  6. Jie Zhou
  7. Zhiyuan Liu

Citations in the corpus