PromptChainer: Chaining Large Language Model Prompts through Visual Programming

By Tongshuang Sherry Wu, Ellen Jiang, Aaron Donsbach, J. Gray, A. Molina, Michael Terry, Carrie J. Cai. 2022

301 citations recorded by the source corpus.

While LLMs have made it possible to rapidly prototype new ML functionalities, many real-world applications involve complex tasks that cannot be easily handled via a single run of an LLM. Recent work has found that chaining multiple LLM runs together (with the output of one step being the input to the next) can help users accomplish these more complex tasks, and in a way that is perceived to be more transparent and controllable. However, it remains unknown what users need when authoring their own LLM chains – a key step to lowering the barriers for non-AI-experts to prototype AI-infused applications. In this work, we explore the LLM chain authoring process. We find from pilot studies that users need support transforming data between steps of a chain, as well as debugging the chain at multiple granularities. To address these needs, we designed PromptChainer, an interactive interface for visually programming chains. Through case studies with four designers and developers, we show that PromptChainer supports building prototypes for a range of applications, and conclude with open questions on scaling chains to even more complex tasks, as well as supporting low-fi chain prototyping.

Subfields: Artificial Intelligence, Health Informatics, Safety Research, Prompting & Reasoning, LLM Agents & Tool Use

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Percy Liang
  3. Luke S. Zettlemoyer
  4. Yejin Choi
  5. Jianfeng Gao
  6. Chitta Baral
  7. Xipeng Qiu
  8. Hannaneh Hajishirzi

In Health Informatics

  1. Swaroop Mishra
  2. Meredith Ringel Morris
  3. Percy Liang
  4. Joon Sung Park

In Safety Research

  1. Percy Liang
  2. Michael S. Bernstein
  3. Timo Schick
  4. Richmond Y. Wong

In Prompting & Reasoning

  1. Swaroop Mishra
  2. Chitta Baral
  3. Mihir Parmar
  4. Percy Liang
  5. Man Luo
  6. Qian Yang
  7. J.D. Zamfirescu-Pereira
  8. Bjoern Hartmann

In LLM Agents & Tool Use

  1. Swaroop Mishra
  2. Mihir Parmar
  3. Chitta Baral
  4. Man Luo
  5. Percy Liang
  6. Qian Yang
  7. J.D. Zamfirescu-Pereira
  8. Bjoern Hartmann

Citations in the corpus