VScript: Controllable Script Generation with Visual Presentation

By Ziwei Ji, Yan Xu, I-Tsun Cheng, Samuel Cahyawijaya, Rita Frieske, Etsuko Ishii, Mini Zeng, Andrea Madotto, Pascale Fung. 2022

4 citations recorded by the source corpus.

In order to offer a customized script tool and inspire professional scriptwriters, we present VScript. It is a controllable pipeline that generates complete scripts, including dialogues and scene descriptions, as well as presents visually using video retrieval. With an interactive interface, our system allows users to select genres and input starting words that control the theme and development of the generated script. We adopt a hierarchical structure, which first generates the plot, then the script and its visual presentation. A novel approach is also introduced to plot-guided dialogue generation by treating it as an inverse dialogue summarization. The experiment results show that our approach outperforms the baselines on both automatic and human evaluations, especially in genre control.

Subfields: Artificial Intelligence, Information Systems, Software, Natural Language Processing, Generative Models

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Pascale Fung
  2. Andrea Madotto
  3. Wenliang Dai
  4. Nayeon Lee
  5. Yan Xu
  6. Etsuko Ishii
  7. Ziwei Ji
  8. Dan Su

In Information Systems

  1. Tiezheng Yu
  2. Nayeon Lee
  3. Pascale Fung
  4. Wenliang Dai
  5. Michael Castelle

In Natural Language Processing

  1. Pascale Fung
  2. Nayeon Lee
  3. Andrea Madotto
  4. Etsuko Ishii
  5. Yejin Bang
  6. Yan Xu
  7. Rita Frieske
  8. Dan Su

In Generative Models

  1. Dan Su
  2. Andrea Madotto
  3. Pascale Fung

Citations in the corpus