De-Confounded Variational Encoder-Decoder for Logical Table-to-Text Generation

By Wenqing Chen, Jidong Tian, Yitian Li, Hao He, Yaohui Jin. 2021

28 citations recorded by the source corpus.

Logical table-to-text generation aims to automatically generate fluent and logically faithful text from tables. The task remains challenging where deep learning models often generated linguistically fluent but logically inconsistent text. The underlying reason may be that deep learning models often capture surface-level spurious correlations rather than the causal relationships between the table \boldsymbol{x} and the sentence \boldsymbol{y}. Specifically, in the training stage, a model can get a low empirical loss without understanding \boldsymbol{x} and use spurious statistical cues instead. In this paper, we propose a de-confounded variational encoder-decoder (DCVED) based on causal intervention, learning the objective p(\boldsymbol{y}|\textrm{do}(\boldsymbol{x})). Firstly, we propose to use variational inference to estimate the confounders in the latent space and cooperate with the causal intervention based on Pearl’s do-calculus to alleviate the spurious correlations. Secondly, to make the latent confounder meaningful, we propose a back-prediction process to predict the not-used entities but linguistically similar to the exactly selected ones. Finally, since our variational model can generate multiple candidates, we train a table-text selector to find out the best candidate sentence for the given table. An extensive set of experiments show that our model outperforms the baselines and achieves new state-of-the-art performance on two logical table-to-text datasets in terms of logical fidelity.

Subfields: Artificial Intelligence, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Pascale Fung
  2. Andrea Madotto
  3. Wenliang Dai
  4. Nayeon Lee
  5. Yan Xu
  6. Etsuko Ishii
  7. Ziwei Ji
  8. Dan Su

In Natural Language Processing

  1. Pascale Fung
  2. Nayeon Lee
  3. Andrea Madotto
  4. Etsuko Ishii
  5. Yejin Bang
  6. Yan Xu
  7. Rita Frieske
  8. Dan Su

Citations in the corpus