Task-specific Objectives of Pre-trained Language Models for Dialogue Adaptation

By Junlong Li, Zhuosheng Zhang, Hai Zhao, Xi Zhou, Xiang Zhou. 2020

23 citations recorded by the source corpus.

Subfields: Large Language Models, Dialogue & Conversational AI

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Large Language Models

1. Kun Zhou
2. Ji-rong Wen
3. Shijin Wang

Citations in the corpus

• Continual Pre-training of Language Models for Math Problem Understanding with Syntax-Aware Memory Network (2022, methodology): “…the model parameters with BERT-like tasks on domain or task related corpus ( e.g., scientific (Beltagy et al., 2019) and bio-media (Lee et al., 2020)), or design new pre-training objectives for task adaption ( e.g., commonsense reasoning (Zhou et al., 2021) and dialogue adaption (Li et al., 2020)).”