Zero-shot Learning by Generating Task-specific Adapters
By Qinyuan Ye, Xiang Ren. 2021
10 citations recorded by the source corpus.
Subfields: Natural Language Processing, Meta & Continual Learning
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Natural Language Processing
- Chitta Baral
- Daniel Khashabi
- Ashish Sabharwal
- Hannaneh Hajishirzi
- Swaroop Mishra
- Tushar Khot
- Peter Clark
- Kai-Wei Chang
In Meta & Continual Learning
Citations in the corpus
- Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm (2021, background): “optimization of prompts [17, 22], and task-specific adapter networks [25].”
- Cross-Task Generalization via Natural Language Crowdsourcing Instructions (2021, neutral): “Similar to ours, recent works study the impact of language instructions in modifying a model behavior (Hase and Bansal, 2021; Ye and Ren, 2021; Gupta et al., 2021; Zhong et al., 2021).”
- Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions? (2021, background): “A range of recent works are based on the general idea of models revising their behavior according to changes in their input (Wallace et al., 2019; Gardner et al., 2020; Emelin et al., 2020; Ye and Ren, 2021; Schick and Schütze, 2020; Sheng et al., 2020).”
- Natural Instructions: Benchmarking Generalization to New Tasks from Natural Language Instructions (2021, background): “A recent line of work has explored the ability of models to reason with respect to natural language description of a goal task (Goldwasser and Roth, 2014; Weller et al., 2020; Efrat and Levy, 2020; Clark et al., 2020; Hase and Bansal, 2021; Ye and Ren, 2021).”
- In-BoXBART: Get Instructions into Biomedical Multi-Task Learning (2022, background): “Studies have been made to investigate the effect of natural language instructions on model performance (Hase and Bansal, 2021; Ye and Ren, 2021b; Zhong et al., 2021; Weller et al., 2020).”
- How Many Data Samples is an Additional Instruction Worth? (2022, background): “After that, many works have been proposed to show that models follow language instructions (Hase and Bansal, 2021; Ye and Ren, 2021; Gupta et al., 2021; Zhong et al., 2021).”