: Masked Language Modeling with Higher-Level Representations for Long Documents

By Tamara Czinczoll, C. Hones, Maximilian Schall, Gerard de Melo

Subfields: Natural Language Processing, Representation & Self-Supervised Learning, Model Architectures