NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents

By Tamara Czinczoll, C. Hones, Maximilian Schall, Gerard de Melo. 2024

Subfields: Natural Language Processing, Representation & Self-Supervised Learning, Model Architectures