ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance

By Wissam Antoun, Benoît Sagot, Djamé Seddah. 2025

Subfields: Natural Language Processing, Representation & Self-Supervised Learning, Model Architectures