BERTimbau: Pretrained BERT Models for Brazilian Portuguese

By Fábio Souza, Rodrigo Nogueira, Roberto de Alencar Lotufo. Brazilian Conference on Intelligent Systems, 2020

556 citations recorded by the source corpus.

Subfields: Artificial Intelligence

View Paper: https://www.semanticscholar.org/paper/1d95011355628f7aef068ab1914198e43258c530

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

1. Ajit Rajasekharan
2. Sivanesan Sangeetha
3. Katikapalli Subramanyam Kalyan

Citations in the corpus

• AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing (2021, methodology): “For example, models like RuBERT [74], PortugueseBERT [75], SlavicBERT [76] are initialized from mBERT but further pretrained with languagespecific vocabulary.”