FreeLing 3.0: Towards Wider Multilinguality
By Lluís Padró, Evgeny Stanilovsky. 2012
644 citations recorded by the source corpus.
FreeLing is an open-source multilingual language processing library providing a wide range of analyzers for several languages. It offers text processing and language annotation facilities to NLP application developers, lowering the cost of building those applications. FreeLing is customizable, extensible, and has a strong orientation to real-world applications in terms of speed and robustness. Developers can use the default linguistic resources (dictionaries, lexicons, grammars, etc.), extend/adapt them to specific domains, or --since the library is open source-- develop new ones for specific languages or special application needs. This paper describes the general architecture of the library, presents the major changes and improvements included in FreeLing version 3.0, and summarizes some relevant industrial projects in which it has been used.
Subfields: Artificial Intelligence, Information Systems, Natural Language Processing, Computational Linguistics & Semantics
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Josef van Genabith
- François Yvon
- Santanu Pal
- Yonatan Belinkov
- Hinrich Schütze
- Alexander Allauzen
- Helmut Schmid
- Sudip Kumar Naskar
In Information Systems
- Hinrich Schütze
- Leon Derczynski
- Alejandro Ramos-Soto
- Julio Janeiro Gallardo
- Santanu Pal
- James F. Allen
- Guillaume Wisniewski
- Alberto Bugarín-Diz
In Natural Language Processing
- Josef van Genabith
- Hinrich Schütze
- Santanu Pal
- François Yvon
- Sudip Kumar Naskar
- Helmut Schmid
- Alexander Allauzen
- Guillaume Wisniewski
In Computational Linguistics & Semantics
- Alejandro Ramos-Soto
- Julio Janeiro Gallardo
- Hinrich Schütze
- Santanu Pal
- Guillaume Wisniewski
- James Pustejovsky
- Alberto Bugarín-Diz
- Nicolas Pécheux
Citations in the corpus
- USAAR-SAPE: An English–Spanish Statistical Automatic Post-Editing System (2015, methodology): “The preprocessing of the training corpus was carried out first by stemming the Spanish MT output and the PE data using Freeling (Padr´o and Stanilovsky, 2012).”
- SemEval-2013 Task 1: TempEval-3: Evaluating Time Expressions, Events, and Temporal Relations (2013, methodology): “In this case, TIPSemB-Freeling is provided as a state-of-the-art reference covering all the tasks.”
- LIMSI Submission for WMT’14 QE Task (2014, methodology): “More precisely, if the number of true positive (i.e. 2We used FreeLing (http:nlp.lsi.upc.edu/ freeling/) to predict the POS tags of the translation hypotheses and, for the sake of clarity, mapped the 71 tags used by FreeLing to the 11 universal POS tags of Petrov et al. (2012).”
- Efficient Higher-Order CRFs for Morphological Tagging (2013, methodology): “In this paper, we demonstrate that fast and accurate CRF training and tagging is possible for large tagsets of even thousands of tags by approximating the CRF objective function using coarse-to-fine decoding (Charniak and Johnson, 2005; Rush and Petrov, 2012).”
- Corpus analysis of simultaneous interpretation data for improving real time speech translation (2013, methodology): “Freeling [16] was used to parse the parallel English and Spanish sides of the corpus.”
- IXA pipeline: Efficient and Ready to Use Multilingual NLP tools (2014, background): “Freeling (Padró and Stanilovsky, 2012) provides multilingual processing for a number of languages, including Spanish and English.”
- Interacting with educational chatbots: A systematic review (2022, methodology): “Pérez et al. (2020) identified various technologies used to implement chatbots such as Dialogflow 4 , FreeLing (Padró and Stanilovsky, 2012), and ChatFuel 5 .”
- BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Sampling (2022, background): “Models in monolingual Spanish are generally hard to come by and, when they do, they are often trained on proprietary datasets and with massive resources (Padr´o and Stanilovsky, 2012; Guti´errez-Fandi˜no et al., 2021).”
- Adapting SimpleNLG to Spanish (2017, methodology): “In particular, we have used the Spanish dictionary provided by the FreeL-ing project (Padr´o and Stanilovsky, 2012) to develop and test SimpleNLG-ES.”
- UGENT-LT3 SCATE System for Machine Translation Quality Estimation (2015, methodology): “The following preprocessing steps have been applied on the data before building the language models: normalizing punctuation and numbers, tokenization, named entity recognition using the Stanford NER tool (Finkel et al., 2005), lowercasing, and PoS-tagging using FreeLing (Padró and Stanilovsky, 2012”