Academic Bibliography

 Search 200 years of publications by Ghent University researchers.
Advanced search
1 file | 359.83 KB
Add to list
  1. Search results
  2. LeTs preprocess : the multilingual LT...

LeTs preprocess : the multilingual LT3 linguistic preprocessing toolkit

Marjan Van de Kauter (UGent) , Geert Coorman, Els Lefever (UGent) , Bart Desmet (UGent) , Lieve Macken (UGent) and Veronique Hoste (UGent)
(2013) COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL. 3. p.103-120
Author
Organization
Project
Abstract
This paper presents the LeTs Preprocess Toolkit, a suite of robust high-performance preprocessing modules including Part-of-Speech Taggers, Lemmatizers and Named Entity Recognizers. The currently supported languages are Dutch, English, French and German. We give a detailed description of the architecture of the LeTs Preprocess pipeline and describe the data and methods used to train each component. Ten-fold cross-validation results are also presented. To assess the performance of each module on different domains, we collected real-world textual data from companies covering various domains (a.o. automotive, dredging and human resources) for all four supported languages. For this multi-domain corpus, a manually verified gold standard was created for each of the three preprocessing steps. We present the performance of our preprocessing components on this corpus and compare it to the performance of other existing tools.
Keywords
part-of-speech tagging, preprocessing, NER, lemmatization, Named Entity Recognition, LT3

Downloads

  • Download
    07-VandeKauter-etal-CLIN2013.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 359.83 KB

Citation

Please use this url to cite or link to this publication:

MLA
Van de Kauter, Marjan, et al. “LeTs Preprocess : The Multilingual LT3 Linguistic Preprocessing Toolkit.” COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL, vol. 3, 2013, pp. 103–20.
APA
Van de Kauter, M., Coorman, G., Lefever, E., Desmet, B., Macken, L., & Hoste, V. (2013). LeTs preprocess : the multilingual LT3 linguistic preprocessing toolkit. COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL, 3, 103–120.
Chicago author-date
Van de Kauter, Marjan, Geert Coorman, Els Lefever, Bart Desmet, Lieve Macken, and Veronique Hoste. 2013. “LeTs Preprocess : The Multilingual LT3 Linguistic Preprocessing Toolkit.” COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL 3: 103–20.
Chicago author-date (all authors)
Van de Kauter, Marjan, Geert Coorman, Els Lefever, Bart Desmet, Lieve Macken, and Veronique Hoste. 2013. “LeTs Preprocess : The Multilingual LT3 Linguistic Preprocessing Toolkit.” COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL 3: 103–120.
Vancouver
1.
Van de Kauter M, Coorman G, Lefever E, Desmet B, Macken L, Hoste V. LeTs preprocess : the multilingual LT3 linguistic preprocessing toolkit. COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL. 2013;3:103–20.
IEEE
[1]
M. Van de Kauter, G. Coorman, E. Lefever, B. Desmet, L. Macken, and V. Hoste, “LeTs preprocess : the multilingual LT3 linguistic preprocessing toolkit,” COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL, vol. 3, pp. 103–120, 2013.
@article{4228576,
  abstract     = {{This paper presents the LeTs Preprocess Toolkit, a suite of robust high-performance preprocessing modules including Part-of-Speech Taggers, Lemmatizers and Named Entity Recognizers. The currently supported languages are Dutch, English, French and German. We give a detailed description of the architecture of the LeTs Preprocess pipeline and describe the data and methods used to train each component. Ten-fold cross-validation results are also presented. To assess the performance of each module on different domains, we collected real-world textual data from companies covering various domains (a.o. automotive, dredging and human resources) for all four supported languages. For this multi-domain corpus, a manually verified gold standard was created for each of the three preprocessing steps. We present the performance of our preprocessing components on this corpus and compare it to the performance of other existing tools.}},
  author       = {{Van de Kauter, Marjan and Coorman, Geert and Lefever, Els and Desmet, Bart and Macken, Lieve and Hoste, Veronique}},
  issn         = {{2211-4009}},
  journal      = {{COMPUTATIONAL LINGUISTICS IN THE NETHERLANDS JOURNAL}},
  keywords     = {{part-of-speech tagging,preprocessing,NER,lemmatization,Named Entity Recognition,LT3}},
  language     = {{eng}},
  pages        = {{103--120}},
  title        = {{LeTs preprocess : the multilingual LT3 linguistic preprocessing toolkit}},
  url          = {{https://www.clinjournal.org/clinj/article/view/28}},
  volume       = {{3}},
  year         = {{2013}},
}