Advanced search
1 file | 732.95 KB

Estimating word-level quality of statistical machine translation output using monolingual information alone

Arda Tezcan (UGent) , Veronique Hoste (UGent) and Lieve Macken (UGent)
Author
Organization
Abstract
Various studies show that statistical machine translation (SMT) systems suffer from fluency errors, especially in the form of grammatical errors and errors related to idiomatic word choices. In this study, we investigate the effectiveness of using monolingual information contained in the machine-translated text to estimate word-level quality of SMT output.We propose a recurrent neural network architecture which uses morpho-syntactic features and word embeddings as word representations within surface and syntactic n-grams.We test the proposed method on two language pairs and for two tasks, namely detecting fluency errors and predicting overall post-editing effort. Our results show that this method is effective for capturing all types of fluency errors at once. Moreover, on the task of predicting post-editing effort, while solely relying on monolingual information, it achieves on-par results with the state-of-the-art quality estimation systems which use both bilingual and monolingual information.
Keywords
Machine translation, Quality estimation, Post-editing, Neural Networks, lt3

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 732.95 KB

Citation

Please use this url to cite or link to this publication:

Chicago
Tezcan, Arda, Veronique Hoste, and Lieve Macken. 2019. “Estimating Word-level Quality of Statistical Machine Translation Output Using Monolingual Information Alone.” Natural Language Engineering.
APA
Tezcan, A., Hoste, V., & Macken, L. (2019). Estimating word-level quality of statistical machine translation output using monolingual information alone. NATURAL LANGUAGE ENGINEERING.
Vancouver
1.
Tezcan A, Hoste V, Macken L. Estimating word-level quality of statistical machine translation output using monolingual information alone. NATURAL LANGUAGE ENGINEERING. 2019;
MLA
Tezcan, Arda, Veronique Hoste, and Lieve Macken. “Estimating Word-level Quality of Statistical Machine Translation Output Using Monolingual Information Alone.” NATURAL LANGUAGE ENGINEERING (2019): n. pag. Print.
@article{8606927,
  abstract     = {Various studies show that statistical machine translation (SMT) systems suffer from fluency errors, especially
in the form of grammatical errors and errors related to idiomatic word choices. In this study, we
investigate the effectiveness of using monolingual information contained in the machine-translated text
to estimate word-level quality of SMT output.We propose a recurrent neural network architecture which
uses morpho-syntactic features and word embeddings as word representations within surface and syntactic
n-grams.We test the proposed method on two language pairs and for two tasks, namely detecting fluency
errors and predicting overall post-editing effort. Our results show that this method is effective for capturing
all types of fluency errors at once. Moreover, on the task of predicting post-editing effort, while solely
relying on monolingual information, it achieves on-par results with the state-of-the-art quality estimation
systems which use both bilingual and monolingual information.},
  author       = {Tezcan, Arda and Hoste, Veronique and Macken, Lieve},
  issn         = {1351-3249},
  journal      = {NATURAL LANGUAGE ENGINEERING},
  language     = {eng},
  title        = {Estimating word-level quality of statistical machine translation output using monolingual information alone},
  url          = {http://dx.doi.org/10.1017/S1351324919000111},
  year         = {2019},
}

Altmetric
View in Altmetric