On the origin of errors: a fine-grained analysis of MT and PE errors and their relationship
- Author
- Joke Daems (UGent) , Lieve Macken (UGent) and Sonia Vandepitte (UGent)
- Organization
- Abstract
- In order to improve the symbiosis between machine translation (MT) system and post-editor, it is not enough to know that the output of one system is better than the output of another system. A fine-grained error analysis is needed to provide information on the type and location of errors occurring in MT and the corresponding errors occurring after post-editing (PE). This article reports on a fine-grained translation quality assessment approach which was applied to machine translated-texts and the post-edited versions of these texts, made by student post-editors. By linking each error to the corresponding source text-passage, it is possible to identify passages that were problematic in MT, but not after PE, or passages that were problematic even after PE. This method provides rich data on the origin and impact of errors, which can be used to improve post-editor training as well as machine translation systems. We present the results of a pilot experiment on the post-editing of newspaper articles and highlight the advantages of our approach.
- Keywords
- Translation Quality Assessment, Machine Translation, Post-editing
Downloads
-
(...).pdf
- full text
- |
- UGent only
- |
- |
- 117.97 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-4418636
- MLA
- Daems, Joke, et al. “On the Origin of Errors: A Fine-Grained Analysis of MT and PE Errors and Their Relationship.” LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, edited by Nicoletta Calzolari et al., European Language Resources Association (ELRA), 2014, pp. 62–66.
- APA
- Daems, J., Macken, L., & Vandepitte, S. (2014). On the origin of errors: a fine-grained analysis of MT and PE errors and their relationship. In N. Calzolari, K. Choukri, T. Declerck, H. Loftsson, B. Maegaard, J. Mariani, … S. Piperidis (Eds.), LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (pp. 62–66). European Language Resources Association (ELRA).
- Chicago author-date
- Daems, Joke, Lieve Macken, and Sonia Vandepitte. 2014. “On the Origin of Errors: A Fine-Grained Analysis of MT and PE Errors and Their Relationship.” In LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, edited by Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, and Stelios Piperidis, 62–66. European Language Resources Association (ELRA).
- Chicago author-date (all authors)
- Daems, Joke, Lieve Macken, and Sonia Vandepitte. 2014. “On the Origin of Errors: A Fine-Grained Analysis of MT and PE Errors and Their Relationship.” In LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, ed by. Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, and Stelios Piperidis, 62–66. European Language Resources Association (ELRA).
- Vancouver
- 1.Daems J, Macken L, Vandepitte S. On the origin of errors: a fine-grained analysis of MT and PE errors and their relationship. In: Calzolari N, Choukri K, Declerck T, Loftsson H, Maegaard B, Mariani J, et al., editors. LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION. European Language Resources Association (ELRA); 2014. p. 62–6.
- IEEE
- [1]J. Daems, L. Macken, and S. Vandepitte, “On the origin of errors: a fine-grained analysis of MT and PE errors and their relationship,” in LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, Reykjavik, Iceland, 2014, pp. 62–66.
@inproceedings{4418636,
abstract = {{In order to improve the symbiosis between machine translation (MT) system and post-editor, it is not enough to know that the output of one system is better than the output of another system. A fine-grained error analysis is needed to provide information on the type and location of errors occurring in MT and the corresponding errors occurring after post-editing (PE). This article reports on a fine-grained translation quality assessment approach which was applied to machine translated-texts and the post-edited versions of these texts, made by student post-editors. By linking each error to the corresponding source text-passage, it is possible to identify passages that were problematic in MT, but not after PE, or passages that were problematic even after PE. This method provides rich data on the origin and impact of errors, which can be used to improve post-editor training as well as machine translation systems. We present the results of a pilot experiment on the post-editing of newspaper articles and highlight the advantages of our approach.}},
author = {{Daems, Joke and Macken, Lieve and Vandepitte, Sonia}},
booktitle = {{LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION}},
editor = {{Calzolari, Nicoletta and Choukri, Khalid and Declerck, Thierry and Loftsson, Hrafn and Maegaard, Bente and Mariani, Joseph and Moreno, Asuncion and Odijk, Jan and Piperidis, Stelios}},
isbn = {{9782951740884}},
keywords = {{Translation Quality Assessment,Machine Translation,Post-editing}},
language = {{eng}},
location = {{Reykjavik, Iceland}},
pages = {{62--66}},
publisher = {{European Language Resources Association (ELRA)}},
title = {{On the origin of errors: a fine-grained analysis of MT and PE errors and their relationship}},
url = {{http://www.lrec-conf.org/proceedings/lrec2014/pdf/532_Paper.pdf}},
year = {{2014}},
}