Quality as the sum of its parts: a two-step approach for the identification of translation problems and translation quality assessment for HT and MT+PE
- Author
- Joke Daems (UGent) , Lieve Macken (UGent) and Sonia Vandepitte (UGent)
- Organization
- Abstract
- Existing translation quality assessment (TQA) metrics have a few major drawbacks: they are often subjective, their scope is limited to the sentence level, and they do not take the translation situation into account. Though suitable for a general assessment, they lack the granularity needed to compare different methods of translation and their respective translation problems. In an attempt to solve these issues, a two-step TQA-approach is presented, based on the dichotomy between adequacy and acceptability. The proposed categorization allows for easy customization and user-defined error weights, which makes it suitable for different types of translation assessment, analysis and comparison. In the first part of the paper, the approach is explained. In the second part of the paper, the approach is tested in a pilot study designed to compare human translation with post-editing for the translation of general texts (newspaper articles). Inter-annotator results are presented for the translation quality assessment task as well as general findings on the productivity and quality differences between postediting and human translation of student translators.
- Keywords
- machine translation, human translation, translation quality assessment, post-editing
Downloads
-
(...).pdf
- full text
- |
- UGent only
- |
- |
- 215.74 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-4127483
- MLA
- Daems, Joke, et al. “Quality as the Sum of Its Parts: A Two-Step Approach for the Identification of Translation Problems and Translation Quality Assessment for HT and MT+PE.” MT Summit XIV Workshop on Post-Editing Technology and Practice, Proceedings, edited by Sharon O’Brien et al., European Association for Machine Translation, 2013, pp. 63–71.
- APA
- Daems, J., Macken, L., & Vandepitte, S. (2013). Quality as the sum of its parts: a two-step approach for the identification of translation problems and translation quality assessment for HT and MT+PE. In S. O’Brien, M. Simard, & L. Specia (Eds.), MT Summit XIV Workshop on Post-editing Technology and Practice, Proceedings (pp. 63–71). European Association for Machine Translation.
- Chicago author-date
- Daems, Joke, Lieve Macken, and Sonia Vandepitte. 2013. “Quality as the Sum of Its Parts: A Two-Step Approach for the Identification of Translation Problems and Translation Quality Assessment for HT and MT+PE.” In MT Summit XIV Workshop on Post-Editing Technology and Practice, Proceedings, edited by Sharon O’Brien, Michel Simard, and Lucia Specia, 63–71. European Association for Machine Translation.
- Chicago author-date (all authors)
- Daems, Joke, Lieve Macken, and Sonia Vandepitte. 2013. “Quality as the Sum of Its Parts: A Two-Step Approach for the Identification of Translation Problems and Translation Quality Assessment for HT and MT+PE.” In MT Summit XIV Workshop on Post-Editing Technology and Practice, Proceedings, ed by. Sharon O’Brien, Michel Simard, and Lucia Specia, 63–71. European Association for Machine Translation.
- Vancouver
- 1.Daems J, Macken L, Vandepitte S. Quality as the sum of its parts: a two-step approach for the identification of translation problems and translation quality assessment for HT and MT+PE. In: O’Brien S, Simard M, Specia L, editors. MT Summit XIV Workshop on Post-editing Technology and Practice, Proceedings. European Association for Machine Translation; 2013. p. 63–71.
- IEEE
- [1]J. Daems, L. Macken, and S. Vandepitte, “Quality as the sum of its parts: a two-step approach for the identification of translation problems and translation quality assessment for HT and MT+PE,” in MT Summit XIV Workshop on Post-editing Technology and Practice, Proceedings, Nice, France, 2013, pp. 63–71.
@inproceedings{4127483,
abstract = {{Existing translation quality assessment (TQA) metrics have a few major drawbacks: they are often subjective, their scope is limited to the sentence level, and they do not take the translation situation into account. Though suitable for a general assessment, they lack the granularity needed to compare different methods of translation and their respective translation problems. In an attempt to solve these issues, a two-step TQA-approach is presented, based on the dichotomy between adequacy and acceptability. The proposed categorization allows for easy customization and user-defined error weights, which makes it suitable for different types of translation assessment, analysis and comparison. In the first part of the paper, the approach is explained. In the second part of the paper, the approach is tested in a pilot study designed to compare human translation with post-editing for the translation of general texts (newspaper articles). Inter-annotator results are presented for the translation quality assessment task as well as general findings on the productivity and quality differences between postediting and human translation of student translators.}},
author = {{Daems, Joke and Macken, Lieve and Vandepitte, Sonia}},
booktitle = {{MT Summit XIV Workshop on Post-editing Technology and Practice, Proceedings}},
editor = {{O’Brien, Sharon and Simard, Michel and Specia, Lucia}},
isbn = {{9783952420720}},
keywords = {{machine translation,human translation,translation quality assessment,post-editing}},
language = {{eng}},
location = {{Nice, France}},
pages = {{63--71}},
publisher = {{European Association for Machine Translation}},
title = {{Quality as the sum of its parts: a two-step approach for the identification of translation problems and translation quality assessment for HT and MT+PE}},
year = {{2013}},
}