An exploratory study into automated précis grading
- Author
- Orphée De Clercq (UGent) and Senne Van Hoecke
- Organization
- Abstract
- Automated writing evaluation is a popular research field, but the main focus has been on evaluating argumentative essays. In this paper, we consider a different genre, namely précis texts. A précis is a written text that provides a coherent summary of main points of a spoken or written text. We present a corpus of English précis texts which all received a grade assigned by a highly-experienced English language teacher and were subsequently annotated following an exhaustive error typology. With this corpus we trained a machine learning model which relies on a number of linguistic, automatic summarization and AWE features. Our results reveal that this model is able to predict the grade of précis texts with only a moderate error margin.
- Keywords
- LT3, automated writing evaluation, natural language processing, learner corpus, FEATURES, TEXT
Downloads
-
2020.lrec-1.50.pdf
- full text (Published version)
- |
- open access
- |
- |
- 824.80 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8663089
- MLA
- De Clercq, Orphée, and Senne Van Hoecke. “An Exploratory Study into Automated Précis Grading.” PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), European Language Resources Association (ELRA), 2020, pp. 397–404.
- APA
- De Clercq, O., & Van Hoecke, S. (2020). An exploratory study into automated précis grading. PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 397–404. European Language Resources Association (ELRA).
- Chicago author-date
- De Clercq, Orphée, and Senne Van Hoecke. 2020. “An Exploratory Study into Automated Précis Grading.” In PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 397–404. European Language Resources Association (ELRA).
- Chicago author-date (all authors)
- De Clercq, Orphée, and Senne Van Hoecke. 2020. “An Exploratory Study into Automated Précis Grading.” In PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 397–404. European Language Resources Association (ELRA).
- Vancouver
- 1.De Clercq O, Van Hoecke S. An exploratory study into automated précis grading. In: PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020). European Language Resources Association (ELRA); 2020. p. 397–404.
- IEEE
- [1]O. De Clercq and S. Van Hoecke, “An exploratory study into automated précis grading,” in PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), Marseille, France, 2020, pp. 397–404.
@inproceedings{8663089,
abstract = {{Automated writing evaluation is a popular research field, but the main focus has been on evaluating argumentative essays. In this paper, we consider a different genre, namely précis texts. A précis is a written text that provides a coherent summary of main points of a spoken or written text. We present a corpus of English précis texts which all received a grade assigned by a highly-experienced English language teacher and were subsequently annotated following an exhaustive error typology. With this corpus we trained a machine learning model which relies on a number of linguistic, automatic summarization and AWE features. Our results reveal that this model is able to predict the grade of précis texts with only a moderate error margin.}},
author = {{De Clercq, Orphée and Van Hoecke, Senne}},
booktitle = {{PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020)}},
isbn = {{9791095546344}},
issn = {{2522-2686}},
keywords = {{LT3,automated writing evaluation,natural language processing,learner corpus,FEATURES,TEXT}},
language = {{eng}},
location = {{Marseille, France}},
pages = {{397--404}},
publisher = {{European Language Resources Association (ELRA)}},
title = {{An exploratory study into automated précis grading}},
url = {{http://www.lrec-conf.org/proceedings/lrec2020/LREC-2020.pdf}},
year = {{2020}},
}