Leading by example : the use of generative Artificial Intelligence to create pedagogically suitable example sentences
- Author
- Jasper Degraeuwe (UGent) and Patrick Goethals (UGent)
- Organization
- Project
- Abstract
- Several second language acquisition studies have argued in favour of practising vocabulary in authentic contexts. After the tradition of obtaining these usage examples by "invention" (i.e. language experts creating examples based on their intuitions) was superseded by corpus-based approaches (i.e. using dedicated tools to select examples from corpora), the rise of large language models led to a third possible "data source": Generative Artificial Intelligence (GenAI). This paper aims to assess GenAI-based examples in terms of their pedagogical suitability by conducting an experiment in which second language (L2) learners compare GenAI-based examples to corpus-based ones, for L2 Spanish. The study shows that L2 learners find GenAI-based sentences more suitable than corpus-based sentences, with -- on a total of 400 pairwise comparisons -- 265 artificial examples being found most suitable by all learners (compared to 10 corpus-based examples). The prompt type (different zero-shot and few-shot prompts were designed) did not have a noticeable impact on the results. Importantly, the GenAI approach also yielded a number of unsuitable example sentences, leading us to conclude that a "hybrid" method which takes authentic corpus-based examples as its starting point and employs GenAI models to rewrite the examples might combine the best of both worlds.
- Keywords
- Generative Artificial Intelligence, example sentences, Spanish as a foreign language
Downloads
-
Degraeuwe Goethals 2024.pdf
- full text (Published version)
- |
- open access
- |
- |
- 597.55 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01JANNKB0JGNMAEET0DRN9SXNK
- MLA
- Degraeuwe, Jasper, and Patrick Goethals. “Leading by Example : The Use of Generative Artificial Intelligence to Create Pedagogically Suitable Example Sentences.” Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024), vol. 211, 2024, pp. 33–48, doi:10.3384/ecp211003.
- APA
- Degraeuwe, J., & Goethals, P. (2024). Leading by example : the use of generative Artificial Intelligence to create pedagogically suitable example sentences. Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024), 211, 33–48. https://doi.org/10.3384/ecp211003
- Chicago author-date
- Degraeuwe, Jasper, and Patrick Goethals. 2024. “Leading by Example : The Use of Generative Artificial Intelligence to Create Pedagogically Suitable Example Sentences.” In Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024), 211:33–48. https://doi.org/10.3384/ecp211003.
- Chicago author-date (all authors)
- Degraeuwe, Jasper, and Patrick Goethals. 2024. “Leading by Example : The Use of Generative Artificial Intelligence to Create Pedagogically Suitable Example Sentences.” In Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024), 211:33–48. doi:10.3384/ecp211003.
- Vancouver
- 1.Degraeuwe J, Goethals P. Leading by example : the use of generative Artificial Intelligence to create pedagogically suitable example sentences. In: Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024). 2024. p. 33–48.
- IEEE
- [1]J. Degraeuwe and P. Goethals, “Leading by example : the use of generative Artificial Intelligence to create pedagogically suitable example sentences,” in Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024), Rennes, France, 2024, vol. 211, pp. 33–48.
@inproceedings{01JANNKB0JGNMAEET0DRN9SXNK,
abstract = {{Several second language acquisition studies have argued in favour of practising vocabulary in authentic contexts. After the tradition of obtaining these usage examples by "invention" (i.e. language experts creating examples based on their intuitions) was superseded by corpus-based approaches (i.e. using dedicated tools to select examples from corpora), the rise of large language models led to a third possible "data source": Generative Artificial Intelligence (GenAI). This paper aims to assess GenAI-based examples in terms of their pedagogical suitability by conducting an experiment in which second language (L2) learners compare GenAI-based examples to corpus-based ones, for L2 Spanish. The study shows that L2 learners find GenAI-based sentences more suitable than corpus-based sentences, with -- on a total of 400 pairwise comparisons -- 265 artificial examples being found most suitable by all learners (compared to 10 corpus-based examples). The prompt type (different zero-shot and few-shot prompts were designed) did not have a noticeable impact on the results. Importantly, the GenAI approach also yielded a number of unsuitable example sentences, leading us to conclude that a "hybrid" method which takes authentic corpus-based examples as its starting point and employs GenAI models to rewrite the examples might combine the best of both worlds.}},
author = {{Degraeuwe, Jasper and Goethals, Patrick}},
booktitle = {{Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024)}},
issn = {{1650-3686}},
keywords = {{Generative Artificial Intelligence,example sentences,Spanish as a foreign language}},
language = {{eng}},
location = {{Rennes, France}},
pages = {{33--48}},
title = {{Leading by example : the use of generative Artificial Intelligence to create pedagogically suitable example sentences}},
url = {{http://doi.org/10.3384/ecp211003}},
volume = {{211}},
year = {{2024}},
}
- Altmetric
- View in Altmetric