
The limitations of irony detection in Dutch social media
- Author
- Aaron Maladry (UGent) , Els Lefever (UGent) , Cynthia Van Hee (UGent) and Veronique Hoste (UGent)
- Organization
- Project
- Abstract
- In this paper, we explore the feasibility of irony detection in Dutch social media. To this end, we investigate both transformer models with embedding representations, as well as traditional machine learning classifiers with extensive feature sets. Our feature-based methodology implements a variety of information sources including lexical, semantic, syntactic, sentiment features, as well as two new data-driven features to model common sense. Based on patterns in the syntactic structure of tweets, we aim to model the presence of contrasting sentiments, a phenomenon that is known to be indicative of verbal irony and sarcasm. Feature selection, as well as voting ensemble techniques were implemented to enhance the classification performance. The final systems reach F1-scores up to 0.79, which are promising results for a task as difficult as irony detection. Besides a quantitative analysis, this paper also describes a thorough qualitative analysis of the system output. Although lexical cues appear to be very important to express irony, our analysis also revealed the need for more advanced modeling of common-sense knowledge to detect more subtle examples of irony.
- Keywords
- Irony detection, Sarcasm detection, Implicit sentiment modeling, Computational linguistics, Natural language processing, Machine learning, Neural networks, Language models, Social media
Downloads
-
LimitationsofIronyDetection.pdf
- full text (Published version)
- |
- open access
- |
- |
- 1.13 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01H68PT2CKPQ6H9KVAY53FBFD4
- MLA
- Maladry, Aaron, et al. “The Limitations of Irony Detection in Dutch Social Media.” LANGUAGE RESOURCES AND EVALUATION, vol. 58, no. 4, 2024, pp. 1355–86, doi:10.1007/s10579-023-09656-1.
- APA
- Maladry, A., Lefever, E., Van Hee, C., & Hoste, V. (2024). The limitations of irony detection in Dutch social media. LANGUAGE RESOURCES AND EVALUATION, 58(4), 1355–1386. https://doi.org/10.1007/s10579-023-09656-1
- Chicago author-date
- Maladry, Aaron, Els Lefever, Cynthia Van Hee, and Veronique Hoste. 2024. “The Limitations of Irony Detection in Dutch Social Media.” LANGUAGE RESOURCES AND EVALUATION 58 (4): 1355–86. https://doi.org/10.1007/s10579-023-09656-1.
- Chicago author-date (all authors)
- Maladry, Aaron, Els Lefever, Cynthia Van Hee, and Veronique Hoste. 2024. “The Limitations of Irony Detection in Dutch Social Media.” LANGUAGE RESOURCES AND EVALUATION 58 (4): 1355–1386. doi:10.1007/s10579-023-09656-1.
- Vancouver
- 1.Maladry A, Lefever E, Van Hee C, Hoste V. The limitations of irony detection in Dutch social media. LANGUAGE RESOURCES AND EVALUATION. 2024;58(4):1355–86.
- IEEE
- [1]A. Maladry, E. Lefever, C. Van Hee, and V. Hoste, “The limitations of irony detection in Dutch social media,” LANGUAGE RESOURCES AND EVALUATION, vol. 58, no. 4, pp. 1355–1386, 2024.
@article{01H68PT2CKPQ6H9KVAY53FBFD4, abstract = {{In this paper, we explore the feasibility of irony detection in Dutch social media. To this end, we investigate both transformer models with embedding representations, as well as traditional machine learning classifiers with extensive feature sets. Our feature-based methodology implements a variety of information sources including lexical, semantic, syntactic, sentiment features, as well as two new data-driven features to model common sense. Based on patterns in the syntactic structure of tweets, we aim to model the presence of contrasting sentiments, a phenomenon that is known to be indicative of verbal irony and sarcasm. Feature selection, as well as voting ensemble techniques were implemented to enhance the classification performance. The final systems reach F1-scores up to 0.79, which are promising results for a task as difficult as irony detection. Besides a quantitative analysis, this paper also describes a thorough qualitative analysis of the system output. Although lexical cues appear to be very important to express irony, our analysis also revealed the need for more advanced modeling of common-sense knowledge to detect more subtle examples of irony. }}, author = {{Maladry, Aaron and Lefever, Els and Van Hee, Cynthia and Hoste, Veronique}}, issn = {{1574-020X}}, journal = {{LANGUAGE RESOURCES AND EVALUATION}}, keywords = {{Irony detection,Sarcasm detection,Implicit sentiment modeling,Computational linguistics,Natural language processing,Machine learning,Neural networks,Language models,Social media}}, language = {{eng}}, number = {{4}}, pages = {{1355--1386}}, title = {{The limitations of irony detection in Dutch social media}}, url = {{http://doi.org/10.1007/s10579-023-09656-1}}, volume = {{58}}, year = {{2024}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: