Advanced search
1 file | 1.13 MB Add to list

The limitations of irony detection in Dutch social media

Aaron Maladry (UGent) , Els Lefever (UGent) , Cynthia Van Hee (UGent) and Veronique Hoste (UGent)
(2024) LANGUAGE RESOURCES AND EVALUATION. 58(4). p.1355-1386
Author
Organization
Project
Abstract
In this paper, we explore the feasibility of irony detection in Dutch social media. To this end, we investigate both transformer models with embedding representations, as well as traditional machine learning classifiers with extensive feature sets. Our feature-based methodology implements a variety of information sources including lexical, semantic, syntactic, sentiment features, as well as two new data-driven features to model common sense. Based on patterns in the syntactic structure of tweets, we aim to model the presence of contrasting sentiments, a phenomenon that is known to be indicative of verbal irony and sarcasm. Feature selection, as well as voting ensemble techniques were implemented to enhance the classification performance. The final systems reach F1-scores up to 0.79, which are promising results for a task as difficult as irony detection. Besides a quantitative analysis, this paper also describes a thorough qualitative analysis of the system output. Although lexical cues appear to be very important to express irony, our analysis also revealed the need for more advanced modeling of common-sense knowledge to detect more subtle examples of irony.
Keywords
Irony detection, Sarcasm detection, Implicit sentiment modeling, Computational linguistics, Natural language processing, Machine learning, Neural networks, Language models, Social media

Downloads

  • LimitationsofIronyDetection.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 1.13 MB

Citation

Please use this url to cite or link to this publication:

MLA
Maladry, Aaron, et al. “The Limitations of Irony Detection in Dutch Social Media.” LANGUAGE RESOURCES AND EVALUATION, vol. 58, no. 4, 2024, pp. 1355–86, doi:10.1007/s10579-023-09656-1.
APA
Maladry, A., Lefever, E., Van Hee, C., & Hoste, V. (2024). The limitations of irony detection in Dutch social media. LANGUAGE RESOURCES AND EVALUATION, 58(4), 1355–1386. https://doi.org/10.1007/s10579-023-09656-1
Chicago author-date
Maladry, Aaron, Els Lefever, Cynthia Van Hee, and Veronique Hoste. 2024. “The Limitations of Irony Detection in Dutch Social Media.” LANGUAGE RESOURCES AND EVALUATION 58 (4): 1355–86. https://doi.org/10.1007/s10579-023-09656-1.
Chicago author-date (all authors)
Maladry, Aaron, Els Lefever, Cynthia Van Hee, and Veronique Hoste. 2024. “The Limitations of Irony Detection in Dutch Social Media.” LANGUAGE RESOURCES AND EVALUATION 58 (4): 1355–1386. doi:10.1007/s10579-023-09656-1.
Vancouver
1.
Maladry A, Lefever E, Van Hee C, Hoste V. The limitations of irony detection in Dutch social media. LANGUAGE RESOURCES AND EVALUATION. 2024;58(4):1355–86.
IEEE
[1]
A. Maladry, E. Lefever, C. Van Hee, and V. Hoste, “The limitations of irony detection in Dutch social media,” LANGUAGE RESOURCES AND EVALUATION, vol. 58, no. 4, pp. 1355–1386, 2024.
@article{01H68PT2CKPQ6H9KVAY53FBFD4,
  abstract     = {{In this paper, we explore the feasibility of irony detection in Dutch social media. To this end, we investigate both transformer models with embedding representations, as well as traditional machine learning classifiers with extensive feature sets. Our feature-based methodology implements a variety of information sources including lexical, semantic, syntactic, sentiment features, as well as two new data-driven features to model common sense. Based on patterns in the syntactic structure of tweets, we aim to model the presence of contrasting sentiments, a phenomenon that is known to be indicative of verbal irony and sarcasm. Feature selection, as well as voting ensemble techniques were implemented to enhance the classification performance. The final systems reach F1-scores up to 0.79, which are promising results for a task as difficult as irony detection. Besides a quantitative analysis, this paper also describes a thorough qualitative analysis of the system output. Although lexical cues appear to be very important to express irony, our analysis also revealed the need for more advanced modeling of common-sense knowledge to detect more subtle examples of irony.
}},
  author       = {{Maladry, Aaron and Lefever, Els and Van Hee, Cynthia and Hoste, Veronique}},
  issn         = {{1574-020X}},
  journal      = {{LANGUAGE RESOURCES AND EVALUATION}},
  keywords     = {{Irony detection,Sarcasm detection,Implicit sentiment modeling,Computational linguistics,Natural language processing,Machine learning,Neural networks,Language models,Social media}},
  language     = {{eng}},
  number       = {{4}},
  pages        = {{1355--1386}},
  title        = {{The limitations of irony detection in Dutch social media}},
  url          = {{http://doi.org/10.1007/s10579-023-09656-1}},
  volume       = {{58}},
  year         = {{2024}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: