Advanced search
1 file | 1.71 MB Add to list

Modal disalignment of sentiment in Chinese screen dialogue : evidence from independent multimodal annotations

Quanqi Du (UGent) and Yingyu Yan
Author
Organization
Abstract
Sentiment in spoken interaction is not a fixed property of utterances but a dynamic and multimodally constructed phenomenon. This study investigates how sentiment polarity is differently interpreted across modalities -- text, audio, silent video, and full video -- within Chinese screen dialogue, using a corpus in which each modality has been independently annotated. We show that judgments of affective stance frequently diverge, and these divergences shed light on how emotion and evaluation are shaped and perceived across semiotic channels.
Keywords
Sentiment Analysis, Indepedent Multimodal Annotations, Chinese Dialogue

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 1.71 MB

Citation

Please use this url to cite or link to this publication:

MLA
Du, Quanqi, and Yingyu Yan. “Modal Disalignment of Sentiment in Chinese Screen Dialogue : Evidence from Independent Multimodal Annotations.” International Conference on Conversation Analysis (ICCA 2026), Abstracts, 2026.
APA
Du, Q., & Yan, Y. (2026). Modal disalignment of sentiment in Chinese screen dialogue : evidence from independent multimodal annotations. International Conference on Conversation Analysis (ICCA 2026), Abstracts. Presented at the International Conference on Conversation Analysis (ICCA 2026) : Diversities, Language, Interaction, Edmonton, Canada.
Chicago author-date
Du, Quanqi, and Yingyu Yan. 2026. “Modal Disalignment of Sentiment in Chinese Screen Dialogue : Evidence from Independent Multimodal Annotations.” In International Conference on Conversation Analysis (ICCA 2026), Abstracts.
Chicago author-date (all authors)
Du, Quanqi, and Yingyu Yan. 2026. “Modal Disalignment of Sentiment in Chinese Screen Dialogue : Evidence from Independent Multimodal Annotations.” In International Conference on Conversation Analysis (ICCA 2026), Abstracts.
Vancouver
1.
Du Q, Yan Y. Modal disalignment of sentiment in Chinese screen dialogue : evidence from independent multimodal annotations. In: International Conference on Conversation Analysis (ICCA 2026), Abstracts. 2026.
IEEE
[1]
Q. Du and Y. Yan, “Modal disalignment of sentiment in Chinese screen dialogue : evidence from independent multimodal annotations,” in International Conference on Conversation Analysis (ICCA 2026), Abstracts, Edmonton, Canada, 2026.
@inproceedings{01K5F8REXHH8HB50HZRYTJXB2P,
  abstract     = {{Sentiment in spoken interaction is not a fixed property of utterances but a dynamic and multimodally constructed phenomenon. This study investigates how sentiment polarity is differently interpreted across modalities -- text, audio, silent video, and full video -- within Chinese screen dialogue, using a corpus in which each modality has been independently annotated. We show that judgments of affective stance frequently diverge, and these divergences shed light on how emotion and evaluation are shaped and perceived across semiotic channels.}},
  author       = {{Du, Quanqi and Yan, Yingyu}},
  booktitle    = {{International Conference on Conversation Analysis (ICCA 2026), Abstracts}},
  keywords     = {{Sentiment Analysis,Indepedent Multimodal Annotations,Chinese Dialogue}},
  language     = {{eng}},
  location     = {{Edmonton, Canada}},
  title        = {{Modal disalignment of sentiment in Chinese screen dialogue : evidence from independent multimodal annotations}},
  url          = {{https://icca2026.org}},
  year         = {{2026}},
}