Advanced search
2 files | 4.74 MB Add to list

Evaluating facial recognition services as interaction technique for recommender systems

Toon De Pessemier (UGent) , Ine Coppens (UGent) and Luc Martens (UGent)
(2020) MULTIMEDIA TOOLS AND APPLICATIONS. 79(31-32). p.23547-23570
Author
Organization
Abstract
Recommender systems are tools and techniques to assist users in the content selection process thereby coping with the problem of information overload. For recommender systems, user authentication and feedback gathering are of crucial importance. However, the typical user authentication with username / password and feedback method with a star rating system are not user friendly and often bypassed. This article proposes an alternative method for user authentication based on facial recognition and an automatic feedback gathering method by detecting various face characteristics such as emotions. We studied the use case of video watching. Photos made with the front-facing camera of a tablet, smartphone, or smart TV are used as input of a facial recognition service. The persons in front of the screen can be identified. During video watching, implicit feedback for the video content is automatically gathered through emotion recognition, attention measurements, and behavior analysis. An evaluation with a test panel showed that the recognized emotions are correlated with the user's star ratings and that happiness can be most accurately detected. So as the main contribution, this article indicates that emotion recognition might be used as an alternative feedback mechanism for recommender systems.
Keywords
EMOTION RECOGNITION, Recommender system, Facial analysis, Emotion recognition, Human-computer, interaction

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 2.07 MB
  • WICA 943a.pdf
    • full text (Accepted manuscript)
    • |
    • open access
    • |
    • PDF
    • |
    • 2.67 MB

Citation

Please use this url to cite or link to this publication:

MLA
De Pessemier, Toon, et al. “Evaluating Facial Recognition Services as Interaction Technique for Recommender Systems.” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 79, no. 31–32, 2020, pp. 23547–70, doi:10.1007/s11042-020-09061-8.
APA
De Pessemier, T., Coppens, I., & Martens, L. (2020). Evaluating facial recognition services as interaction technique for recommender systems. MULTIMEDIA TOOLS AND APPLICATIONS, 79(31–32), 23547–23570. https://doi.org/10.1007/s11042-020-09061-8
Chicago author-date
De Pessemier, Toon, Ine Coppens, and Luc Martens. 2020. “Evaluating Facial Recognition Services as Interaction Technique for Recommender Systems.” MULTIMEDIA TOOLS AND APPLICATIONS 79 (31–32): 23547–70. https://doi.org/10.1007/s11042-020-09061-8.
Chicago author-date (all authors)
De Pessemier, Toon, Ine Coppens, and Luc Martens. 2020. “Evaluating Facial Recognition Services as Interaction Technique for Recommender Systems.” MULTIMEDIA TOOLS AND APPLICATIONS 79 (31–32): 23547–23570. doi:10.1007/s11042-020-09061-8.
Vancouver
1.
De Pessemier T, Coppens I, Martens L. Evaluating facial recognition services as interaction technique for recommender systems. MULTIMEDIA TOOLS AND APPLICATIONS. 2020;79(31–32):23547–70.
IEEE
[1]
T. De Pessemier, I. Coppens, and L. Martens, “Evaluating facial recognition services as interaction technique for recommender systems,” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 79, no. 31–32, pp. 23547–23570, 2020.
@article{8677259,
  abstract     = {{Recommender systems are tools and techniques to assist users in the content selection process thereby coping with the problem of information overload. For recommender systems, user authentication and feedback gathering are of crucial importance. However, the typical user authentication with username / password and feedback method with a star rating system are not user friendly and often bypassed. This article proposes an alternative method for user authentication based on facial recognition and an automatic feedback gathering method by detecting various face characteristics such as emotions. We studied the use case of video watching. Photos made with the front-facing camera of a tablet, smartphone, or smart TV are used as input of a facial recognition service. The persons in front of the screen can be identified. During video watching, implicit feedback for the video content is automatically gathered through emotion recognition, attention measurements, and behavior analysis. An evaluation with a test panel showed that the recognized emotions are correlated with the user's star ratings and that happiness can be most accurately detected. So as the main contribution, this article indicates that emotion recognition might be used as an alternative feedback mechanism for recommender systems.}},
  author       = {{De Pessemier, Toon and Coppens, Ine and Martens, Luc}},
  issn         = {{1380-7501}},
  journal      = {{MULTIMEDIA TOOLS AND APPLICATIONS}},
  keywords     = {{EMOTION RECOGNITION,Recommender system,Facial analysis,Emotion recognition,Human-computer,interaction}},
  language     = {{eng}},
  number       = {{31-32}},
  pages        = {{23547--23570}},
  title        = {{Evaluating facial recognition services as interaction technique for recommender systems}},
  url          = {{http://doi.org/10.1007/s11042-020-09061-8}},
  volume       = {{79}},
  year         = {{2020}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: