Evaluating facial recognition services as interaction technique for recommender systems
- Author
- Toon De Pessemier (UGent) , Ine Coppens (UGent) and Luc Martens (UGent)
- Organization
- Abstract
- Recommender systems are tools and techniques to assist users in the content selection process thereby coping with the problem of information overload. For recommender systems, user authentication and feedback gathering are of crucial importance. However, the typical user authentication with username / password and feedback method with a star rating system are not user friendly and often bypassed. This article proposes an alternative method for user authentication based on facial recognition and an automatic feedback gathering method by detecting various face characteristics such as emotions. We studied the use case of video watching. Photos made with the front-facing camera of a tablet, smartphone, or smart TV are used as input of a facial recognition service. The persons in front of the screen can be identified. During video watching, implicit feedback for the video content is automatically gathered through emotion recognition, attention measurements, and behavior analysis. An evaluation with a test panel showed that the recognized emotions are correlated with the user's star ratings and that happiness can be most accurately detected. So as the main contribution, this article indicates that emotion recognition might be used as an alternative feedback mechanism for recommender systems.
- Keywords
- EMOTION RECOGNITION, Recommender system, Facial analysis, Emotion recognition, Human-computer, interaction
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 2.07 MB
-
WICA 943a.pdf
- full text (Accepted manuscript)
- |
- open access
- |
- |
- 2.67 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8677259
- MLA
- De Pessemier, Toon, et al. “Evaluating Facial Recognition Services as Interaction Technique for Recommender Systems.” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 79, no. 31–32, 2020, pp. 23547–70, doi:10.1007/s11042-020-09061-8.
- APA
- De Pessemier, T., Coppens, I., & Martens, L. (2020). Evaluating facial recognition services as interaction technique for recommender systems. MULTIMEDIA TOOLS AND APPLICATIONS, 79(31–32), 23547–23570. https://doi.org/10.1007/s11042-020-09061-8
- Chicago author-date
- De Pessemier, Toon, Ine Coppens, and Luc Martens. 2020. “Evaluating Facial Recognition Services as Interaction Technique for Recommender Systems.” MULTIMEDIA TOOLS AND APPLICATIONS 79 (31–32): 23547–70. https://doi.org/10.1007/s11042-020-09061-8.
- Chicago author-date (all authors)
- De Pessemier, Toon, Ine Coppens, and Luc Martens. 2020. “Evaluating Facial Recognition Services as Interaction Technique for Recommender Systems.” MULTIMEDIA TOOLS AND APPLICATIONS 79 (31–32): 23547–23570. doi:10.1007/s11042-020-09061-8.
- Vancouver
- 1.De Pessemier T, Coppens I, Martens L. Evaluating facial recognition services as interaction technique for recommender systems. MULTIMEDIA TOOLS AND APPLICATIONS. 2020;79(31–32):23547–70.
- IEEE
- [1]T. De Pessemier, I. Coppens, and L. Martens, “Evaluating facial recognition services as interaction technique for recommender systems,” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 79, no. 31–32, pp. 23547–23570, 2020.
@article{8677259, abstract = {{Recommender systems are tools and techniques to assist users in the content selection process thereby coping with the problem of information overload. For recommender systems, user authentication and feedback gathering are of crucial importance. However, the typical user authentication with username / password and feedback method with a star rating system are not user friendly and often bypassed. This article proposes an alternative method for user authentication based on facial recognition and an automatic feedback gathering method by detecting various face characteristics such as emotions. We studied the use case of video watching. Photos made with the front-facing camera of a tablet, smartphone, or smart TV are used as input of a facial recognition service. The persons in front of the screen can be identified. During video watching, implicit feedback for the video content is automatically gathered through emotion recognition, attention measurements, and behavior analysis. An evaluation with a test panel showed that the recognized emotions are correlated with the user's star ratings and that happiness can be most accurately detected. So as the main contribution, this article indicates that emotion recognition might be used as an alternative feedback mechanism for recommender systems.}}, author = {{De Pessemier, Toon and Coppens, Ine and Martens, Luc}}, issn = {{1380-7501}}, journal = {{MULTIMEDIA TOOLS AND APPLICATIONS}}, keywords = {{EMOTION RECOGNITION,Recommender system,Facial analysis,Emotion recognition,Human-computer,interaction}}, language = {{eng}}, number = {{31-32}}, pages = {{23547--23570}}, title = {{Evaluating facial recognition services as interaction technique for recommender systems}}, url = {{http://doi.org/10.1007/s11042-020-09061-8}}, volume = {{79}}, year = {{2020}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: