Academic Bibliography

 Search 200 years of publications by Ghent University researchers.
Advanced search
1 file | 4.41 MB
Add to list
  1. Search results
  2. The conducting master: an interactive...

The conducting master: an interactive, real-time gesture monitoring system based on spatiotemporal motion templates

Pieter-Jan Maes (UGent) , Denis Amelynck (UGent) , Micheline Lesaffre (UGent) , DK Arvind and Marc Leman (UGent)
(2013) INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION. 29(7). p.471-487
Author
Organization
Abstract
Research in the field of embodied music cognition has shown the importance of coupled processes of body activity (action) and multimodal percepts of these actions (perception) in how music is processed. Technologies in the field of human- computer interaction (HCI) provide excellent means to intervene into, and extend these coupled action-perception processes. In this article we apply this model to a concrete HCI application, called the “Conducting Master”. The application facilitates multiple users to interact in real time with the system through conducting gestures, made in synchrony with the musical meter (i.e., beating-time gestures). Techniques are provided to model and automatically recognize these gestures in order to provide multimodal feedback streams back to the users. These techniques are based on template-based methods that allow approaching beating-time gestures explicitly from a spatiotem- poral account. To conclude, we present some concrete setups in which the functionality of the Conducting Master was evaluated.
Keywords
PERCEPTION, MUSIC, ACTION RECOGNITION, DESIGN, BRAIN, BATON, DANCE, PITCH, SOUND, SHAPE, IPEMapplication, IPEMentrainment

Downloads

  • Download
    (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 4.41 MB

Citation

Please use this url to cite or link to this publication:

MLA
Maes, Pieter-Jan, et al. “The Conducting Master: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion Templates.” INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, vol. 29, no. 7, 2013, pp. 471–87, doi:10.1080/10447318.2012.720197.
APA
Maes, P.-J., Amelynck, D., Lesaffre, M., Arvind, D., & Leman, M. (2013). The conducting master: an interactive, real-time gesture monitoring system based on spatiotemporal motion templates. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 29(7), 471–487. https://doi.org/10.1080/10447318.2012.720197
Chicago author-date
Maes, Pieter-Jan, Denis Amelynck, Micheline Lesaffre, DK Arvind, and Marc Leman. 2013. “The Conducting Master: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion Templates.” INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION 29 (7): 471–87. https://doi.org/10.1080/10447318.2012.720197.
Chicago author-date (all authors)
Maes, Pieter-Jan, Denis Amelynck, Micheline Lesaffre, DK Arvind, and Marc Leman. 2013. “The Conducting Master: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion Templates.” INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION 29 (7): 471–487. doi:10.1080/10447318.2012.720197.
Vancouver
1.
Maes P-J, Amelynck D, Lesaffre M, Arvind D, Leman M. The conducting master: an interactive, real-time gesture monitoring system based on spatiotemporal motion templates. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION. 2013;29(7):471–87.
IEEE
[1]
P.-J. Maes, D. Amelynck, M. Lesaffre, D. Arvind, and M. Leman, “The conducting master: an interactive, real-time gesture monitoring system based on spatiotemporal motion templates,” INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, vol. 29, no. 7, pp. 471–487, 2013.
@article{3230025,
  abstract     = {{Research in the field of embodied music cognition has shown the importance of coupled processes of body activity (action) and multimodal percepts of these actions (perception) in how music is processed. Technologies in the field of human- computer interaction (HCI) provide excellent means to intervene into, and extend these coupled action-perception processes. In this article we apply this model to a concrete HCI application, called the “Conducting Master”. The application facilitates multiple users to interact in real time with the system through conducting gestures, made in synchrony with the musical meter (i.e., beating-time gestures). Techniques are provided to model and automatically recognize these gestures in order to provide multimodal feedback streams back to the users. These techniques are based on template-based methods that allow approaching beating-time gestures explicitly from a spatiotem- poral account. To conclude, we present some concrete setups in which the functionality of the Conducting Master was evaluated.}},
  author       = {{Maes, Pieter-Jan and Amelynck, Denis and Lesaffre, Micheline and Arvind, DK and Leman, Marc}},
  issn         = {{1044-7318}},
  journal      = {{INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION}},
  keywords     = {{PERCEPTION,MUSIC,ACTION RECOGNITION,DESIGN,BRAIN,BATON,DANCE,PITCH,SOUND,SHAPE,IPEMapplication,IPEMentrainment}},
  language     = {{eng}},
  number       = {{7}},
  pages        = {{471--487}},
  title        = {{The conducting master: an interactive, real-time gesture monitoring system based on spatiotemporal motion templates}},
  url          = {{http://doi.org/10.1080/10447318.2012.720197}},
  volume       = {{29}},
  year         = {{2013}},
}
Altmetric
View in Altmetric
Web of Science
Times cited: