Multiview 3D markerless human pose estimation from OpenPose skeletons
(2020)
Advanced concepts for intelligent vision systems - ACIVS 2020.
In Lecture Notes in Computer Science
12002.
p.166-178
- Author
- Maarten Slembrouck (UGent) , Hiep Luong (UGent) , Joeri Gerlo (UGent) , Kurt Schütte, Dimitri Van Cauwelaert (UGent) , Dirk De Clercq (UGent) , Benedicte Vanwanseele, Peter Veelaert (UGent) and Wilfried Philips (UGent)
- Organization
- Abstract
- Despite the fact that marker-based systems for human motion estimation provide very accurate tracking of the human body joints (at mm precision), these systems are often intrusive or even impossible to use depending on the circumstances, e.g.~markers cannot be put on an athlete during competition. Instrumenting an athlete with the appropriate number of markers requires a lot of time and these markers may fall off during the analysis, which leads to incomplete data and requires new data capturing sessions and hence a waste of time and effort. Therefore, we present a novel multiview video-based markerless system that uses 2D joint detections per view (from OpenPose) to estimate their corresponding 3D positions while tackling the people association problem in the process to allow the tracking of multiple persons at the same time. Our proposed system can perform the tracking in real-time at 20-25 fps. Our results show a standard deviation between 9.6 and 23.7 mm for the lower body joints based on the raw measurements only. After filtering the data, the standard deviation drops to a range between 6.6 and 21.3 mm. Our proposed solution can be applied to a large number of applications, ranging from sports analysis to virtual classrooms where submillimeter precision is not necessarily required, but where the use of markers is impractical.
- Keywords
- Markerless human motion, joint detection, multiview
Downloads
-
paper117.pdf
- full text (Accepted manuscript)
- |
- open access
- |
- |
- 6.53 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8638312
- MLA
- Slembrouck, Maarten, et al. “Multiview 3D Markerless Human Pose Estimation from OpenPose Skeletons.” Advanced Concepts for Intelligent Vision Systems - ACIVS 2020, edited by Jacques Blanc-Talon et al., vol. 12002, Springer, 2020, pp. 166–78, doi:10.1007/978-3-030-40605-9_15.
- APA
- Slembrouck, M., Luong, H., Gerlo, J., Schütte, K., Van Cauwelaert, D., De Clercq, D., … Philips, W. (2020). Multiview 3D markerless human pose estimation from OpenPose skeletons. In J. Blanc-Talon, P. Delmas, W. Philips, D. Popescu, & P. Scheunders (Eds.), Advanced concepts for intelligent vision systems - ACIVS 2020 (Vol. 12002, pp. 166–178). https://doi.org/10.1007/978-3-030-40605-9_15
- Chicago author-date
- Slembrouck, Maarten, Hiep Luong, Joeri Gerlo, Kurt Schütte, Dimitri Van Cauwelaert, Dirk De Clercq, Benedicte Vanwanseele, Peter Veelaert, and Wilfried Philips. 2020. “Multiview 3D Markerless Human Pose Estimation from OpenPose Skeletons.” In Advanced Concepts for Intelligent Vision Systems - ACIVS 2020, edited by Jacques Blanc-Talon, Patrice Delmas, Wilfried Philips, Dan Popescu, and Paul Scheunders, 12002:166–78. Springer. https://doi.org/10.1007/978-3-030-40605-9_15.
- Chicago author-date (all authors)
- Slembrouck, Maarten, Hiep Luong, Joeri Gerlo, Kurt Schütte, Dimitri Van Cauwelaert, Dirk De Clercq, Benedicte Vanwanseele, Peter Veelaert, and Wilfried Philips. 2020. “Multiview 3D Markerless Human Pose Estimation from OpenPose Skeletons.” In Advanced Concepts for Intelligent Vision Systems - ACIVS 2020, ed by. Jacques Blanc-Talon, Patrice Delmas, Wilfried Philips, Dan Popescu, and Paul Scheunders, 12002:166–178. Springer. doi:10.1007/978-3-030-40605-9_15.
- Vancouver
- 1.Slembrouck M, Luong H, Gerlo J, Schütte K, Van Cauwelaert D, De Clercq D, et al. Multiview 3D markerless human pose estimation from OpenPose skeletons. In: Blanc-Talon J, Delmas P, Philips W, Popescu D, Scheunders P, editors. Advanced concepts for intelligent vision systems - ACIVS 2020. Springer; 2020. p. 166–78.
- IEEE
- [1]M. Slembrouck et al., “Multiview 3D markerless human pose estimation from OpenPose skeletons,” in Advanced concepts for intelligent vision systems - ACIVS 2020, Auckland, New Zealand, 2020, vol. 12002, pp. 166–178.
@inproceedings{8638312,
abstract = {{Despite the fact that marker-based systems for human motion estimation provide very accurate tracking of the human body joints (at mm precision), these systems are often intrusive or even impossible to use depending on the circumstances, e.g.~markers cannot be put on an athlete during competition. Instrumenting an athlete with the appropriate number of markers requires a lot of time and these markers may fall off during the analysis, which leads to incomplete data and requires new data capturing sessions and hence a waste of time and effort. Therefore, we present a novel multiview video-based markerless system that uses 2D joint detections per view (from OpenPose) to estimate their corresponding 3D positions while tackling the people association problem in the process to allow the tracking of multiple persons at the same time. Our proposed system can perform the tracking in real-time at 20-25 fps. Our results show a standard deviation between 9.6 and 23.7 mm for the lower body joints based on the raw measurements only. After filtering the data, the standard deviation drops to a range between 6.6 and 21.3 mm. Our proposed solution can be applied to a large number of applications, ranging from sports analysis to virtual classrooms where submillimeter precision is not necessarily required, but where the use of markers is impractical.}},
author = {{Slembrouck, Maarten and Luong, Hiep and Gerlo, Joeri and Schütte, Kurt and Van Cauwelaert, Dimitri and De Clercq, Dirk and Vanwanseele, Benedicte and Veelaert, Peter and Philips, Wilfried}},
booktitle = {{Advanced concepts for intelligent vision systems - ACIVS 2020}},
editor = {{Blanc-Talon, Jacques and Delmas, Patrice and Philips, Wilfried and Popescu, Dan and Scheunders, Paul}},
isbn = {{9783030406042}},
issn = {{0302-9743}},
keywords = {{Markerless human motion,joint detection,multiview}},
language = {{eng}},
location = {{Auckland, New Zealand}},
pages = {{166--178}},
publisher = {{Springer}},
title = {{Multiview 3D markerless human pose estimation from OpenPose skeletons}},
url = {{http://doi.org/10.1007/978-3-030-40605-9_15}},
volume = {{12002}},
year = {{2020}},
}
- Altmetric
- View in Altmetric