Point of interest recognition and tracking in aerial video during live cycling broadcasts
- Author
- Jelle Vanhaeverbeke (UGent) , Robbe Decorte (UGent) , Maarten Slembrouck (UGent) , Sofie Van Hoecke (UGent) and Steven Verstockt (UGent)
- Organization
- Abstract
- Road cycling races, such as the Tour de France, captivate millions of viewers globally, combining competitive sportsmanship with the promotion of regional landmarks. Traditionally, points of interest (POIs) are highlighted during broadcasts using manually created static overlays, a process that is both outdated and labor-intensive. This paper presents a novel, fully automated methodology for detecting and tracking POIs in live helicopter video streams, aiming to streamline the visualization workflow and enhance viewer engagement. Our approach integrates a saliency and Segment Anything-based technique to propose potential POI regions, which are then recognized using a keypoint matching method that requires only a few reference images. This system supports both automatic and semi-automatic operations, allowing video editors to intervene when necessary, thereby balancing automation with manual control. The proposed pipeline demonstrated high effectiveness, achieving over 75% precision and recall in POI detection, and offers two tracking solutions: a traditional MedianFlow tracker and an advanced SAM 2 tracker. While the former provides speed and simplicity, the latter delivers superior segmentation tracking, albeit with higher computational demands. Our findings suggest that this methodology significantly reduces manual workload and opens new possibilities for interactive visualizations, enhancing the live viewing experience of cycling races.
- Keywords
- landmark recognition, object tracking, computer vision, live processing, aerial video, END
Downloads
-
DS827.pdf
- full text (Published version)
- |
- open access
- |
- |
- 55.32 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01JBVCFWPFBGEDWK45TG0SM4ER
- MLA
- Vanhaeverbeke, Jelle, et al. “Point of Interest Recognition and Tracking in Aerial Video during Live Cycling Broadcasts.” APPLIED SCIENCES-BASEL, vol. 14, no. 20, 2024, doi:10.3390/app14209246.
- APA
- Vanhaeverbeke, J., Decorte, R., Slembrouck, M., Van Hoecke, S., & Verstockt, S. (2024). Point of interest recognition and tracking in aerial video during live cycling broadcasts. APPLIED SCIENCES-BASEL, 14(20). https://doi.org/10.3390/app14209246
- Chicago author-date
- Vanhaeverbeke, Jelle, Robbe Decorte, Maarten Slembrouck, Sofie Van Hoecke, and Steven Verstockt. 2024. “Point of Interest Recognition and Tracking in Aerial Video during Live Cycling Broadcasts.” APPLIED SCIENCES-BASEL 14 (20). https://doi.org/10.3390/app14209246.
- Chicago author-date (all authors)
- Vanhaeverbeke, Jelle, Robbe Decorte, Maarten Slembrouck, Sofie Van Hoecke, and Steven Verstockt. 2024. “Point of Interest Recognition and Tracking in Aerial Video during Live Cycling Broadcasts.” APPLIED SCIENCES-BASEL 14 (20). doi:10.3390/app14209246.
- Vancouver
- 1.Vanhaeverbeke J, Decorte R, Slembrouck M, Van Hoecke S, Verstockt S. Point of interest recognition and tracking in aerial video during live cycling broadcasts. APPLIED SCIENCES-BASEL. 2024;14(20).
- IEEE
- [1]J. Vanhaeverbeke, R. Decorte, M. Slembrouck, S. Van Hoecke, and S. Verstockt, “Point of interest recognition and tracking in aerial video during live cycling broadcasts,” APPLIED SCIENCES-BASEL, vol. 14, no. 20, 2024.
@article{01JBVCFWPFBGEDWK45TG0SM4ER,
abstract = {{Road cycling races, such as the Tour de France, captivate millions of viewers globally, combining competitive sportsmanship with the promotion of regional landmarks. Traditionally, points of interest (POIs) are highlighted during broadcasts using manually created static overlays, a process that is both outdated and labor-intensive. This paper presents a novel, fully automated methodology for detecting and tracking POIs in live helicopter video streams, aiming to streamline the visualization workflow and enhance viewer engagement. Our approach integrates a saliency and Segment Anything-based technique to propose potential POI regions, which are then recognized using a keypoint matching method that requires only a few reference images. This system supports both automatic and semi-automatic operations, allowing video editors to intervene when necessary, thereby balancing automation with manual control. The proposed pipeline demonstrated high effectiveness, achieving over 75% precision and recall in POI detection, and offers two tracking solutions: a traditional MedianFlow tracker and an advanced SAM 2 tracker. While the former provides speed and simplicity, the latter delivers superior segmentation tracking, albeit with higher computational demands. Our findings suggest that this methodology significantly reduces manual workload and opens new possibilities for interactive visualizations, enhancing the live viewing experience of cycling races.}},
articleno = {{9246}},
author = {{Vanhaeverbeke, Jelle and Decorte, Robbe and Slembrouck, Maarten and Van Hoecke, Sofie and Verstockt, Steven}},
issn = {{2076-3417}},
journal = {{APPLIED SCIENCES-BASEL}},
keywords = {{landmark recognition,object tracking,computer vision,live processing,aerial video,END}},
language = {{eng}},
number = {{20}},
pages = {{20}},
title = {{Point of interest recognition and tracking in aerial video during live cycling broadcasts}},
url = {{http://doi.org/10.3390/app14209246}},
volume = {{14}},
year = {{2024}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: