Advanced search
1 file | 55.32 MB Add to list

Point of interest recognition and tracking in aerial video during live cycling broadcasts

Jelle Vanhaeverbeke (UGent) , Robbe Decorte (UGent) , Maarten Slembrouck (UGent) , Sofie Van Hoecke (UGent) and Steven Verstockt (UGent)
Author
Organization
Abstract
Road cycling races, such as the Tour de France, captivate millions of viewers globally, combining competitive sportsmanship with the promotion of regional landmarks. Traditionally, points of interest (POIs) are highlighted during broadcasts using manually created static overlays, a process that is both outdated and labor-intensive. This paper presents a novel, fully automated methodology for detecting and tracking POIs in live helicopter video streams, aiming to streamline the visualization workflow and enhance viewer engagement. Our approach integrates a saliency and Segment Anything-based technique to propose potential POI regions, which are then recognized using a keypoint matching method that requires only a few reference images. This system supports both automatic and semi-automatic operations, allowing video editors to intervene when necessary, thereby balancing automation with manual control. The proposed pipeline demonstrated high effectiveness, achieving over 75% precision and recall in POI detection, and offers two tracking solutions: a traditional MedianFlow tracker and an advanced SAM 2 tracker. While the former provides speed and simplicity, the latter delivers superior segmentation tracking, albeit with higher computational demands. Our findings suggest that this methodology significantly reduces manual workload and opens new possibilities for interactive visualizations, enhancing the live viewing experience of cycling races.
Keywords
landmark recognition, object tracking, computer vision, live processing, aerial video, END

Downloads

  • DS827.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 55.32 MB

Citation

Please use this url to cite or link to this publication:

MLA
Vanhaeverbeke, Jelle, et al. “Point of Interest Recognition and Tracking in Aerial Video during Live Cycling Broadcasts.” APPLIED SCIENCES-BASEL, vol. 14, no. 20, 2024, doi:10.3390/app14209246.
APA
Vanhaeverbeke, J., Decorte, R., Slembrouck, M., Van Hoecke, S., & Verstockt, S. (2024). Point of interest recognition and tracking in aerial video during live cycling broadcasts. APPLIED SCIENCES-BASEL, 14(20). https://doi.org/10.3390/app14209246
Chicago author-date
Vanhaeverbeke, Jelle, Robbe Decorte, Maarten Slembrouck, Sofie Van Hoecke, and Steven Verstockt. 2024. “Point of Interest Recognition and Tracking in Aerial Video during Live Cycling Broadcasts.” APPLIED SCIENCES-BASEL 14 (20). https://doi.org/10.3390/app14209246.
Chicago author-date (all authors)
Vanhaeverbeke, Jelle, Robbe Decorte, Maarten Slembrouck, Sofie Van Hoecke, and Steven Verstockt. 2024. “Point of Interest Recognition and Tracking in Aerial Video during Live Cycling Broadcasts.” APPLIED SCIENCES-BASEL 14 (20). doi:10.3390/app14209246.
Vancouver
1.
Vanhaeverbeke J, Decorte R, Slembrouck M, Van Hoecke S, Verstockt S. Point of interest recognition and tracking in aerial video during live cycling broadcasts. APPLIED SCIENCES-BASEL. 2024;14(20).
IEEE
[1]
J. Vanhaeverbeke, R. Decorte, M. Slembrouck, S. Van Hoecke, and S. Verstockt, “Point of interest recognition and tracking in aerial video during live cycling broadcasts,” APPLIED SCIENCES-BASEL, vol. 14, no. 20, 2024.
@article{01JBVCFWPFBGEDWK45TG0SM4ER,
  abstract     = {{Road cycling races, such as the Tour de France, captivate millions of viewers globally, combining competitive sportsmanship with the promotion of regional landmarks. Traditionally, points of interest (POIs) are highlighted during broadcasts using manually created static overlays, a process that is both outdated and labor-intensive. This paper presents a novel, fully automated methodology for detecting and tracking POIs in live helicopter video streams, aiming to streamline the visualization workflow and enhance viewer engagement. Our approach integrates a saliency and Segment Anything-based technique to propose potential POI regions, which are then recognized using a keypoint matching method that requires only a few reference images. This system supports both automatic and semi-automatic operations, allowing video editors to intervene when necessary, thereby balancing automation with manual control. The proposed pipeline demonstrated high effectiveness, achieving over 75% precision and recall in POI detection, and offers two tracking solutions: a traditional MedianFlow tracker and an advanced SAM 2 tracker. While the former provides speed and simplicity, the latter delivers superior segmentation tracking, albeit with higher computational demands. Our findings suggest that this methodology significantly reduces manual workload and opens new possibilities for interactive visualizations, enhancing the live viewing experience of cycling races.}},
  articleno    = {{9246}},
  author       = {{Vanhaeverbeke, Jelle and Decorte, Robbe and Slembrouck, Maarten and Van Hoecke, Sofie and Verstockt, Steven}},
  issn         = {{2076-3417}},
  journal      = {{APPLIED SCIENCES-BASEL}},
  keywords     = {{landmark recognition,object tracking,computer vision,live processing,aerial video,END}},
  language     = {{eng}},
  number       = {{20}},
  pages        = {{20}},
  title        = {{Point of interest recognition and tracking in aerial video during live cycling broadcasts}},
  url          = {{http://doi.org/10.3390/app14209246}},
  volume       = {{14}},
  year         = {{2024}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: