
Thermal infrared video stabilization for aerial monitoring of active wildfires
- Author
- Mario Miguel Valero, Steven Verstockt (UGent) , Bret Butler, Daniel Jimenez, Oriol Rios, Christian Mata, LLoyd Queen, Elsa Pastor and Eulalia Planas
- Organization
- Abstract
- Measuring wildland fire behavior is essential for fire science and fire management. Aerial thermal infrared (TIR) imaging provides outstanding opportunities to acquire such information remotely. Variables such as fire rate of spread (ROS), fire radiative power (FRP), and fireline intensity may be measured explicitly both in time and space, providing the necessary data to study the response of fire behavior to weather, vegetation, topography, and firefighting efforts. However, raw TIR imagery acquired by unmanned aerial vehicles (UAVs) requires stabilization and georeferencing before any other processing can be performed. Aerial video usually suffers from instabilities produced by sensor movement. This problem is especially acute near an active wildfire due to fire-generated turbulence. Furthermore, the nature of fire TIR video presents some specific challenges that hinder robust interframe registration. Therefore, this article presents a software-based video stabilization algorithm specifically designed for TIR imagery of forest fires. After a comparative analysis of existing image registration algorithms, the KAZE feature-matching method was selected and accompanied by pre- and postprocessing modules. These included foreground histogram equalization and a multireference framework designed to increase the algorithm's robustness in the presence of missing or faulty frames. The performance of the proposed algorithm was validated in a total of nine video sequences acquired during field fire experiments. The proposed algorithm yielded a registration accuracy between 10 and 1000x higher than other tested methods, returned 10x more meaningful feature matches, and proved robust in the presence of faulty video frames. The ability to automatically cancel camera movement for every frame in a video sequence solves a key limitation in data processing pipelines and opens the door to a number of systematic fire behavior experimental analyses. Moreover, a completely automated process supports the development of decision support tools that can operate in real time during an emergency.
- Keywords
- Cameras, Image registration, Video sequences, Monitoring, Annotations, Unmanned aerial vehicles, Temperature measurement, Fire behavior, image registration, KAZE, remote sensing, unmanned aerial systems (UAS), video stabilization, wildland fire
Downloads
-
Ds418.pdf
- full text (Published version)
- |
- open access
- |
- |
- 3.51 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8704534
- MLA
- Valero, Mario Miguel, et al. “Thermal Infrared Video Stabilization for Aerial Monitoring of Active Wildfires.” IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, vol. 14, 2021, pp. 2817–32, doi:10.1109/JSTARS.2021.3059054.
- APA
- Valero, M. M., Verstockt, S., Butler, B., Jimenez, D., Rios, O., Mata, C., … Planas, E. (2021). Thermal infrared video stabilization for aerial monitoring of active wildfires. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 14, 2817–2832. https://doi.org/10.1109/JSTARS.2021.3059054
- Chicago author-date
- Valero, Mario Miguel, Steven Verstockt, Bret Butler, Daniel Jimenez, Oriol Rios, Christian Mata, LLoyd Queen, Elsa Pastor, and Eulalia Planas. 2021. “Thermal Infrared Video Stabilization for Aerial Monitoring of Active Wildfires.” IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING 14: 2817–32. https://doi.org/10.1109/JSTARS.2021.3059054.
- Chicago author-date (all authors)
- Valero, Mario Miguel, Steven Verstockt, Bret Butler, Daniel Jimenez, Oriol Rios, Christian Mata, LLoyd Queen, Elsa Pastor, and Eulalia Planas. 2021. “Thermal Infrared Video Stabilization for Aerial Monitoring of Active Wildfires.” IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING 14: 2817–2832. doi:10.1109/JSTARS.2021.3059054.
- Vancouver
- 1.Valero MM, Verstockt S, Butler B, Jimenez D, Rios O, Mata C, et al. Thermal infrared video stabilization for aerial monitoring of active wildfires. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING. 2021;14:2817–32.
- IEEE
- [1]M. M. Valero et al., “Thermal infrared video stabilization for aerial monitoring of active wildfires,” IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, vol. 14, pp. 2817–2832, 2021.
@article{8704534, abstract = {{Measuring wildland fire behavior is essential for fire science and fire management. Aerial thermal infrared (TIR) imaging provides outstanding opportunities to acquire such information remotely. Variables such as fire rate of spread (ROS), fire radiative power (FRP), and fireline intensity may be measured explicitly both in time and space, providing the necessary data to study the response of fire behavior to weather, vegetation, topography, and firefighting efforts. However, raw TIR imagery acquired by unmanned aerial vehicles (UAVs) requires stabilization and georeferencing before any other processing can be performed. Aerial video usually suffers from instabilities produced by sensor movement. This problem is especially acute near an active wildfire due to fire-generated turbulence. Furthermore, the nature of fire TIR video presents some specific challenges that hinder robust interframe registration. Therefore, this article presents a software-based video stabilization algorithm specifically designed for TIR imagery of forest fires. After a comparative analysis of existing image registration algorithms, the KAZE feature-matching method was selected and accompanied by pre- and postprocessing modules. These included foreground histogram equalization and a multireference framework designed to increase the algorithm's robustness in the presence of missing or faulty frames. The performance of the proposed algorithm was validated in a total of nine video sequences acquired during field fire experiments. The proposed algorithm yielded a registration accuracy between 10 and 1000x higher than other tested methods, returned 10x more meaningful feature matches, and proved robust in the presence of faulty video frames. The ability to automatically cancel camera movement for every frame in a video sequence solves a key limitation in data processing pipelines and opens the door to a number of systematic fire behavior experimental analyses. Moreover, a completely automated process supports the development of decision support tools that can operate in real time during an emergency.}}, author = {{Valero, Mario Miguel and Verstockt, Steven and Butler, Bret and Jimenez, Daniel and Rios, Oriol and Mata, Christian and Queen, LLoyd and Pastor, Elsa and Planas, Eulalia}}, issn = {{1939-1404}}, journal = {{IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING}}, keywords = {{Cameras,Image registration,Video sequences,Monitoring,Annotations,Unmanned aerial vehicles,Temperature measurement,Fire behavior,image registration,KAZE,remote sensing,unmanned aerial systems (UAS),video stabilization,wildland fire}}, language = {{eng}}, pages = {{2817--2832}}, title = {{Thermal infrared video stabilization for aerial monitoring of active wildfires}}, url = {{http://doi.org/10.1109/JSTARS.2021.3059054}}, volume = {{14}}, year = {{2021}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: