Advanced search
1 file | 2.25 MB Add to list

Recognition of map activities using eye tracking and EEG data

Tong Qin (UGent) , Wim Fias (UGent) , Nico Van de Weghe (UGent) and Haosheng Huang (UGent)
Author
Organization
Project
Abstract
Recognizing the activities being performed on a map is crucial for adaptive map design based on user context. Despite eye tracking (ET) demonstrating potential in recognizing map activities and electroencephalography (EEG) measuring map users' cognitive load, no studies have yet combined ET and EEG for recognition of the user's activity on maps. Our study collected participants' ET and EEG data during four types of map activities. After feature extraction and selection, we trained LightGBM (light Gradient-Boosting Machine) to classify these activities, and achieved 88.0% accuracy when combining ET and EEG features in the entire map usage trial, which is higher than using ET (85.9%) or EEG (53.9%) alone. Acceptable recognition accuracy could also be achieved with the early time windows (73.1% when using the first 3 seconds). Saccade features of ET were the most important for differentiating map activities, indicating selective map content for different tasks. Our findings demonstrate the feasibility and advantages of combining ET and EEG for activity recognition in map use. The results not only improve our understanding of visual patterns and cognitive processes in map use, but also enable the design of adaptive maps that can automatically adapt to the activities a map user is performing.
Keywords
Library and Information Sciences, Geography, Planning and Development, Information Systems, Map activities, activity recognition, eye tracking, electroencephalography, map adaptation, PEDESTRIAN NAVIGATION, ATTENTION, CLASSIFICATION, PERFORMANCE, STRATEGIES, ENTROPY, DESIGN, TASKS

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 2.25 MB

Citation

Please use this url to cite or link to this publication:

MLA
Qin, Tong, et al. “Recognition of Map Activities Using Eye Tracking and EEG Data.” INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, vol. 38, no. 3, 2024, pp. 550–76, doi:10.1080/13658816.2024.2309188.
APA
Qin, T., Fias, W., Van de Weghe, N., & Huang, H. (2024). Recognition of map activities using eye tracking and EEG data. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 38(3), 550–576. https://doi.org/10.1080/13658816.2024.2309188
Chicago author-date
Qin, Tong, Wim Fias, Nico Van de Weghe, and Haosheng Huang. 2024. “Recognition of Map Activities Using Eye Tracking and EEG Data.” INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE 38 (3): 550–76. https://doi.org/10.1080/13658816.2024.2309188.
Chicago author-date (all authors)
Qin, Tong, Wim Fias, Nico Van de Weghe, and Haosheng Huang. 2024. “Recognition of Map Activities Using Eye Tracking and EEG Data.” INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE 38 (3): 550–576. doi:10.1080/13658816.2024.2309188.
Vancouver
1.
Qin T, Fias W, Van de Weghe N, Huang H. Recognition of map activities using eye tracking and EEG data. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE. 2024;38(3):550–76.
IEEE
[1]
T. Qin, W. Fias, N. Van de Weghe, and H. Huang, “Recognition of map activities using eye tracking and EEG data,” INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, vol. 38, no. 3, pp. 550–576, 2024.
@article{01HPZ2RY1QFM5KGTXXZ3EEYP5K,
  abstract     = {{Recognizing the activities being performed on a map is crucial for adaptive map design based on user context. Despite eye tracking (ET) demonstrating potential in recognizing map activities and electroencephalography (EEG) measuring map users' cognitive load, no studies have yet combined ET and EEG for recognition of the user's activity on maps. Our study collected participants' ET and EEG data during four types of map activities. After feature extraction and selection, we trained LightGBM (light Gradient-Boosting Machine) to classify these activities, and achieved 88.0% accuracy when combining ET and EEG features in the entire map usage trial, which is higher than using ET (85.9%) or EEG (53.9%) alone. Acceptable recognition accuracy could also be achieved with the early time windows (73.1% when using the first 3 seconds). Saccade features of ET were the most important for differentiating map activities, indicating selective map content for different tasks. Our findings demonstrate the feasibility and advantages of combining ET and EEG for activity recognition in map use. The results not only improve our understanding of visual patterns and cognitive processes in map use, but also enable the design of adaptive maps that can automatically adapt to the activities a map user is performing.}},
  author       = {{Qin, Tong and Fias, Wim and Van de Weghe, Nico and Huang, Haosheng}},
  issn         = {{1365-8816}},
  journal      = {{INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE}},
  keywords     = {{Library and Information Sciences,Geography, Planning and Development,Information Systems,Map activities,activity recognition,eye tracking,electroencephalography,map adaptation,PEDESTRIAN NAVIGATION,ATTENTION,CLASSIFICATION,PERFORMANCE,STRATEGIES,ENTROPY,DESIGN,TASKS}},
  language     = {{eng}},
  number       = {{3}},
  pages        = {{550--576}},
  title        = {{Recognition of map activities using eye tracking and EEG data}},
  url          = {{http://doi.org/10.1080/13658816.2024.2309188}},
  volume       = {{38}},
  year         = {{2024}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: