Advanced search
1 file | 935.84 KB Add to list

Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli

(2009) EXPERIMENTAL BRAIN RESEARCH. 198(2-2). p.313-328
Author
Organization
Abstract
The temporal asynchrony between inputs to different sensory modalities has been shown to be a critical factor influencing the interaction between such inputs. We used scalp-recorded event-related potentials (ERPs) to investigate the effects of attention on the processing of audiovisual multisensory stimuli as the temporal asynchrony between the auditory and visual inputs varied across the audiovisual integration window (i.e., up to 125 ms). Randomized streams of unisensory auditory stimuli, unisensory visual stimuli, and audiovisual stimuli (consisting of the temporally proximal presentation of the visual and auditory stimulus components) were presented centrally while participants attended to either the auditory or the visual modality to detect occasional target stimuli in that modality. ERPs elicited by each of the contributing sensory modalities were extracted by signal processing techniques from the combined ERP waveforms elicited by the multisensory stimuli. This was done for each of the five different 50-ms subranges of stimulus onset asynchrony (SOA: e. g., V precedes A by 125-75 ms, by 75-25 ms, etc.). The extracted ERPs for the visual inputs of the multisensory stimuli were compared among each other and with the ERPs to the unisensory visual control stimuli, separately when attention was directed to the visual or to the auditory modality. The results showed that the attention effects on the right-hemisphere visual P1 was largest when auditory and visual stimuli were temporally aligned. In contrast, the N1 attention effect was smallest at this latency, suggesting that attention may play a role in the processing of the relative temporal alignment of the constituent parts of multisensory stimuli. At longer latencies an occipital selection negativity for the attended versus unattended visual stimuli was also observed, but this effect did not vary as a function of SOA, suggesting that by that latency a stable representation of the auditory and visual stimulus components has been established.
Keywords
MULTISENSORY INTEGRATION, SUPERIOR COLLICULUS, SELECTIVE ATTENTION, AUDITORY-VISUAL INTERACTIONS, EVENT-RELATED POTENTIALS, PERVASIVE DEVELOPMENTAL DISORDER, VENTRILOQUISM, PERCEPTION, SOUND, TIME

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 935.84 KB

Citation

Please use this url to cite or link to this publication:

MLA
Talsma, Durk, Daniel Senkowski, and Marty Woldorff. “Intermodal Attention Affects the Processing of the Temporal Alignment of Audiovisual Stimuli.” EXPERIMENTAL BRAIN RESEARCH 198.2-2 (2009): 313–328. Print.
APA
Talsma, Durk, Senkowski, D., & Woldorff, M. (2009). Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli. EXPERIMENTAL BRAIN RESEARCH, 198(2-2), 313–328.
Chicago author-date
Talsma, Durk, Daniel Senkowski, and Marty Woldorff. 2009. “Intermodal Attention Affects the Processing of the Temporal Alignment of Audiovisual Stimuli.” Experimental Brain Research 198 (2-2): 313–328.
Chicago author-date (all authors)
Talsma, Durk, Daniel Senkowski, and Marty Woldorff. 2009. “Intermodal Attention Affects the Processing of the Temporal Alignment of Audiovisual Stimuli.” Experimental Brain Research 198 (2-2): 313–328.
Vancouver
1.
Talsma D, Senkowski D, Woldorff M. Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli. EXPERIMENTAL BRAIN RESEARCH. 2009;198(2-2):313–28.
IEEE
[1]
D. Talsma, D. Senkowski, and M. Woldorff, “Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli,” EXPERIMENTAL BRAIN RESEARCH, vol. 198, no. 2–2, pp. 313–328, 2009.
@article{4082260,
  abstract     = {The temporal asynchrony between inputs to different sensory modalities has been shown to be a critical factor influencing the interaction between such inputs. We used scalp-recorded event-related potentials (ERPs) to investigate the effects of attention on the processing of audiovisual multisensory stimuli as the temporal asynchrony between the auditory and visual inputs varied across the audiovisual integration window (i.e., up to 125 ms). Randomized streams of unisensory auditory stimuli, unisensory visual stimuli, and audiovisual stimuli (consisting of the temporally proximal presentation of the visual and auditory stimulus components) were presented centrally while participants attended to either the auditory or the visual modality to detect occasional target stimuli in that modality. ERPs elicited by each of the contributing sensory modalities were extracted by signal processing techniques from the combined ERP waveforms elicited by the multisensory stimuli. This was done for each of the five different 50-ms subranges of stimulus onset asynchrony (SOA: e. g., V precedes A by 125-75 ms, by 75-25 ms, etc.). The extracted ERPs for the visual inputs of the multisensory stimuli were compared among each other and with the ERPs to the unisensory visual control stimuli, separately when attention was directed to the visual or to the auditory modality. The results showed that the attention effects on the right-hemisphere visual P1 was largest when auditory and visual stimuli were temporally aligned. In contrast, the N1 attention effect was smallest at this latency, suggesting that attention may play a role in the processing of the relative temporal alignment of the constituent parts of multisensory stimuli. At longer latencies an occipital selection negativity for the attended versus unattended visual stimuli was also observed, but this effect did not vary as a function of SOA, suggesting that by that latency a stable representation of the auditory and visual stimulus components has been established.},
  author       = {Talsma, Durk and Senkowski, Daniel and Woldorff, Marty},
  issn         = {0014-4819},
  journal      = {EXPERIMENTAL BRAIN RESEARCH},
  keywords     = {MULTISENSORY INTEGRATION,SUPERIOR COLLICULUS,SELECTIVE ATTENTION,AUDITORY-VISUAL INTERACTIONS,EVENT-RELATED POTENTIALS,PERVASIVE DEVELOPMENTAL DISORDER,VENTRILOQUISM,PERCEPTION,SOUND,TIME},
  language     = {eng},
  number       = {2-2},
  pages        = {313--328},
  title        = {Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli},
  volume       = {198},
  year         = {2009},
}

Web of Science
Times cited: