Academic Bibliography

 Search 200 years of publications by Ghent University researchers.
Advanced search
1 file | 2.11 MB
Add to list
  1. Search results
  2. The empirical replicability of task-b...

The empirical replicability of task-based fMRI as a function of sample size

Han Bossier (UGent) , Sanne Roels (UGent) , Ruth Seurinck (UGent) , Tobias Banaschewski, Gareth J. Barker, Arun L. W. Bokde, Erin Burke Quinlan, Sylvane Desrivières, Herta Flor, Antoine Grigis, et al.
(2020) NEUROIMAGE. 212.
Author
Organization
Abstract
Replicating results (i.e. obtaining consistent results using a new independent dataset) is an essential part of good science. As replicability has consequences for theories derived from empirical studies, it is of utmost importance to better understand the underlying mechanisms influencing it. A popular tool for non-invasive neuroimaging studies is functional magnetic resonance imaging (fMRI). While the effect of underpowered studies is well documented, the empirical assessment of the interplay between sample size and replicability of results for task-based fMRI studies remains limited. In this work, we extend existing work on this assessment in two ways. Firstly, we use a large database of 1400 subjects performing four types of tasks from the IMAGEN project to subsample a series of independent samples of increasing size. Secondly, replicability is evaluated using a multi-dimensional framework consisting of 3 different measures: (un)conditional test-retest reliability, coherence and stability. We demonstrate not only a positive effect of sample size, but also a trade-off between spatial resolution and replicability. When replicability is assessed voxelwise or when observing small areas of activation, a larger sample size than typically used in fMRI is required to replicate results. On the other hand, when focussing on clusters of voxels, we observe a higher replicability. In addition, we observe variability in the size of clusters of activation between experimental paradigms or contrasts of parameter estimates within these.
Keywords
Task-based fMRI, Replicability, Reproducibility, Reliability, Stability, Coherence, TEST-RETEST RELIABILITY, NEUROIMAGING DATA, POWER CALCULATION, MR-IMAGES, REPRODUCIBILITY, PERMUTATION, INFERENCE, TESTS, METAANALYSIS, FAILURE

Downloads

  • Download
    1-s2.0-S1053811920300884-main.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 2.11 MB

Citation

Please use this url to cite or link to this publication:

MLA
Bossier, Han, et al. “The Empirical Replicability of Task-Based FMRI as a Function of Sample Size.” NEUROIMAGE, vol. 212, 2020, doi:10.1016/j.neuroimage.2020.116601.
APA
Bossier, H., Roels, S., Seurinck, R., Banaschewski, T., Barker, G. J., Bokde, A. L. W., … Moerkerke, B. (2020). The empirical replicability of task-based fMRI as a function of sample size. NEUROIMAGE, 212. https://doi.org/10.1016/j.neuroimage.2020.116601
Chicago author-date
Bossier, Han, Sanne Roels, Ruth Seurinck, Tobias Banaschewski, Gareth J. Barker, Arun L. W. Bokde, Erin Burke Quinlan, et al. 2020. “The Empirical Replicability of Task-Based FMRI as a Function of Sample Size.” NEUROIMAGE 212. https://doi.org/10.1016/j.neuroimage.2020.116601.
Chicago author-date (all authors)
Bossier, Han, Sanne Roels, Ruth Seurinck, Tobias Banaschewski, Gareth J. Barker, Arun L. W. Bokde, Erin Burke Quinlan, Sylvane Desrivières, Herta Flor, Antoine Grigis, Hugh Garavan, Penny Gowland, Andreas Heinz, Bernd Ittermann, Jean-Luc Martinot, Eric Artiges, Frauke Nees, Dimitri Papadopoulos Orfanos, Luise Poustka, Juliane H. Fröhner Dipl-Psych, Michael N. Smolka, Henrik Walter, Robert Whelan, Gunter Schumann, and Beatrijs Moerkerke. 2020. “The Empirical Replicability of Task-Based FMRI as a Function of Sample Size.” NEUROIMAGE 212. doi:10.1016/j.neuroimage.2020.116601.
Vancouver
1.
Bossier H, Roels S, Seurinck R, Banaschewski T, Barker GJ, Bokde ALW, et al. The empirical replicability of task-based fMRI as a function of sample size. NEUROIMAGE. 2020;212.
IEEE
[1]
H. Bossier et al., “The empirical replicability of task-based fMRI as a function of sample size,” NEUROIMAGE, vol. 212, 2020.
@article{8654271,
  abstract     = {{Replicating results (i.e. obtaining consistent results using a new independent dataset) is an essential part of good science. As replicability has consequences for theories derived from empirical studies, it is of utmost importance to better understand the underlying mechanisms influencing it. A popular tool for non-invasive neuroimaging studies is functional magnetic resonance imaging (fMRI). While the effect of underpowered studies is well documented, the empirical assessment of the interplay between sample size and replicability of results for task-based fMRI studies remains limited. In this work, we extend existing work on this assessment in two ways. Firstly, we use a large database of 1400 subjects performing four types of tasks from the IMAGEN project to subsample a series of independent samples of increasing size. Secondly, replicability is evaluated using a multi-dimensional framework consisting of 3 different measures: (un)conditional test-retest reliability, coherence and stability. We demonstrate not only a positive effect of sample size, but also a trade-off between spatial resolution and replicability. When replicability is assessed voxelwise or when observing small areas of activation, a larger sample size than typically used in fMRI is required to replicate results. On the other hand, when focussing on clusters of voxels, we observe a higher replicability. In addition, we observe variability in the size of clusters of activation between experimental paradigms or contrasts of parameter estimates within these.}},
  articleno    = {{116601}},
  author       = {{Bossier, Han and Roels, Sanne and Seurinck, Ruth and Banaschewski, Tobias and Barker, Gareth J. and Bokde, Arun L. W. and Quinlan, Erin Burke and Desrivières, Sylvane and Flor, Herta and Grigis, Antoine and Garavan, Hugh and Gowland, Penny and Heinz, Andreas and Ittermann, Bernd and Martinot, Jean-Luc and Artiges, Eric and Nees, Frauke and Orfanos, Dimitri Papadopoulos and Poustka, Luise and Fröhner Dipl-Psych, Juliane H. and Smolka, Michael N. and Walter, Henrik and Whelan, Robert and Schumann, Gunter and Moerkerke, Beatrijs}},
  issn         = {{1053-8119}},
  journal      = {{NEUROIMAGE}},
  keywords     = {{Task-based fMRI,Replicability,Reproducibility,Reliability,Stability,Coherence,TEST-RETEST RELIABILITY,NEUROIMAGING DATA,POWER CALCULATION,MR-IMAGES,REPRODUCIBILITY,PERMUTATION,INFERENCE,TESTS,METAANALYSIS,FAILURE}},
  language     = {{eng}},
  pages        = {{12}},
  title        = {{The empirical replicability of task-based fMRI as a function of sample size}},
  url          = {{http://doi.org/10.1016/j.neuroimage.2020.116601}},
  volume       = {{212}},
  year         = {{2020}},
}
Altmetric
View in Altmetric
Web of Science
Times cited: