#EEGManyLabs : investigating the replicability of influential EEG experiments
- Author
- Yuri G. Pavlov, Nika Adamian, Stefan Appelhoff, Mahnaz Arvaneh, Christopher S. Y. Benwell, Christian Beste, Amy R. Bland, Daniel E. Bradford, Florian Bublatzky, Niko A. Busch, Peter E. Clayson, Damian Cruse, Artur Czeszumski, Anna Dreber, Guillaume Dumas, Benedikt Ehinger, Ganis Giorgio, Xun He, José A. Hinojosa, Christoph Huber-Huber, Michael Inzlicht, Bradley N. Jack, Magnus Johannesson, Rhiannon Jones, Evgenii Kalenkovich, Laura Kaltwasser, Hamid Karimi-Rouzbahani, Andreas Keil, Peter König, Layla Kouara, Louisa Kulke, Cecile D. Ladouceur, Nicolas Langer, Heinrich R. Liesefeld, David Luque, Annmarie MacNamara, Muthuraman Muthuraman, Lauren B. Neal, Gustav Nilsonne, Guiomar Niso, Sebastian Ocklenburg, Robert Oostenveld, Cyril R. Pernet, Gilles Pourtois (UGent) , Manuela Ruzzoli, Sarah M. Sass, Alexandre Schaefer, Magdalena Senderecka, Joel S. Snyder, Christian K. Tamnes, Emmanuelle Tognoli, Marieke K. van Vugt, Edelyn Verona, Robin Vloeberghs, Dominik Welke, Jan R. Wessel, Ilya Zakharov and Faisal Mushtaq
- Organization
- Project
- Abstract
- There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalog-raphy (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound in-fluence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and se-lection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations. (c) 2021 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
- Keywords
- EEG, ERP, Replication, Many labs, Open science, Cognitive neuroscience, SAMPLE-SIZE, REPLICATION, ATTENTION, REPRODUCIBILITY, ERP, RELIABILITY, MOTIVATION, MAGNITUDE, DYNAMICS, REFLECTS
Downloads
-
published.pdf
- full text (Published version)
- |
- open access
- |
- |
- 1.24 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8700927
- MLA
- Pavlov, Yuri G., et al. “#EEGManyLabs : Investigating the Replicability of Influential EEG Experiments.” CORTEX, vol. 144, 2021, pp. 213–29, doi:10.1016/j.cortex.2021.03.013.
- APA
- Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S. Y., Beste, C., … Mushtaq, F. (2021). #EEGManyLabs : investigating the replicability of influential EEG experiments. CORTEX, 144, 213–229. https://doi.org/10.1016/j.cortex.2021.03.013
- Chicago author-date
- Pavlov, Yuri G., Nika Adamian, Stefan Appelhoff, Mahnaz Arvaneh, Christopher S. Y. Benwell, Christian Beste, Amy R. Bland, et al. 2021. “#EEGManyLabs : Investigating the Replicability of Influential EEG Experiments.” CORTEX 144: 213–29. https://doi.org/10.1016/j.cortex.2021.03.013.
- Chicago author-date (all authors)
- Pavlov, Yuri G., Nika Adamian, Stefan Appelhoff, Mahnaz Arvaneh, Christopher S. Y. Benwell, Christian Beste, Amy R. Bland, Daniel E. Bradford, Florian Bublatzky, Niko A. Busch, Peter E. Clayson, Damian Cruse, Artur Czeszumski, Anna Dreber, Guillaume Dumas, Benedikt Ehinger, Ganis Giorgio, Xun He, José A. Hinojosa, Christoph Huber-Huber, Michael Inzlicht, Bradley N. Jack, Magnus Johannesson, Rhiannon Jones, Evgenii Kalenkovich, Laura Kaltwasser, Hamid Karimi-Rouzbahani, Andreas Keil, Peter König, Layla Kouara, Louisa Kulke, Cecile D. Ladouceur, Nicolas Langer, Heinrich R. Liesefeld, David Luque, Annmarie MacNamara, Muthuraman Muthuraman, Lauren B. Neal, Gustav Nilsonne, Guiomar Niso, Sebastian Ocklenburg, Robert Oostenveld, Cyril R. Pernet, Gilles Pourtois, Manuela Ruzzoli, Sarah M. Sass, Alexandre Schaefer, Magdalena Senderecka, Joel S. Snyder, Christian K. Tamnes, Emmanuelle Tognoli, Marieke K. van Vugt, Edelyn Verona, Robin Vloeberghs, Dominik Welke, Jan R. Wessel, Ilya Zakharov, and Faisal Mushtaq. 2021. “#EEGManyLabs : Investigating the Replicability of Influential EEG Experiments.” CORTEX 144: 213–229. doi:10.1016/j.cortex.2021.03.013.
- Vancouver
- 1.Pavlov YG, Adamian N, Appelhoff S, Arvaneh M, Benwell CSY, Beste C, et al. #EEGManyLabs : investigating the replicability of influential EEG experiments. CORTEX. 2021;144:213–29.
- IEEE
- [1]Y. G. Pavlov et al., “#EEGManyLabs : investigating the replicability of influential EEG experiments,” CORTEX, vol. 144, pp. 213–229, 2021.
@article{8700927, abstract = {{There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalog-raphy (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound in-fluence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and se-lection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations. (c) 2021 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).}}, author = {{Pavlov, Yuri G. and Adamian, Nika and Appelhoff, Stefan and Arvaneh, Mahnaz and Benwell, Christopher S. Y. and Beste, Christian and Bland, Amy R. and Bradford, Daniel E. and Bublatzky, Florian and Busch, Niko A. and Clayson, Peter E. and Cruse, Damian and Czeszumski, Artur and Dreber, Anna and Dumas, Guillaume and Ehinger, Benedikt and Giorgio, Ganis and He, Xun and Hinojosa, José A. and Huber-Huber, Christoph and Inzlicht, Michael and Jack, Bradley N. and Johannesson, Magnus and Jones, Rhiannon and Kalenkovich, Evgenii and Kaltwasser, Laura and Karimi-Rouzbahani, Hamid and Keil, Andreas and König, Peter and Kouara, Layla and Kulke, Louisa and Ladouceur, Cecile D. and Langer, Nicolas and Liesefeld, Heinrich R. and Luque, David and MacNamara, Annmarie and Muthuraman, Muthuraman and Neal, Lauren B. and Nilsonne, Gustav and Niso, Guiomar and Ocklenburg, Sebastian and Oostenveld, Robert and Pernet, Cyril R. and Pourtois, Gilles and Ruzzoli, Manuela and Sass, Sarah M. and Schaefer, Alexandre and Senderecka, Magdalena and Snyder, Joel S. and Tamnes, Christian K. and Tognoli, Emmanuelle and van Vugt, Marieke K. and Verona, Edelyn and Vloeberghs, Robin and Welke, Dominik and Wessel, Jan R. and Zakharov, Ilya and Mushtaq, Faisal}}, issn = {{0010-9452}}, journal = {{CORTEX}}, keywords = {{EEG,ERP,Replication,Many labs,Open science,Cognitive neuroscience,SAMPLE-SIZE,REPLICATION,ATTENTION,REPRODUCIBILITY,ERP,RELIABILITY,MOTIVATION,MAGNITUDE,DYNAMICS,REFLECTS}}, language = {{eng}}, pages = {{213--229}}, title = {{#EEGManyLabs : investigating the replicability of influential EEG experiments}}, url = {{http://doi.org/10.1016/j.cortex.2021.03.013}}, volume = {{144}}, year = {{2021}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: