There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

#EEGManyLabs: Investigating the replicability of influential EEG experiments / Pavlov, Y. G.; Adamian, N.; Appelhoff, S.; Arvaneh, M.; Benwell, C. S. Y.; Beste, C.; Bland, A. R.; Bradford, D. E.; Bublatzky, F.; Busch, N. A.; Clayson, P. E.; Cruse, D.; Czeszumski, A.; Dreber, A.; Dumas, G.; Ehinger, B.; Ganis, G.; He, X.; Hinojosa, J. A.; Huber-Huber, C.; Inzlicht, M.; Jack, B. N.; Johannesson, M.; Jones, R.; Kalenkovich, E.; Kaltwasser, L.; Karimi-Rouzbahani, H.; Keil, A.; Konig, P.; Kouara, L.; Kulke, L.; Ladouceur, C. D.; Langer, N.; Liesefeld, H. R.; Luque, D.; Macnamara, A.; Mudrik, L.; Muthuraman, M.; Neal, L. B.; Nilsonne, G.; Niso, G.; Ocklenburg, S.; Oostenveld, R.; Pernet, C. R.; Pourtois, G.; Ruzzoli, M.; Sass, S. M.; Schaefer, A.; Senderecka, M.; Snyder, J. S.; Tamnes, C. K.; Tognoli, E.; van Vugt, M. K.; Verona, E.; Vloeberghs, R.; Welke, D.; Wessel, J. R.; Zakharov, I.; Mushtaq, F.. - In: CORTEX. - ISSN 0010-9452. - 144:(2021), pp. 213-229. [10.1016/j.cortex.2021.03.013]

#EEGManyLabs: Investigating the replicability of influential EEG experiments

He X.;Huber-Huber C.;Oostenveld R.;
2021-01-01

Abstract

There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.
2021
Pavlov, Y. G.; Adamian, N.; Appelhoff, S.; Arvaneh, M.; Benwell, C. S. Y.; Beste, C.; Bland, A. R.; Bradford, D. E.; Bublatzky, F.; Busch, N. A.; Clayson, P. E.; Cruse, D.; Czeszumski, A.; Dreber, A.; Dumas, G.; Ehinger, B.; Ganis, G.; He, X.; Hinojosa, J. A.; Huber-Huber, C.; Inzlicht, M.; Jack, B. N.; Johannesson, M.; Jones, R.; Kalenkovich, E.; Kaltwasser, L.; Karimi-Rouzbahani, H.; Keil, A.; Konig, P.; Kouara, L.; Kulke, L.; Ladouceur, C. D.; Langer, N.; Liesefeld, H. R.; Luque, D.; Macnamara, A.; Mudrik, L.; Muthuraman, M.; Neal, L. B.; Nilsonne, G.; Niso, G.; Ocklenburg, S.; Oostenveld, R.; Pernet, C. R.; Pourtois, G.; Ruzzoli, M.; Sass, S. M.; Schaefer, A.; Senderecka, M.; Snyder, J. S.; Tamnes, C. K.; Tognoli, E.; van Vugt, M. K.; Verona, E.; Vloeberghs, R.; Welke, D.; Wessel, J. R.; Zakharov, I.; Mushtaq, F.
#EEGManyLabs: Investigating the replicability of influential EEG experiments / Pavlov, Y. G.; Adamian, N.; Appelhoff, S.; Arvaneh, M.; Benwell, C. S. Y.; Beste, C.; Bland, A. R.; Bradford, D. E.; Bublatzky, F.; Busch, N. A.; Clayson, P. E.; Cruse, D.; Czeszumski, A.; Dreber, A.; Dumas, G.; Ehinger, B.; Ganis, G.; He, X.; Hinojosa, J. A.; Huber-Huber, C.; Inzlicht, M.; Jack, B. N.; Johannesson, M.; Jones, R.; Kalenkovich, E.; Kaltwasser, L.; Karimi-Rouzbahani, H.; Keil, A.; Konig, P.; Kouara, L.; Kulke, L.; Ladouceur, C. D.; Langer, N.; Liesefeld, H. R.; Luque, D.; Macnamara, A.; Mudrik, L.; Muthuraman, M.; Neal, L. B.; Nilsonne, G.; Niso, G.; Ocklenburg, S.; Oostenveld, R.; Pernet, C. R.; Pourtois, G.; Ruzzoli, M.; Sass, S. M.; Schaefer, A.; Senderecka, M.; Snyder, J. S.; Tamnes, C. K.; Tognoli, E.; van Vugt, M. K.; Verona, E.; Vloeberghs, R.; Welke, D.; Wessel, J. R.; Zakharov, I.; Mushtaq, F.. - In: CORTEX. - ISSN 0010-9452. - 144:(2021), pp. 213-229. [10.1016/j.cortex.2021.03.013]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/383131
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? 13
  • Scopus 42
  • ???jsp.display-item.citation.isi??? 38
social impact