A systematic review on the evolution of power analysis practices in psychological research
- Author
- Lara Vankelecom (UGent) , Ole Schacht (UGent) , Nathan Laroy (UGent) , Tom Loeys (UGent) and Beatrijs Moerkerke (UGent)
- Organization
- Project
- Abstract
- Performing hypothesis tests with adequate statistical power is indispensable for psychological research. In response to several large-scale replication projects following the replication crisis, concerns about the root causes of this crisis – such as questionable research practices (QRPs) – have grown. While initial efforts primarily addressed the inflation of the type I error rate of research due to QRPs, recent attention has shifted to the adverse consequences of low statistical power. In this paper we first argue how underpowered studies, in combination with publication bias, contribute to a literature rife with false positive results and overestimated effect sizes. We then examine whether the prevalence of power analyses in psychological research has effectively increased over time in response to the increased awareness regarding these phenomena. To address this, we conducted a systematic review of 903 published empirical articles across four APA-disciplines, comparing 453 papers published in 2015–2016, with 450 papers from 2020–2021. Although the prevalence of power analysis across different domains in psychology has increased over time (from 9.5% to 30%), it remains insufficient overall. We conclude by discussing the implications of these findings and elaborating on some alternative methods to a priori power analysis that can help ensure sufficient statistical power.
- Keywords
- replication crisis, statistical power, publication bias, systematic review, power analysis prevalence
Downloads
-
Vankelecom et al. (2025).pdf
- full text (Published version)
- |
- open access
- |
- |
- 883.48 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01JJ2SMFGJD9T79GRAYTHGBPA1
- MLA
- Vankelecom, Lara, et al. “A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research.” PSYCHOLOGICA BELGICA, vol. 65, no. 1, 2025, pp. 17–37, doi:10.5334/pb.1318.
- APA
- Vankelecom, L., Schacht, O., Laroy, N., Loeys, T., & Moerkerke, B. (2025). A systematic review on the evolution of power analysis practices in psychological research. PSYCHOLOGICA BELGICA, 65(1), 17–37. https://doi.org/10.5334/pb.1318
- Chicago author-date
- Vankelecom, Lara, Ole Schacht, Nathan Laroy, Tom Loeys, and Beatrijs Moerkerke. 2025. “A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research.” PSYCHOLOGICA BELGICA 65 (1): 17–37. https://doi.org/10.5334/pb.1318.
- Chicago author-date (all authors)
- Vankelecom, Lara, Ole Schacht, Nathan Laroy, Tom Loeys, and Beatrijs Moerkerke. 2025. “A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research.” PSYCHOLOGICA BELGICA 65 (1): 17–37. doi:10.5334/pb.1318.
- Vancouver
- 1.Vankelecom L, Schacht O, Laroy N, Loeys T, Moerkerke B. A systematic review on the evolution of power analysis practices in psychological research. PSYCHOLOGICA BELGICA. 2025;65(1):17–37.
- IEEE
- [1]L. Vankelecom, O. Schacht, N. Laroy, T. Loeys, and B. Moerkerke, “A systematic review on the evolution of power analysis practices in psychological research,” PSYCHOLOGICA BELGICA, vol. 65, no. 1, pp. 17–37, 2025.
@article{01JJ2SMFGJD9T79GRAYTHGBPA1,
abstract = {{Performing hypothesis tests with adequate statistical power is indispensable for psychological research. In response to several large-scale replication projects following the replication crisis, concerns about the root causes of this crisis – such as questionable research practices (QRPs) – have grown. While initial efforts primarily addressed the inflation of the type I error rate of research due to QRPs, recent attention has shifted to the adverse consequences of low statistical power. In this paper we first argue how underpowered studies, in combination with publication bias, contribute to a literature rife with false positive results and overestimated effect sizes. We then examine whether the prevalence of power analyses in psychological research has effectively increased over time in response to the increased awareness regarding these phenomena. To address this, we conducted a systematic review of 903 published empirical articles across four APA-disciplines, comparing 453 papers published in 2015–2016, with 450 papers from 2020–2021. Although the prevalence of power analysis across different domains in psychology has increased over time (from 9.5% to 30%), it remains insufficient overall. We conclude by discussing the implications of these findings and elaborating on some alternative methods to a priori power analysis that can help ensure sufficient statistical power.}},
author = {{Vankelecom, Lara and Schacht, Ole and Laroy, Nathan and Loeys, Tom and Moerkerke, Beatrijs}},
issn = {{0033-2879}},
journal = {{PSYCHOLOGICA BELGICA}},
keywords = {{replication crisis,statistical power,publication bias,systematic review,power analysis prevalence}},
language = {{eng}},
number = {{1}},
pages = {{17--37}},
title = {{A systematic review on the evolution of power analysis practices in psychological research}},
url = {{http://doi.org/10.5334/pb.1318}},
volume = {{65}},
year = {{2025}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: