Investigating reproducibility at Interspeech conferences : a longitudinal and comparative perspective
- Author
- Mohammad Arvan, A. Seza Doğruöz (UGent) and Natalie Parde
- Organization
- Abstract
- Reproducibility is a key aspect for scientific advancement across disciplines, and reducing barriers for open science is a focus area for the theme of Interspeech 2023. Availability of source code is one of the indicators that facilitates reproducibility. However, less is known about the rates of reproducibility at Interspeech conferences in comparison to other conferences in the field. In order to fill this gap, we have surveyed 27,717 papers at seven conferences across speech and language processing disciplines. We find that despite having a close number of accepted papers to the other conferences, Interspeech has up to 40% less source code availability. In addition to reporting the difficulties we have encountered during our research, we also provide recommendations and possible directions to increase reproducibility for further studies.
Downloads
-
Dogruoz Interspeech2023.pdf
- full text (Published version)
- |
- open access
- |
- |
- 272.51 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01HAKKEC38H7EVPPESVZ4K5SG8
- MLA
- Arvan, Mohammad, et al. “Investigating Reproducibility at Interspeech Conferences : A Longitudinal and Comparative Perspective.” Proceedings of the 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023), International Speech Communication Association (ISCA), 2023, pp. 3929–33, doi:10.21437/interspeech.2023-2252.
- APA
- Arvan, M., Doğruöz, A. S., & Parde, N. (2023). Investigating reproducibility at Interspeech conferences : a longitudinal and comparative perspective. Proceedings of the 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023), 3929–3933. https://doi.org/10.21437/interspeech.2023-2252
- Chicago author-date
- Arvan, Mohammad, A. Seza Doğruöz, and Natalie Parde. 2023. “Investigating Reproducibility at Interspeech Conferences : A Longitudinal and Comparative Perspective.” In Proceedings of the 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023), 3929–33. International Speech Communication Association (ISCA). https://doi.org/10.21437/interspeech.2023-2252.
- Chicago author-date (all authors)
- Arvan, Mohammad, A. Seza Doğruöz, and Natalie Parde. 2023. “Investigating Reproducibility at Interspeech Conferences : A Longitudinal and Comparative Perspective.” In Proceedings of the 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023), 3929–3933. International Speech Communication Association (ISCA). doi:10.21437/interspeech.2023-2252.
- Vancouver
- 1.Arvan M, Doğruöz AS, Parde N. Investigating reproducibility at Interspeech conferences : a longitudinal and comparative perspective. In: Proceedings of the 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023). International Speech Communication Association (ISCA); 2023. p. 3929–33.
- IEEE
- [1]M. Arvan, A. S. Doğruöz, and N. Parde, “Investigating reproducibility at Interspeech conferences : a longitudinal and comparative perspective,” in Proceedings of the 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023), Dublin, Ireland, 2023, pp. 3929–3933.
@inproceedings{01HAKKEC38H7EVPPESVZ4K5SG8,
abstract = {{Reproducibility is a key aspect for scientific advancement across disciplines, and reducing barriers for open science is a focus area for the theme of Interspeech 2023. Availability of source code is one of the indicators that facilitates reproducibility. However, less is known about the rates of reproducibility at Interspeech conferences in comparison to other conferences in the field. In order to fill this gap, we have surveyed 27,717 papers at seven conferences across speech and language processing disciplines. We find that despite having a close number of accepted papers to the other conferences, Interspeech has up to 40% less source code availability. In addition to reporting the difficulties we have encountered during our research, we also provide recommendations and possible directions to increase reproducibility for further studies.}},
author = {{Arvan, Mohammad and Doğruöz, A. Seza and Parde, Natalie}},
booktitle = {{Proceedings of the 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023)}},
language = {{eng}},
location = {{Dublin, Ireland}},
pages = {{3929--3933}},
publisher = {{International Speech Communication Association (ISCA)}},
title = {{Investigating reproducibility at Interspeech conferences : a longitudinal and comparative perspective}},
url = {{http://doi.org/10.21437/interspeech.2023-2252}},
year = {{2023}},
}
- Altmetric
- View in Altmetric