Advanced search
1 file | 592.10 KB Add to list

Crowdsourcing reproducible seizure forecasting in human and canine epilepsy

(2016) BRAIN. 139(6). p.1713-1722
Author
Organization
Abstract
Accurate forecasting of epileptic seizures has the potential to transform clinical epilepsy care. However, progress toward reliable seizure forecasting has been hampered by lack of open access to long duration recordings with an adequate number of seizures for investigators to rigorously compare algorithms and results. A seizure forecasting competition was conducted on kaggle.com using open access chronic ambulatory intracranial electroencephalography from five canines with naturally occurring epilepsy and two humans undergoing prolonged wide bandwidth intracranial electroencephalographic monitoring. Data were provided to participants as 10-min interictal and preictal clips, with approximately half of the 60 GB data bundle labelled (interictal/preictal) for algorithm training and half unlabelled for evaluation. The contestants developed custom algorithms and uploaded their classifications (interictal/preictal) for the unknown testing data, and a randomly selected 40% of data segments were scored and results broadcasted on a public leader board. The contest ran from August to November 2014, and 654 participants submitted 17 856 classifications of the unlabelled test data. The top performing entry scored 0.84 area under the classification curve. Following the contest, additional held-out unlabelled data clips were provided to the top 10 participants and they submitted classifications for the new unseen data. The resulting area under the classification curves were well above chance forecasting, but did show a mean 6.54 ± 2.45% (min, max: 0.30, 20.2) decline in performance. The kaggle.com model using open access data and algorithms generated reproducible research that advanced seizure forecasting. The overall performance from multiple contestants on unseen data was better than a random predictor, and demonstrates the feasibility of seizure forecasting in canine and human epilepsy.
Keywords
DRUG-RESISTANT EPILEPSY, TEMPORAL-LOBE EPILEPSY, EEG, MODEL, PREDICTION, SYSTEM, DOGS, ELECTROENCEPHALOGRAPHY, SIMILARITIES, RECOGNITION, epilepsy, intracranial EEG, refractory epilepsy, experimental models

Downloads

  • aww045.pdf
    • full text
    • |
    • open access
    • |
    • PDF
    • |
    • 592.10 KB

Citation

Please use this url to cite or link to this publication:

MLA
H. Brinkmann, Benjamin, et al. “Crowdsourcing Reproducible Seizure Forecasting in Human and Canine Epilepsy.” BRAIN, edited by Dimitri M Kullmann, vol. 139, no. 6, 2016, pp. 1713–22, doi:10.1093/brain/aww045.
APA
H. Brinkmann, B., Wagenaar, J., Abbot, D., Adkins, P., C Bosshard, S., Chen, M., … Worrell, G. A. (2016). Crowdsourcing reproducible seizure forecasting in human and canine epilepsy. BRAIN, 139(6), 1713–1722. https://doi.org/10.1093/brain/aww045
Chicago author-date
H. Brinkmann, Benjamin, Joost Wagenaar, Drew Abbot, Phillip Adkins, Simone C Bosshard, Min Chen, Quang M Tieng, et al. 2016. “Crowdsourcing Reproducible Seizure Forecasting in Human and Canine Epilepsy.” Edited by Dimitri M Kullmann. BRAIN 139 (6): 1713–22. https://doi.org/10.1093/brain/aww045.
Chicago author-date (all authors)
H. Brinkmann, Benjamin, Joost Wagenaar, Drew Abbot, Phillip Adkins, Simone C Bosshard, Min Chen, Quang M Tieng, Jialune He, FJ Muñoz-Almaraz, Paloma Botella-Rocamora, Juan Pardo, Francisco Zamora-Martinez, Michael Hills, Wei Wu, Iryna Korshunova, Will Cukierski, Charles Vite, Edward E Patterson, Brian Litt, and Gregory A Worrell. 2016. “Crowdsourcing Reproducible Seizure Forecasting in Human and Canine Epilepsy.” Ed by. Dimitri M Kullmann. BRAIN 139 (6): 1713–1722. doi:10.1093/brain/aww045.
Vancouver
1.
H. Brinkmann B, Wagenaar J, Abbot D, Adkins P, C Bosshard S, Chen M, et al. Crowdsourcing reproducible seizure forecasting in human and canine epilepsy. Kullmann DM, editor. BRAIN. 2016;139(6):1713–22.
IEEE
[1]
B. H. Brinkmann et al., “Crowdsourcing reproducible seizure forecasting in human and canine epilepsy,” BRAIN, vol. 139, no. 6, pp. 1713–1722, 2016.
@article{7223428,
  abstract     = {{Accurate forecasting of epileptic seizures has the potential to transform clinical epilepsy care. However, progress toward reliable seizure forecasting has been hampered by lack of open access to long duration recordings with an adequate number of seizures for investigators to rigorously compare algorithms and results. A seizure forecasting competition was conducted on kaggle.com using open access chronic ambulatory intracranial electroencephalography from five canines with naturally occurring epilepsy and two humans undergoing prolonged wide bandwidth intracranial electroencephalographic monitoring. Data were provided to participants as 10-min interictal and preictal clips, with approximately half of the 60 GB data bundle labelled (interictal/preictal) for algorithm training and half unlabelled for evaluation. The contestants developed custom algorithms and uploaded their classifications (interictal/preictal) for the unknown testing data, and a randomly selected 40% of data segments were scored and results broadcasted on a public leader board. The contest ran from August to November 2014, and 654 participants submitted 17 856 classifications of the unlabelled test data. The top performing entry scored 0.84 area under the classification curve. Following the contest, additional held-out unlabelled data clips were provided to the top 10 participants and they submitted classifications for the new unseen data. The resulting area under the classification curves were well above chance forecasting, but did show a mean 6.54 ± 2.45% (min, max: 0.30, 20.2) decline in performance. The kaggle.com model using open access data and algorithms generated reproducible research that advanced seizure forecasting. The overall performance from multiple contestants on unseen data was better than a random predictor, and demonstrates the feasibility of seizure forecasting in canine and human epilepsy.}},
  author       = {{H. Brinkmann, Benjamin and Wagenaar, Joost and Abbot, Drew and Adkins, Phillip and C Bosshard, Simone and Chen, Min and Tieng, Quang M and He, Jialune and Muñoz-Almaraz, FJ and Botella-Rocamora, Paloma and Pardo, Juan and Zamora-Martinez, Francisco and Hills, Michael and Wu, Wei and Korshunova, Iryna and Cukierski, Will and Vite, Charles and Patterson, Edward E and Litt, Brian and Worrell, Gregory A}},
  editor       = {{Kullmann, Dimitri M}},
  issn         = {{0006-8950}},
  journal      = {{BRAIN}},
  keywords     = {{DRUG-RESISTANT EPILEPSY,TEMPORAL-LOBE EPILEPSY,EEG,MODEL,PREDICTION,SYSTEM,DOGS,ELECTROENCEPHALOGRAPHY,SIMILARITIES,RECOGNITION,epilepsy,intracranial EEG,refractory epilepsy,experimental models}},
  language     = {{eng}},
  number       = {{6}},
  pages        = {{1713--1722}},
  title        = {{Crowdsourcing reproducible seizure forecasting in human and canine epilepsy}},
  url          = {{http://doi.org/10.1093/brain/aww045}},
  volume       = {{139}},
  year         = {{2016}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: