Advanced search
1 file | 2.30 MB Add to list

Using photonic reservoirs as preprocessors for deep neural networks

Author
Organization
Project
Abstract
Artificial neural networks are very time consuming and energy intensive to train, especially when increasing the size of the neural network in an attempt to improve the performance. In this paper, we propose to preprocess the input data of a deep neural network using a reservoir, which has originally been introduced in the framework of reservoir computing. The key idea of this paper is to use such a reservoir to transform the input data into a state in a higher dimensional state-space, which allows the deep neural network to process the data with improved performance. We focus on photonic reservoirs because of their fast computation times and low-energy consumption. Based on numerical simulations of delay-based reservoirs using a semiconductor laser, we show that using such preprocessed data results in an improved performance of deep neural networks. Furthermore, we show that we do not need to carefully fine-tune the parameters of the preprocessing reservoir.
Keywords
DELAYED OPTICAL FEEDBACK, SEMICONDUCTOR-LASERS, NONLINEARITY, photonic reservoir computing, semiconductor lasers, feedback, optical, injection, artificial neural networks, preprocessor

Downloads

  • pub 2832.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 2.30 MB

Citation

Please use this url to cite or link to this publication:

MLA
Bauwens, Ian, et al. “Using Photonic Reservoirs as Preprocessors for Deep Neural Networks.” FRONTIERS IN PHYSICS, vol. 10, 2022, doi:10.3389/fphy.2022.1051941.
APA
Bauwens, I., van der Sande, G., Bienstman, P., & Verschaffelt, G. (2022). Using photonic reservoirs as preprocessors for deep neural networks. FRONTIERS IN PHYSICS, 10. https://doi.org/10.3389/fphy.2022.1051941
Chicago author-date
Bauwens, Ian, Guy van der Sande, Peter Bienstman, and Guy Verschaffelt. 2022. “Using Photonic Reservoirs as Preprocessors for Deep Neural Networks.” FRONTIERS IN PHYSICS 10. https://doi.org/10.3389/fphy.2022.1051941.
Chicago author-date (all authors)
Bauwens, Ian, Guy van der Sande, Peter Bienstman, and Guy Verschaffelt. 2022. “Using Photonic Reservoirs as Preprocessors for Deep Neural Networks.” FRONTIERS IN PHYSICS 10. doi:10.3389/fphy.2022.1051941.
Vancouver
1.
Bauwens I, van der Sande G, Bienstman P, Verschaffelt G. Using photonic reservoirs as preprocessors for deep neural networks. FRONTIERS IN PHYSICS. 2022;10.
IEEE
[1]
I. Bauwens, G. van der Sande, P. Bienstman, and G. Verschaffelt, “Using photonic reservoirs as preprocessors for deep neural networks,” FRONTIERS IN PHYSICS, vol. 10, 2022.
@article{01GQST5FGTXS24CQ5PT3HRZ3K0,
  abstract     = {{Artificial neural networks are very time consuming and energy intensive to train, especially when increasing the size of the neural network in an attempt to improve the performance. In this paper, we propose to preprocess the input data of a deep neural network using a reservoir, which has originally been introduced in the framework of reservoir computing. The key idea of this paper is to use such a reservoir to transform the input data into a state in a higher dimensional state-space, which allows the deep neural network to process the data with improved performance. We focus on photonic reservoirs because of their fast computation times and low-energy consumption. Based on numerical simulations of delay-based reservoirs using a semiconductor laser, we show that using such preprocessed data results in an improved performance of deep neural networks. Furthermore, we show that we do not need to carefully fine-tune the parameters of the preprocessing reservoir.}},
  articleno    = {{1051941}},
  author       = {{Bauwens, Ian and  van der Sande, Guy and Bienstman, Peter and  Verschaffelt, Guy}},
  issn         = {{2296-424X}},
  journal      = {{FRONTIERS IN PHYSICS}},
  keywords     = {{DELAYED OPTICAL FEEDBACK,SEMICONDUCTOR-LASERS,NONLINEARITY,photonic reservoir computing,semiconductor lasers,feedback,optical,injection,artificial neural networks,preprocessor}},
  language     = {{eng}},
  pages        = {{14}},
  title        = {{Using photonic reservoirs as preprocessors for deep neural networks}},
  url          = {{http://doi.org/10.3389/fphy.2022.1051941}},
  volume       = {{10}},
  year         = {{2022}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: