
Using photonic reservoirs as preprocessors for deep neural networks
- Author
- Ian Bauwens, Guy van der Sande, Peter Bienstman (UGent) and Guy Verschaffelt
- Organization
- Project
- Abstract
- Artificial neural networks are very time consuming and energy intensive to train, especially when increasing the size of the neural network in an attempt to improve the performance. In this paper, we propose to preprocess the input data of a deep neural network using a reservoir, which has originally been introduced in the framework of reservoir computing. The key idea of this paper is to use such a reservoir to transform the input data into a state in a higher dimensional state-space, which allows the deep neural network to process the data with improved performance. We focus on photonic reservoirs because of their fast computation times and low-energy consumption. Based on numerical simulations of delay-based reservoirs using a semiconductor laser, we show that using such preprocessed data results in an improved performance of deep neural networks. Furthermore, we show that we do not need to carefully fine-tune the parameters of the preprocessing reservoir.
- Keywords
- DELAYED OPTICAL FEEDBACK, SEMICONDUCTOR-LASERS, NONLINEARITY, photonic reservoir computing, semiconductor lasers, feedback, optical, injection, artificial neural networks, preprocessor
Downloads
-
pub 2832.pdf
- full text (Published version)
- |
- open access
- |
- |
- 2.30 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01GQST5FGTXS24CQ5PT3HRZ3K0
- MLA
- Bauwens, Ian, et al. “Using Photonic Reservoirs as Preprocessors for Deep Neural Networks.” FRONTIERS IN PHYSICS, vol. 10, 2022, doi:10.3389/fphy.2022.1051941.
- APA
- Bauwens, I., van der Sande, G., Bienstman, P., & Verschaffelt, G. (2022). Using photonic reservoirs as preprocessors for deep neural networks. FRONTIERS IN PHYSICS, 10. https://doi.org/10.3389/fphy.2022.1051941
- Chicago author-date
- Bauwens, Ian, Guy van der Sande, Peter Bienstman, and Guy Verschaffelt. 2022. “Using Photonic Reservoirs as Preprocessors for Deep Neural Networks.” FRONTIERS IN PHYSICS 10. https://doi.org/10.3389/fphy.2022.1051941.
- Chicago author-date (all authors)
- Bauwens, Ian, Guy van der Sande, Peter Bienstman, and Guy Verschaffelt. 2022. “Using Photonic Reservoirs as Preprocessors for Deep Neural Networks.” FRONTIERS IN PHYSICS 10. doi:10.3389/fphy.2022.1051941.
- Vancouver
- 1.Bauwens I, van der Sande G, Bienstman P, Verschaffelt G. Using photonic reservoirs as preprocessors for deep neural networks. FRONTIERS IN PHYSICS. 2022;10.
- IEEE
- [1]I. Bauwens, G. van der Sande, P. Bienstman, and G. Verschaffelt, “Using photonic reservoirs as preprocessors for deep neural networks,” FRONTIERS IN PHYSICS, vol. 10, 2022.
@article{01GQST5FGTXS24CQ5PT3HRZ3K0, abstract = {{Artificial neural networks are very time consuming and energy intensive to train, especially when increasing the size of the neural network in an attempt to improve the performance. In this paper, we propose to preprocess the input data of a deep neural network using a reservoir, which has originally been introduced in the framework of reservoir computing. The key idea of this paper is to use such a reservoir to transform the input data into a state in a higher dimensional state-space, which allows the deep neural network to process the data with improved performance. We focus on photonic reservoirs because of their fast computation times and low-energy consumption. Based on numerical simulations of delay-based reservoirs using a semiconductor laser, we show that using such preprocessed data results in an improved performance of deep neural networks. Furthermore, we show that we do not need to carefully fine-tune the parameters of the preprocessing reservoir.}}, articleno = {{1051941}}, author = {{Bauwens, Ian and van der Sande, Guy and Bienstman, Peter and Verschaffelt, Guy}}, issn = {{2296-424X}}, journal = {{FRONTIERS IN PHYSICS}}, keywords = {{DELAYED OPTICAL FEEDBACK,SEMICONDUCTOR-LASERS,NONLINEARITY,photonic reservoir computing,semiconductor lasers,feedback,optical,injection,artificial neural networks,preprocessor}}, language = {{eng}}, pages = {{14}}, title = {{Using photonic reservoirs as preprocessors for deep neural networks}}, url = {{http://doi.org/10.3389/fphy.2022.1051941}}, volume = {{10}}, year = {{2022}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: