Advanced search
2 files | 1.40 MB Add to list

Hyperparameter optimization of two-branch neural networks in multi-target prediction

Author
Organization
Project
Abstract
As a result of the ever increasing complexity of configuring and fine-tuning machine learning models, the field of automated machine learning (AutoML) has emerged over the past decade. However, software implementations like Auto-WEKA and Auto-sklearn typically focus on classical machine learning (ML) tasks such as classification and regression. Our work can be seen as the first attempt at offering a single AutoML framework for most problem settings that fall under the umbrella of multi-target prediction, which includes popular ML settings such as multi-label classification, multivariate regression, multi-task learning, dyadic prediction, matrix completion, and zero-shot learning. Automated problem selection and model configuration are achieved by extending DeepMTP, a general deep learning framework for MTP problem settings, with popular hyperparameter optimization (HPO) methods. Our extensive benchmarking across different datasets and MTP problem settings identifies cases where specific HPO methods outperform others.
Keywords
Machine learning, Multi-target prediction, Automated machine learning, Hyperparameter optimization, Multi-label classification, EFFICIENT

Downloads

  • DeepMTP HPO (1).pdf
    • full text (Accepted manuscript)
    • |
    • open access
    • |
    • PDF
    • |
    • 618.54 KB
  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 780.18 KB

Citation

Please use this url to cite or link to this publication:

MLA
Iliadis, Dimitrios, et al. “Hyperparameter Optimization of Two-Branch Neural Networks in Multi-Target Prediction.” APPLIED SOFT COMPUTING, vol. 165, 2024, doi:10.1016/j.asoc.2024.111957.
APA
Iliadis, D., Wever, M., De Baets, B., & Waegeman, W. (2024). Hyperparameter optimization of two-branch neural networks in multi-target prediction. APPLIED SOFT COMPUTING, 165. https://doi.org/10.1016/j.asoc.2024.111957
Chicago author-date
Iliadis, Dimitrios, Marcel Wever, Bernard De Baets, and Willem Waegeman. 2024. “Hyperparameter Optimization of Two-Branch Neural Networks in Multi-Target Prediction.” APPLIED SOFT COMPUTING 165. https://doi.org/10.1016/j.asoc.2024.111957.
Chicago author-date (all authors)
Iliadis, Dimitrios, Marcel Wever, Bernard De Baets, and Willem Waegeman. 2024. “Hyperparameter Optimization of Two-Branch Neural Networks in Multi-Target Prediction.” APPLIED SOFT COMPUTING 165. doi:10.1016/j.asoc.2024.111957.
Vancouver
1.
Iliadis D, Wever M, De Baets B, Waegeman W. Hyperparameter optimization of two-branch neural networks in multi-target prediction. APPLIED SOFT COMPUTING. 2024;165.
IEEE
[1]
D. Iliadis, M. Wever, B. De Baets, and W. Waegeman, “Hyperparameter optimization of two-branch neural networks in multi-target prediction,” APPLIED SOFT COMPUTING, vol. 165, 2024.
@article{01J531GSF6DA0PHSM564F7ZS23,
  abstract     = {{As a result of the ever increasing complexity of configuring and fine-tuning machine learning models, the field of automated machine learning (AutoML) has emerged over the past decade. However, software implementations like Auto-WEKA and Auto-sklearn typically focus on classical machine learning (ML) tasks such as classification and regression. Our work can be seen as the first attempt at offering a single AutoML framework for most problem settings that fall under the umbrella of multi-target prediction, which includes popular ML settings such as multi-label classification, multivariate regression, multi-task learning, dyadic prediction, matrix completion, and zero-shot learning. Automated problem selection and model configuration are achieved by extending DeepMTP, a general deep learning framework for MTP problem settings, with popular hyperparameter optimization (HPO) methods. Our extensive benchmarking across different datasets and MTP problem settings identifies cases where specific HPO methods outperform others.}},
  articleno    = {{111957}},
  author       = {{Iliadis, Dimitrios and Wever, Marcel and De Baets, Bernard and Waegeman, Willem}},
  issn         = {{1568-4946}},
  journal      = {{APPLIED SOFT COMPUTING}},
  keywords     = {{Machine learning,Multi-target prediction,Automated machine learning,Hyperparameter optimization,Multi-label classification,EFFICIENT}},
  language     = {{eng}},
  pages        = {{9}},
  title        = {{Hyperparameter optimization of two-branch neural networks in multi-target prediction}},
  url          = {{http://doi.org/10.1016/j.asoc.2024.111957}},
  volume       = {{165}},
  year         = {{2024}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: