Advanced search
2 files | 33.61 MB Add to list

A neural-network framework for the design of individualised hearing-loss compensation

Author
Organization
Project
Abstract
Sound processing in the human auditory system is complex and highly non-linear, whereas hearing aids (HAs) still rely on simplified descriptions of auditory processing or hearing loss to restore hearing. Even though standard HA amplification strategies succeed in restoring audibility of faint sounds, they still fall short of providing targeted treatments for complex sensorineural deficits and adverse listening conditions. These shortcomings of current HA devices demonstrate the need for advanced hearing-loss compensation strategies that can effectively leverage the non-linear character of the auditory system. Here, we propose a differentiable deep-neural-network (DNN) framework that can be used to train DNN-based HA models based on biophysical auditory-processing differences between normal-hearing and hearing-impaired systems. We investigate different loss functions to accurately compensate for impairments that include outer-hair-cell (OHC) loss and cochlear synaptopathy (CS), and evaluate the benefits of our trained DNN-based HA models for speech processing in quiet and in noise. Our results show that auditory-processing enhancement was possible for all considered hearing-loss cases, with OHC loss proving easier to compensate than CS. Several objective metrics were considered to estimate the expected speech intelligibility after processing, and these simulations hold promise in yielding improved understanding of speech-in-noise for hearing-impaired listeners who use our DNN-based HA processing. Since our framework can be tuned to the hearing-loss profiles of individual listeners, we enter an era where truly individualised and DNN-based hearing-restoration strategies can be developed and be tested experimentally.
Keywords
Closed loop, cochlear synaptopathy, hearing loss, individualised hearing aids, neural networks, speech intelligibility, GENERATIVE ADVERSARIAL NETWORKS, COCHLEAR NEUROPATHY, AUDITORY-NERVE, FREQUENCY-RESPONSE, INTELLIGIBILITY, MODEL, POWER, INDEX, REVERBERANT, LISTENERS

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 2.63 MB
  • ACUS 641a.pdf
    • full text (Accepted manuscript)
    • |
    • open access
    • |
    • PDF
    • |
    • 30.98 MB

Citation

Please use this url to cite or link to this publication:

MLA
Drakopoulos, Fotios, and Sarah Verhulst. “A Neural-Network Framework for the Design of Individualised Hearing-Loss Compensation.” IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, vol. 31, 2023, pp. 2395–409, doi:10.1109/TASLP.2023.3282093.
APA
Drakopoulos, F., & Verhulst, S. (2023). A neural-network framework for the design of individualised hearing-loss compensation. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 31, 2395–2409. https://doi.org/10.1109/TASLP.2023.3282093
Chicago author-date
Drakopoulos, Fotios, and Sarah Verhulst. 2023. “A Neural-Network Framework for the Design of Individualised Hearing-Loss Compensation.” IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING 31: 2395–2409. https://doi.org/10.1109/TASLP.2023.3282093.
Chicago author-date (all authors)
Drakopoulos, Fotios, and Sarah Verhulst. 2023. “A Neural-Network Framework for the Design of Individualised Hearing-Loss Compensation.” IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING 31: 2395–2409. doi:10.1109/TASLP.2023.3282093.
Vancouver
1.
Drakopoulos F, Verhulst S. A neural-network framework for the design of individualised hearing-loss compensation. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING. 2023;31:2395–409.
IEEE
[1]
F. Drakopoulos and S. Verhulst, “A neural-network framework for the design of individualised hearing-loss compensation,” IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, vol. 31, pp. 2395–2409, 2023.
@article{01HGARZMJCNWTQAYFT0QAQ1PYX,
  abstract     = {{Sound processing in the human auditory system is complex and highly non-linear, whereas hearing aids (HAs) still rely on simplified descriptions of auditory processing or hearing loss to restore hearing. Even though standard HA amplification strategies succeed in restoring audibility of faint sounds, they still fall short of providing targeted treatments for complex sensorineural deficits and adverse listening conditions. These shortcomings of current HA devices demonstrate the need for advanced hearing-loss compensation strategies that can effectively leverage the non-linear character of the auditory system. Here, we propose a differentiable deep-neural-network (DNN) framework that can be used to train DNN-based HA models based on biophysical auditory-processing differences between normal-hearing and hearing-impaired systems. We investigate different loss functions to accurately compensate for impairments that include outer-hair-cell (OHC) loss and cochlear synaptopathy (CS), and evaluate the benefits of our trained DNN-based HA models for speech processing in quiet and in noise. Our results show that auditory-processing enhancement was possible for all considered hearing-loss cases, with OHC loss proving easier to compensate than CS. Several objective metrics were considered to estimate the expected speech intelligibility after processing, and these simulations hold promise in yielding improved understanding of speech-in-noise for hearing-impaired listeners who use our DNN-based HA processing. Since our framework can be tuned to the hearing-loss profiles of individual listeners, we enter an era where truly individualised and DNN-based hearing-restoration strategies can be developed and be tested experimentally.}},
  author       = {{Drakopoulos, Fotios and Verhulst, Sarah}},
  issn         = {{2329-9290}},
  journal      = {{IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING}},
  keywords     = {{Closed loop,cochlear synaptopathy,hearing loss,individualised hearing aids,neural networks,speech intelligibility,GENERATIVE ADVERSARIAL NETWORKS,COCHLEAR NEUROPATHY,AUDITORY-NERVE,FREQUENCY-RESPONSE,INTELLIGIBILITY,MODEL,POWER,INDEX,REVERBERANT,LISTENERS}},
  language     = {{eng}},
  pages        = {{2395--2409}},
  title        = {{A neural-network framework for the design of individualised hearing-loss compensation}},
  url          = {{http://doi.org/10.1109/TASLP.2023.3282093}},
  volume       = {{31}},
  year         = {{2023}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: