An Interpretable Performance Metric for Auditory Attention Decoding Algorithms in a Context of Neuro-Steered Gain Control
- PMID: 31715568
- DOI: 10.1109/TNSRE.2019.2952724
An Interpretable Performance Metric for Auditory Attention Decoding Algorithms in a Context of Neuro-Steered Gain Control
Abstract
In a multi-speaker scenario, a hearing aid lacks information on which speaker the user intends to attend, and therefore it often mistakenly treats the latter as noise while enhancing an interfering speaker. Recently, it has been shown that it is possible to decode the attended speaker from the brain activity, e.g., recorded by electroencephalography sensors. While numerous of these auditory attention decoding (AAD) algorithms appeared in the literature, their performance is generally evaluated in a non-uniform manner. Furthermore, AAD algorithms typically introduce a trade-off between the AAD accuracy and the time needed to make an AAD decision, which hampers an objective benchmarking as it remains unclear which point in each algorithm's trade-off space is the optimal one in a context of neuro-steered gain control. To this end, we present an interpretable performance metric to evaluate AAD algorithms, based on an adaptive gain control system, steered by AAD decisions. Such a system can be modeled as a Markov chain, from which the minimal expected switch duration (MESD) can be calculated and interpreted as the expected time required to switch the operation of the hearing aid after an attention switch of the user, thereby resolving the trade-off between AAD accuracy and decision time. Furthermore, we show that the MESD calculation provides an automatic and theoretically founded procedure to optimize the number of gain levels and decision time in an AAD-based adaptive gain control system.
Similar articles
-
Congruent audiovisual speech enhances auditory attention decoding with EEG.J Neural Eng. 2019 Nov 6;16(6):066033. doi: 10.1088/1741-2552/ab4340. J Neural Eng. 2019. PMID: 31505476
-
EEG-Informed Attended Speaker Extraction From Recorded Speech Mixtures With Application in Neuro-Steered Hearing Prostheses.IEEE Trans Biomed Eng. 2017 May;64(5):1045-1056. doi: 10.1109/TBME.2016.2587382. Epub 2016 Jul 7. IEEE Trans Biomed Eng. 2017. PMID: 27392339
-
Impact of Different Acoustic Components on EEG-Based Auditory Attention Decoding in Noisy and Reverberant Conditions.IEEE Trans Neural Syst Rehabil Eng. 2019 Apr;27(4):652-663. doi: 10.1109/TNSRE.2019.2903404. Epub 2019 Mar 7. IEEE Trans Neural Syst Rehabil Eng. 2019. PMID: 30843845
-
Linear versus deep learning methods for noisy speech separation for EEG-informed attention decoding.J Neural Eng. 2020 Aug 19;17(4):046039. doi: 10.1088/1741-2552/aba6f8. J Neural Eng. 2020. PMID: 32679578
-
Noise, amplification, and compression: considerations of three main issues in hearing aid design.Ear Hear. 1994 Feb;15(1):2-12. Ear Hear. 1994. PMID: 8194676 Review.
Cited by
-
EEG alpha and pupil diameter reflect endogenous auditory attention switching and listening effort.Eur J Neurosci. 2022 Mar;55(5):1262-1277. doi: 10.1111/ejn.15616. Epub 2022 Feb 16. Eur J Neurosci. 2022. PMID: 35098604 Free PMC article.
-
Are They Calling My Name? Attention Capture Is Reflected in the Neural Tracking of Attended and Ignored Speech.Front Neurosci. 2021 Mar 22;15:643705. doi: 10.3389/fnins.2021.643705. eCollection 2021. Front Neurosci. 2021. PMID: 33828451 Free PMC article.
-
Diagnosis of hearing deficiency using EEG based AEP signals: CWT and improved-VGG16 pipeline.PeerJ Comput Sci. 2021 Sep 29;7:e638. doi: 10.7717/peerj-cs.638. eCollection 2021. PeerJ Comput Sci. 2021. PMID: 34712786 Free PMC article.
-
Extracting the Auditory Attention in a Dual-Speaker Scenario From EEG Using a Joint CNN-LSTM Model.Front Physiol. 2021 Aug 2;12:700655. doi: 10.3389/fphys.2021.700655. eCollection 2021. Front Physiol. 2021. PMID: 34408661 Free PMC article.
-
Brain-informed speech separation (BISS) for enhancement of target speaker in multitalker speech perception.Neuroimage. 2020 Dec;223:117282. doi: 10.1016/j.neuroimage.2020.117282. Epub 2020 Aug 20. Neuroimage. 2020. PMID: 32828921 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
