Publication Details
Listen only to me! How well can target speech extraction handle false alarms?
Kinoshita Keisuke
OCHIAI, T.
Žmolíková Kateřina, Ing., Ph.D. (FIT)
Sato Hiroshi
Nakatani Tomohiro
Speech enhancement, Target speech extraction, Inactive speaker
Target speech extraction (TSE) extracts the speech of a target speaker in
a mixture given auxiliary clues characterizing the speaker, such as an enrollment
utterance. TSE addresses thus the challenging problem of simultaneously
performing separation and speaker identification. There has been much progress in
extraction performance following the recent development of neural networks for
speech enhancement and separation. Most studies have focused on processing
mixtures where the target speaker is actively speaking. However, the target
speaker is sometimes silent in practice, i.e., inactive speaker (IS). A typical
TSE system will tend to output a signal in IS cases, causing false alarms. This
is a severe problem for the practical deployment of TSE systems. This paper aims
at understanding better how well TSE systems can handle IS cases. We consider two
approaches to deal with IS, (1) training a system to directly output zero signals
or (2) detecting IS with an extra speaker verification module. We perform an
extensive experimental comparison of these schemes in terms of extraction
performance and IS detection using the LibriMix dataset and reveal their pros and
cons.
@inproceedings{BUT179867,
author="DELCROIX, M. and KINOSHITA, K. and OCHIAI, T. and ŽMOLÍKOVÁ, K. and SATO, H. and NAKATANI, T.",
title="Listen only to me! How well can target speech extraction handle false alarms?",
booktitle="Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",
year="2022",
journal="Proceedings of Interspeech",
number="9",
pages="216--220",
publisher="International Speech Communication Association",
address="Incheon",
doi="10.21437/Interspeech.2022-11252",
issn="1990-9772",
url="https://www.isca-speech.org/archive/pdfs/interspeech_2022/delcroix22_interspeech.pdf"
}