Publication Details
Analysis of impact of emotions on target speech extraction and speech separation
Žmolíková Kateřina, Ing., Ph.D. (FIT)
Kocour Martin, Ing. (DCGM)
Delcroix Marc
OCHIAI, T.
Mošner Ladislav, Ing. (DCGM)
Černocký Jan, prof. Dr. Ing. (DCGM)
target speech extraction, SpeakerBeam, speech separation, Conv-TasNet, emotion
Recently, the performance of blind speech separation (BSS) and target speech
extraction (TSE) has greatly progressed. Most works, however, focus on relatively
well-controlled conditions using, e.g., read speech. The performance may degrade
in more realistic situations. One of the factors causing such degradation may be
intrinsic speaker variability, such as emotions, occurring commonly in realistic
speech. In this paper, we investigate the influence of emotions on TSE and BSS.
We create a new test dataset of emotional mixtures for the evaluation of TSE and
BSS. This dataset combines LibriSpeech and Ryerson Audio-Visual Database of
Emotional Speech and Song (RAVDESS). Through controlled experiments, we can
analyze the impact of different emotions on the performance of BSS and TSE.We
observe that BSS is relatively robust to emotions, while TSE, which requires
identifying and extracting the speech of a target speaker, is much more sensitive
to emotions. On comparative speaker verification experiments we show that
identifying the target speaker may be particularly challenging when dealing with
emotional speech. Using our findings, we outline potential future directions that
could improve the robustness of BSS and TSE systems toward emotional speech.
@inproceedings{BUT179868,
author="ŠVEC, J. and ŽMOLÍKOVÁ, K. and KOCOUR, M. and DELCROIX, M. and OCHIAI, T. and MOŠNER, L. and ČERNOCKÝ, J.",
title="Analysis of impact of emotions on target speech extraction and speech separation",
booktitle="Proceedings of The 17th International Workshop on Acoustic Signal Enhancement (IWAENC 2022)",
year="2022",
pages="1--5",
publisher="IEEE Signal Processing Society",
address="Bamberg",
doi="10.1109/IWAENC53105.2022.9914718",
isbn="978-1-6654-6867-1",
url="https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9914718"
}