Publication Details

Three ways to adapt a CTS recognizer to unseen reverberated speech in BUT system for the ASpIRE challenge

KARAFIÁT, M.; GRÉZL, F.; BURGET, L.; SZŐKE, I.; ČERNOCKÝ, J. Three ways to adapt a CTS recognizer to unseen reverberated speech in BUT system for the ASpIRE challenge. In Proceedings of Interspeech 2015. Proceedings of Interspeech. Dresden: International Speech Communication Association, 2015. p. 2454-2458. ISBN: 978-1-5108-1790-6. ISSN: 1990-9772.
Czech title
Tři způsoby adaptace telefonního rozpoznávače pro neviděnou reverberovanou řeč ve VUT systému pro soutěž ASpIRE
Type
conference paper
Language
English
Authors
Karafiát Martin, Ing., Ph.D. (DCGM)
Grézl František, Ing., Ph.D. (DCGM)
Burget Lukáš, doc. Ing., Ph.D. (DCGM)
Szőke Igor, Ing., Ph.D. (DCGM)
Černocký Jan, prof. Dr. Ing. (DCGM)
URL
Keywords

speech recognition, reverberation, dereverberation, neural networks, DNN

Abstract

We have presented our work towards the ASR of wide-band noisy reverberant speech in ASpIRE challenge. To solve this task, we have started with augmenting Fisher data with artificially noised and reverberated versions.

Annotation

This paper describes several strategies tested in BUT’s submission to the IARPA ASpIRE challenge. The ASpIRE task was to develop an automatic speech recognition (ASR) system for wide-band noisy reverberant speech, while only clean CTS (Fisher) data was allowed for ASR training. To solve this task, we have started with augmenting Fisher data with artificially noised and reverberated versions. The most obvious adaptation was (1) to re-train the whole GMM/HMM-based ASR system. Then, two techniques were designed and tested to make the adaptation easier and overcome retraining the whole ASR on large amount of speech: (2) we trained a speech enhancement DNN (also called de-noising auto-encoder), and (3) we adapted the feature extraction based on stacked bottle-neck networks (SBN). While re-training the whole system works the best, only slightly inferior results were obtained with the autoencoder denoising followed by retraining of the first layers of the SBN hierarchy, letting most of the ASR system trained on clean Fisher unchanged. This shows a promising, efficient and fast way to port ASR systems to new conditions.

Published
2015
Pages
2454–2458
Journal
Proceedings of Interspeech, vol. 2015, no. 09, ISSN 1990-9772
Proceedings
Proceedings of Interspeech 2015
Conference
INTERSPEECH 2015, Dresden, DE
ISBN
978-1-5108-1790-6
Publisher
International Speech Communication Association
Place
Dresden
UT WoS
000380581601048
EID Scopus
2-s2.0-84959099062
BibTeX 
@inproceedings{BUT119908,
  author="Martin {Karafiát} and František {Grézl} and Lukáš {Burget} and Igor {Szőke} and Jan {Černocký}",
  title="Three ways to adapt a CTS recognizer to unseen reverberated speech in BUT system for the ASpIRE challenge",
  booktitle="Proceedings of Interspeech 2015",
  year="2015",
  journal="Proceedings of Interspeech",
  volume="2015",
  number="09",
  pages="2454--2458",
  publisher="International Speech Communication Association",
  address="Dresden",
  isbn="978-1-5108-1790-6",
  issn="1990-9772",
  url="https://www.fit.vut.cz/research/publication/10972/"
}
Files
Back to top