Publication Details
Recovery of Rare Words in Lecture Speech
Hannemann Mirko, Ph.D.
Burget Lukáš, doc. Ing., Ph.D. (DCGM)
Heřmanský Hynek, prof. Ing. (DCGM)
speech, rare words, recognizer, detect OOV words, sub-words, lectures
This paper is on recovery of rare words in lecture speech. We use a hybrid word/sub-word recognizer to detect OOV words occurring in English talks and describe them as sequences of sub-words.
The vocabulary used in speech usually consists of two types of words: a limited set of common words, shared across multiple documents, and a virtually unlimited set of rare words, each of which might appear a few times only in particular documents. In most documents, however, these rare words are not seen at all. The first type of words is typically included in the language model of an automatic speech recognizer (ASR) and is thus widely referred to as invocabulary (IV). Words of the second type are missing in the language model and thus are called out-of-vocabulary (OOV). However, these words usually carry important information. We use a hybrid word/sub-word recognizer to detect OOV words occurring in English talks and describe them as sequences of sub-words.We detected about one third of all OOV words, and were able to recover the correct spelling for 26.2% of all detections by using a phoneme-to-grapheme (P2G) conversion trained on the recognition dictionary. By omitting detections corresponding to recovered IV words, we were able to increase the precision of the OOV detection substantially
@inproceedings{BUT34927,
author="Stefan {Kombrink} and Mirko {Hannemann} and Lukáš {Burget} and Hynek {Heřmanský}",
title="Recovery of Rare Words in Lecture Speech",
booktitle="Proc. Text, Speech and Dialogue 2010",
year="2010",
journal="Lecture Notes in Computer Science",
volume="2010",
number="9",
pages="330--337",
publisher="Springer Verlag",
address="Brno",
isbn="978-3-642-15759-2",
issn="0302-9743",
url="http://www.fit.vutbr.cz/research/groups/speech/publi/2010/kombrink_TSD_2010_330.pdf"
}