Publication Details
On the use of deep feedforward neural networks for automatic language identification
Gonzalez-Dominguez Javier (FIT)
Martínez González David (FIT)
Plchot Oldřich, Ing., Ph.D. (DCGM)
Gonzalez-Rodriguez Joaquin (FIT)
Moreno Pedro (FIT)
LID; DNN; Bottleneck; i-vectors
In this work, we presented an extensive study of the use of deep neural networks for LID. Guided by the success of DNNs for acoustic modelling, we explored their capability to learn discriminative language information from speech signals.
In this work, we present a comprehensive study on the use of deep neural networks (DNNs) for automatic language identification (LID). Motivated by the recent success of using DNNs in acoustic modeling for speech recognition, we adapt DNNs to the problem of identifying the language in a given utterance from its short-term acoustic features. We propose two different DNN-based approaches. In the first one, the DNN acts as an end-to-end LID classifier, receiving as input the speech features and providing as output the estimated probabilities of the target languages. In the second approach, the DNN is used to extract bottleneck features that are then used as inputs for a state-of-the-art i-vector system. Experiments are conducted in two different scenarios: the complete NIST Language Recognition Evaluation dataset 2009 (LRE'09) and a subset of the Voice of America (VOA) data from LRE'09, in which all languages have the same amount of training data. Results for both datasets demonstrate that the DNN-based systems significantly outperform a state-of-art i-vector system when dealing with short-duration utterances. Furthermore, the combination of the DNN-based and the classical i-vector system leads to additional performance improvements (up to 45% of relative improvement in both EER and CavgCavg on 3s and 10s conditions, respectively).
@article{BUT130983,
author="Ignacio {Lopez-Moreno} and Javier {Gonzalez-Dominguez} and David {Martínez González} and Oldřich {Plchot} and Joaquin {Gonzalez-Rodriguez} and Pedro {Moreno}",
title="On the use of deep feedforward neural networks for automatic language identification",
journal="COMPUTER SPEECH AND LANGUAGE",
year="2016",
volume="2016",
number="40",
pages="46--59",
doi="10.1016/j.csl.2016.03.001",
issn="0885-2308",
url="http://www.sciencedirect.com/science/article/pii/S088523081530036X"
}