Publication Details
Learning document representations using subspace multinomial model
Burget Lukáš, doc. Ing., Ph.D. (DCGM)
Szőke Igor, Ing., Ph.D. (DCGM)
Černocký Jan, prof. Dr. Ing. (DCGM)
Document representation, subspace modelling,topic identification, latent topic discovery
Subspace multinomial model (SMM) is a log-linear model andcan be used for learning low dimensional continuous representationfor discrete data. SMMand its variants have been used forspeaker verification based on prosodic features and phonotacticlanguage recognition. In this paper, we propose a new variantof SMM that introduces sparsity and call the resulting modelas `1 SMM. We show that `1 SMM can be used for learningdocument representations that are helpful in topic identificationor classification and clustering tasks. Our experiments in documentclassification show that SMM achieves comparable resultsto models such as latent Dirichlet allocation and sparse topicalcoding, while having a useful property that the resulting documentvectors are Gaussian distributed.
Subspace multinomial model (SMM) is a log-linear model and can be used for learning low dimensional continuous representation for discrete data. SMMand its variants have been used for speaker verification based on prosodic features and phonotactic language recognition. In this paper, we propose a new variant of SMM that introduces sparsity and call the resulting model as `1 SMM. We show that `1 SMM can be used for learning document representations that are helpful in topic identification or classification and clustering tasks. Our experiments in document classification show that SMM achieves comparable results to models such as latent Dirichlet allocation and sparse topical coding, while having a useful property that the resulting document vectors are Gaussian distributed.
@inproceedings{BUT132598,
author="Santosh {Kesiraju} and Lukáš {Burget} and Igor {Szőke} and Jan {Černocký}",
title="Learning document representations using subspace multinomial model",
booktitle="Proceedings of Interspeech 2016",
year="2016",
pages="700--704",
publisher="International Speech Communication Association",
address="San Francisco",
doi="10.21437/Interspeech.2016-1634",
isbn="978-1-5108-3313-5",
url="https://www.researchgate.net/publication/307889473_Learning_Document_Representations_Using_Subspace_Multinomial_Model"
}