Project Details

Neural Representations in multi-modal and multi-lingual modeling

Project Period: 1. 1. 2019 – 31. 12. 2023

Project Type: grant

Code: GX19-26934X

Agency: Czech Science Foundation

Program: Grantové projekty exelence v základním výzkumu EXPRO - 2019

Czech title
Neuronové reprezentace v multimodálním a mnohojazyčném modelování
Type
grant
Keywords

deep learning;machine learning;neural networks;continuous representations;natural
language processing;speech and text processing;machine
translation;multi-modality;multi-linguality

Abstract

The NEUREM3 project encompasses basic research in speech processing (SP) and
natural language processing (NLP) with accent on multi-linguality and
multi-modality (speech and text processing with the support of visual
information). Current deep machine learning methods are based on continuous
vector representations that are created by the neural networks (NN) themselves
during the training. Although empirically, the results of such NNs are often
excellent, our knowledge and understanding of such representations is
insufficient. NEUREM3 has an ambition to fill this gap and to study neural
representations for speech and text units of different scopes (from phonemes and
letters to whole spoken and written documents) and representations acquired both
for isolated tasks and multi-task setups. NEUREM3 will also improve NN
architectures and training techniques, so that they can be trained on incomplete
or incoherent data.

Team members
Burget Lukáš, doc. Ing., Ph.D. (DCGM) – research leader
Baskar Murali Karthick, Ing., Ph.D.
Beneš Karel, Ing. (DCGM)
Karafiát Martin, Ing., Ph.D. (DCGM)
Veselý Karel, Ing., Ph.D. (DCGM)
Publications

2024

2023

2022

2021

2020

2019

Back to top