Publication Details

Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results

MALANDRAKIS, N.; GLEMBEK, O.; NARAYANAN, S. Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results. In Proceedings of Interspeech 2017. Proceedings of Interspeech. Stockholm: International Speech Communication Association, 2017. p. 2123-2127. ISSN: 1990-9772.
Czech title
Extrakce situačních rámců z ne-anglické řeči: evaluační metodika a pilotní výsledky
Type
conference paper
Language
English
Authors
Malandrakis Nikolaos (FIT)
Glembek Ondřej, Ing., Ph.D.
Narayanan Shrikanth, prof., PhD
URL
Keywords

speech recognition, speech analysis, performance evaluation, natural language processing

Abstract

This paper describes the first evaluation framework for the extraction of Situation Frames - structures describing humanitarian assistance needs - from non-English speech audio, conducted for the DARPA LORELEI (Low Resource Languages for Emergent Incidents) program. Participants in LORELEI had to process audio from a variety of sources, in non-English languages, and extract the information required to populate Situation Frames describing whether any need is mentioned, the type of need present and where the need exists. The evaluation was conducted over a period of 10 days and attracted submissions from 6 teams, each team spanning multiple organizations. Performance was evaluated using precision-recall curves. The results are encouraging, with most teams showing some capability to detect the type of situation discussed, but more work will be required to connect needs to specific locations.

Published
2017
Pages
2123–2127
Journal
Proceedings of Interspeech, vol. 2017, no. 8, ISSN 1990-9772
Proceedings
Proceedings of Interspeech 2017
Publisher
International Speech Communication Association
Place
Stockholm
DOI
10.21437/Interspeech.2017-226
UT WoS
000457505000444
EID Scopus
2-s2.0-85039170544
BibTeX 
@inproceedings{BUT163392,
  author="Nikolaos {Malandrakis} and Ondřej {Glembek} and Shrikanth {Narayanan}",
  title="Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results",
  booktitle="Proceedings of Interspeech 2017",
  year="2017",
  journal="Proceedings of Interspeech",
  volume="2017",
  number="8",
  pages="2123--2127",
  publisher="International Speech Communication Association",
  address="Stockholm",
  doi="10.21437/Interspeech.2017-226",
  issn="1990-9772",
  url="https://www.semanticscholar.org/paper/Extracting-Situation-Frames-from-Non-English-and-Malandrakis-Glembek/047ebaf46d648fea9e5c2c64873c629f7fd53a00"
}
Back to top