Publication Details
Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio
WANG, X.
COOPER, E.
DIEZ SÁNCHEZ, M.
Landini Federico Nicolás, Ph.D. (RG SPEECH)
EVANS, N.
YAMAGISHI, J.
partial spoof, spoof diarization, countermeasure, clustering
This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS)
scenario. It aims to determine what spoofed when, which includes not only
locating spoof regions but also clustering them according to different spoofing
methods. As a pioneering study in spoof diarization, we focus on defining the
task, establishing evaluation metrics, and proposing a bench- mark model, namely
the Countermeasure-Condition Cluster- ing (3C) model. Utilizing this model, we
first explore how to effectively train countermeasures to support spoof diariza-
tion using three labeling schemes. We then utilize spoof lo- calization
predictions to enhance the diarization performance. This first study reveals the
high complexity of the task, even in restricted scenarios where only a single
speaker per au- dio file and an oracle number of spoofing methods are con-
sidered. Our code is available at https://github.com/
nii-yamagishilab/PartialSpoof.
@inproceedings{BUT193676,
author="ZHANG, L. and WANG, X. and COOPER, E. and DIEZ SÁNCHEZ, M. and LANDINI, F. and EVANS, N. and YAMAGISHI, J.",
title="Spoof Diarization: {"}What Spoofed When{"} in Partially Spoofed Audio",
booktitle="Proceedings of Interspeech 2024",
year="2024",
journal="Proceedings of Interspeech",
volume="2024",
number="9",
pages="502--506",
publisher="International Speech Communication Association",
address="Kos",
doi="10.21437/Interspeech.2024-1365",
issn="1990-9772",
url="https://www.isca-archive.org/interspeech_2024/zhang24j_interspeech.pdf"
}