ISCA Archive Odyssey 2026
ISCA Archive Odyssey 2026

Evaluating voice anonymisation using similarity rank disclosure

Shilpa Chandra, Matteo Pettenò, Michele Panariello, Nicholas Evans, Massimiliano Todisco, Tom Bäckström, Dorothea Kolossa, Rainer Martin, Themos Stafylakis, Nicolas Gengembre

The evaluation of voice anonymisation remains challenging. Current practice relies on automatic speaker verification metrics such as the equal error rate (EER). Performance estimates dependent on the classifier and operating point provide an incomplete or even misleading characterisation of privacy risk. We investigate the use of similarity rank disclosure (SRD), an information-theoretic metric, which operates on feature representations rather than classifier decisions, providing a threshold-independent assessment of privacy and analysis of both average and worst-case disclosure. We report its application to speaker embeddings, fundamental frequency, and phone embeddings using 2024 VoicePrivacy Challenge systems. The SRD reveals privacy leaks and system-specific weaknesses missed by EER-based evaluation. Findings highlight the merit of representation-level metrics and demonstrate the potential of SRD as a flexible and interpretable tool for the evaluation of voice anonymisation.