Vijay Ravi, Jinhan Wang, Jonathan Flint, Abeer Alwan
{"title":"一种用于从语音中检测抑郁的隐私保护无监督扬声器纠错方法","authors":"Vijay Ravi, Jinhan Wang, Jonathan Flint, Abeer Alwan","doi":"","DOIUrl":null,"url":null,"abstract":"<p><p>The proposed method focuses on speaker disentanglement in the context of depression detection from speech signals. Previous approaches require patient/speaker labels, encounter instability due to loss maximization, and introduce unnecessary parameters for adversarial domain prediction. In contrast, the proposed unsupervised approach reduces cosine similarity between latent spaces of depression and pre-trained speaker classification models. This method outperforms baseline models, matches or exceeds adversarial methods in performance, and does so without relying on speaker labels or introducing additional model parameters, leading to a reduction in model complexity. The higher the speaker de-identification score (<i>DeID</i>), the better the depression detection system is in masking a patient's identity thereby enhancing the privacy attributes of depression detection systems. On the DAIC-WOZ dataset with ComparE16 features and an LSTM-only model, our method achieves an F1-Score of 0.776 and a <i>DeID</i> score of 92.87%, outperforming its adversarial counterpart which has an F1Score of 0.762 and 68.37% <i>DeID</i>, respectively. Furthermore, we demonstrate that speaker-disentanglement methods are complementary to text-based approaches, and a score-level fusion with a Word2vec-based depression detection model further enhances the overall performance to an F1-Score of 0.830.</p>","PeriodicalId":72554,"journal":{"name":"CEUR workshop proceedings","volume":"3649 ","pages":"57-63"},"PeriodicalIF":0.0000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11034881/pdf/","citationCount":"0","resultStr":"{\"title\":\"A Privacy-Preserving Unsupervised Speaker Disentanglement Method for Depression Detection from Speech.\",\"authors\":\"Vijay Ravi, Jinhan Wang, Jonathan Flint, Abeer Alwan\",\"doi\":\"\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The proposed method focuses on speaker disentanglement in the context of depression detection from speech signals. Previous approaches require patient/speaker labels, encounter instability due to loss maximization, and introduce unnecessary parameters for adversarial domain prediction. In contrast, the proposed unsupervised approach reduces cosine similarity between latent spaces of depression and pre-trained speaker classification models. This method outperforms baseline models, matches or exceeds adversarial methods in performance, and does so without relying on speaker labels or introducing additional model parameters, leading to a reduction in model complexity. The higher the speaker de-identification score (<i>DeID</i>), the better the depression detection system is in masking a patient's identity thereby enhancing the privacy attributes of depression detection systems. On the DAIC-WOZ dataset with ComparE16 features and an LSTM-only model, our method achieves an F1-Score of 0.776 and a <i>DeID</i> score of 92.87%, outperforming its adversarial counterpart which has an F1Score of 0.762 and 68.37% <i>DeID</i>, respectively. Furthermore, we demonstrate that speaker-disentanglement methods are complementary to text-based approaches, and a score-level fusion with a Word2vec-based depression detection model further enhances the overall performance to an F1-Score of 0.830.</p>\",\"PeriodicalId\":72554,\"journal\":{\"name\":\"CEUR workshop proceedings\",\"volume\":\"3649 \",\"pages\":\"57-63\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11034881/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"CEUR workshop proceedings\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"CEUR workshop proceedings","FirstCategoryId":"1085","ListUrlMain":"","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
所提出的方法侧重于在从语音信号中检测抑郁的背景下进行扬声器分离。以往的方法需要患者/说话人标签,会因损失最大化而导致不稳定性,并为对抗域预测引入不必要的参数。相比之下,所提出的无监督方法降低了抑郁潜空间与预训练说话人分类模型之间的余弦相似度。这种方法的性能优于基线模型,在性能上与对抗方法不相上下,甚至更胜一筹,而且无需依赖说话者标签或引入额外的模型参数,从而降低了模型的复杂性。说话者去身份化得分(DeID)越高,抑郁检测系统在掩盖患者身份方面的表现就越好,从而提高了抑郁检测系统的隐私属性。在使用 ComparE16 特征和纯 LSTM 模型的 DAIC-WOZ 数据集上,我们的方法获得了 0.776 的 F1 分数和 92.87% 的 DeID 分数,优于其 F1 分数为 0.762 和 DeID 分数为 68.37% 的对抗方法。此外,我们还证明了扬声器分离方法与基于文本的方法是互补的,而与基于 Word2vec 的抑郁检测模型进行分数级融合则进一步提高了整体性能,使 F1 分数达到 0.830。
A Privacy-Preserving Unsupervised Speaker Disentanglement Method for Depression Detection from Speech.
The proposed method focuses on speaker disentanglement in the context of depression detection from speech signals. Previous approaches require patient/speaker labels, encounter instability due to loss maximization, and introduce unnecessary parameters for adversarial domain prediction. In contrast, the proposed unsupervised approach reduces cosine similarity between latent spaces of depression and pre-trained speaker classification models. This method outperforms baseline models, matches or exceeds adversarial methods in performance, and does so without relying on speaker labels or introducing additional model parameters, leading to a reduction in model complexity. The higher the speaker de-identification score (DeID), the better the depression detection system is in masking a patient's identity thereby enhancing the privacy attributes of depression detection systems. On the DAIC-WOZ dataset with ComparE16 features and an LSTM-only model, our method achieves an F1-Score of 0.776 and a DeID score of 92.87%, outperforming its adversarial counterpart which has an F1Score of 0.762 and 68.37% DeID, respectively. Furthermore, we demonstrate that speaker-disentanglement methods are complementary to text-based approaches, and a score-level fusion with a Word2vec-based depression detection model further enhances the overall performance to an F1-Score of 0.830.