用GPT-3检测马来语方言的抑制性

Mohamad Farid Mohd Hayati, M. Ali, Ahmad Nabil Md. Rosli
{"title":"用GPT-3检测马来语方言的抑制性","authors":"Mohamad Farid Mohd Hayati, M. Ali, Ahmad Nabil Md. Rosli","doi":"10.1109/IECBES54088.2022.10079554","DOIUrl":null,"url":null,"abstract":"The increasing number of depression cases and lack of manpower in mental healthcare services call for alternatives use of Artificial Intelligence. Natural language processing (NLP) can offer help in the form of early detection and frequent assessments. However, such technology is still limited in the local Malaysian context. In this paper we aimed to deploy Malay NLP in the local mental healthcare services. We performed depression detection on dialectal Malay speeches, specifically Kuala Lumpur, Pahang, and Terengganu dialects. Generative Pre-Trained Transformer-3 (GPT-3), a large language model, was used to perform the task. We experimented with different hyperparameters to test the capability of GPT-3 in few-shot learning. The results obtained are promising considering the size of our dataset that is very limited. We hope to see more studies in the field for the better development of Malay NLP in future. Clinical Relevance— This research tests the possibility of using NLP technology in the local setting of Malaysia. The advancement of this technology will be beneficial in mental healthcare especially in term of the availability of services such as early detection and frequent assessment.","PeriodicalId":146681,"journal":{"name":"2022 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Depression Detection on Malay Dialects Using GPT-3\",\"authors\":\"Mohamad Farid Mohd Hayati, M. Ali, Ahmad Nabil Md. Rosli\",\"doi\":\"10.1109/IECBES54088.2022.10079554\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The increasing number of depression cases and lack of manpower in mental healthcare services call for alternatives use of Artificial Intelligence. Natural language processing (NLP) can offer help in the form of early detection and frequent assessments. However, such technology is still limited in the local Malaysian context. In this paper we aimed to deploy Malay NLP in the local mental healthcare services. We performed depression detection on dialectal Malay speeches, specifically Kuala Lumpur, Pahang, and Terengganu dialects. Generative Pre-Trained Transformer-3 (GPT-3), a large language model, was used to perform the task. We experimented with different hyperparameters to test the capability of GPT-3 in few-shot learning. The results obtained are promising considering the size of our dataset that is very limited. We hope to see more studies in the field for the better development of Malay NLP in future. Clinical Relevance— This research tests the possibility of using NLP technology in the local setting of Malaysia. The advancement of this technology will be beneficial in mental healthcare especially in term of the availability of services such as early detection and frequent assessment.\",\"PeriodicalId\":146681,\"journal\":{\"name\":\"2022 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES)\",\"volume\":\"13 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IECBES54088.2022.10079554\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IECBES54088.2022.10079554","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

越来越多的抑郁症病例和精神保健服务人力不足要求人工智能的替代使用。自然语言处理(NLP)可以以早期发现和频繁评估的形式提供帮助。然而,这种技术在马来西亚当地的背景下仍然有限。在本文中,我们的目的是部署马来NLP在当地的精神卫生保健服务。我们对马来方言演讲,特别是吉隆坡、彭亨和登嘉楼方言进行了抑郁检测。生成预训练转换器-3 (GPT-3)是一种大型语言模型,用于执行任务。我们用不同的超参数来测试GPT-3在短时学习中的能力。考虑到我们的数据集非常有限,所获得的结果是有希望的。我们希望在这一领域有更多的研究,以便马来语NLP在未来得到更好的发展。临床相关性-本研究测试了在马来西亚当地使用NLP技术的可能性。这项技术的进步将有利于精神保健,特别是在早期发现和频繁评估等服务的可用性方面。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Depression Detection on Malay Dialects Using GPT-3
The increasing number of depression cases and lack of manpower in mental healthcare services call for alternatives use of Artificial Intelligence. Natural language processing (NLP) can offer help in the form of early detection and frequent assessments. However, such technology is still limited in the local Malaysian context. In this paper we aimed to deploy Malay NLP in the local mental healthcare services. We performed depression detection on dialectal Malay speeches, specifically Kuala Lumpur, Pahang, and Terengganu dialects. Generative Pre-Trained Transformer-3 (GPT-3), a large language model, was used to perform the task. We experimented with different hyperparameters to test the capability of GPT-3 in few-shot learning. The results obtained are promising considering the size of our dataset that is very limited. We hope to see more studies in the field for the better development of Malay NLP in future. Clinical Relevance— This research tests the possibility of using NLP technology in the local setting of Malaysia. The advancement of this technology will be beneficial in mental healthcare especially in term of the availability of services such as early detection and frequent assessment.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信