Haotian Hu, Alex Jie Yang, Sanhong Deng, Dongbo Wang, Min Song, Si Shen
{"title":"基于大语言模型的生成式药物-药物相互作用三联体提取框架","authors":"Haotian Hu, Alex Jie Yang, Sanhong Deng, Dongbo Wang, Min Song, Si Shen","doi":"10.1002/pra2.918","DOIUrl":null,"url":null,"abstract":"ABSTRACT Drug–Drug Interaction (DDI) may affect the activity and efficacy of drugs, potentially leading to diminished therapeutic effect or even serious side effects. Therefore, automatic recognition of drug entities and relations involved in DDI is of great significance for pharmaceutical and medical care. In this paper, we propose a generative DDI triplets extraction framework based on Large Language Models (LLMs). We comprehensively apply various training methods, such as In‐context learning, Instruction‐tuning, and Task‐tuning, to investigate the biomedical information extraction capabilities of GPT‐3, OPT, and LLaMA. We also introduce Low‐Rank Adaptation (LoRA) technology to significantly reduce trainable parameters. The proposed method achieves satisfactory results in DDI triplet extraction, and demonstrates strong generalization ability on similar corpus.","PeriodicalId":37833,"journal":{"name":"Proceedings of the Association for Information Science and Technology","volume":"185 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Generative <scp>Drug–Drug</scp> Interaction Triplets Extraction Framework Based on Large Language Models\",\"authors\":\"Haotian Hu, Alex Jie Yang, Sanhong Deng, Dongbo Wang, Min Song, Si Shen\",\"doi\":\"10.1002/pra2.918\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Drug–Drug Interaction (DDI) may affect the activity and efficacy of drugs, potentially leading to diminished therapeutic effect or even serious side effects. Therefore, automatic recognition of drug entities and relations involved in DDI is of great significance for pharmaceutical and medical care. In this paper, we propose a generative DDI triplets extraction framework based on Large Language Models (LLMs). We comprehensively apply various training methods, such as In‐context learning, Instruction‐tuning, and Task‐tuning, to investigate the biomedical information extraction capabilities of GPT‐3, OPT, and LLaMA. We also introduce Low‐Rank Adaptation (LoRA) technology to significantly reduce trainable parameters. The proposed method achieves satisfactory results in DDI triplet extraction, and demonstrates strong generalization ability on similar corpus.\",\"PeriodicalId\":37833,\"journal\":{\"name\":\"Proceedings of the Association for Information Science and Technology\",\"volume\":\"185 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Association for Information Science and Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1002/pra2.918\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Social Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Association for Information Science and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/pra2.918","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Social Sciences","Score":null,"Total":0}
A Generative Drug–Drug Interaction Triplets Extraction Framework Based on Large Language Models
ABSTRACT Drug–Drug Interaction (DDI) may affect the activity and efficacy of drugs, potentially leading to diminished therapeutic effect or even serious side effects. Therefore, automatic recognition of drug entities and relations involved in DDI is of great significance for pharmaceutical and medical care. In this paper, we propose a generative DDI triplets extraction framework based on Large Language Models (LLMs). We comprehensively apply various training methods, such as In‐context learning, Instruction‐tuning, and Task‐tuning, to investigate the biomedical information extraction capabilities of GPT‐3, OPT, and LLaMA. We also introduce Low‐Rank Adaptation (LoRA) technology to significantly reduce trainable parameters. The proposed method achieves satisfactory results in DDI triplet extraction, and demonstrates strong generalization ability on similar corpus.