A foundation language model to decipher diverse regulation of RNAs

IF 10.1 1区 生物学 Q1 BIOTECHNOLOGY & APPLIED MICROBIOLOGY
Hanwen Zhou, Yue Hu, Yulong Zheng, Jiefu Li, Jielong Peng, Jiang Hu, Yun Yang, Wei Chen, Guoqing Zhang, Zefeng Wang
{"title":"A foundation language model to decipher diverse regulation of RNAs","authors":"Hanwen Zhou, Yue Hu, Yulong Zheng, Jiefu Li, Jielong Peng, Jiang Hu, Yun Yang, Wei Chen, Guoqing Zhang, Zefeng Wang","doi":"10.1186/s13059-025-03752-x","DOIUrl":null,"url":null,"abstract":"RNA metabolism is tightly regulated by cis-elements and trans-acting factors. Most information guiding such regulation is encoded in RNA sequences. Deciphering the regulatory rules is critical for RNA biology and therapeutics; however, the prediction of diverse regulation from RNA sequences remains a formidable challenge. Considering the similarities in semantic and syntactic features between RNAs and human language, we present LAMAR, a transformer-based foundation LAnguage Model for RNA Regulation, to decipher general rules underlying RNA processing. The model is pretrained on approximately 15 million sequences from both genome and transcriptome of 225 mammals and 1569 viruses, and further fine-tuned with labeled datasets for various tasks. The resulting fine-tuned models outperform the state-of-the-art methods in predicting mRNA translation efficiency and mRNA half-life, while achieving comparable accuracy to specifically designed methods in predicting splice sites of pre-mRNAs and internal ribosome entry sites (IRESs). The fine-tuned LAMAR is further applied to predict mutational effects of cis-regulatory elements and reveals known and novel regulatory elements that modulate RNA degradation. The fine-tuned LAMAR is also applied in an in silico screen of novel IRESs, resulting in the identifications of highly active IRESs that promote circRNA translation. Our results indicate that a single foundation language model is applicable in the comprehensive analysis of different aspects of RNA regulation and predictive identification of novel regulatory elements, providing new insight into the design and optimization of RNA drugs.","PeriodicalId":12611,"journal":{"name":"Genome Biology","volume":"38 1","pages":""},"PeriodicalIF":10.1000,"publicationDate":"2025-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Genome Biology","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.1186/s13059-025-03752-x","RegionNum":1,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BIOTECHNOLOGY & APPLIED MICROBIOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

RNA metabolism is tightly regulated by cis-elements and trans-acting factors. Most information guiding such regulation is encoded in RNA sequences. Deciphering the regulatory rules is critical for RNA biology and therapeutics; however, the prediction of diverse regulation from RNA sequences remains a formidable challenge. Considering the similarities in semantic and syntactic features between RNAs and human language, we present LAMAR, a transformer-based foundation LAnguage Model for RNA Regulation, to decipher general rules underlying RNA processing. The model is pretrained on approximately 15 million sequences from both genome and transcriptome of 225 mammals and 1569 viruses, and further fine-tuned with labeled datasets for various tasks. The resulting fine-tuned models outperform the state-of-the-art methods in predicting mRNA translation efficiency and mRNA half-life, while achieving comparable accuracy to specifically designed methods in predicting splice sites of pre-mRNAs and internal ribosome entry sites (IRESs). The fine-tuned LAMAR is further applied to predict mutational effects of cis-regulatory elements and reveals known and novel regulatory elements that modulate RNA degradation. The fine-tuned LAMAR is also applied in an in silico screen of novel IRESs, resulting in the identifications of highly active IRESs that promote circRNA translation. Our results indicate that a single foundation language model is applicable in the comprehensive analysis of different aspects of RNA regulation and predictive identification of novel regulatory elements, providing new insight into the design and optimization of RNA drugs.
一种基础语言模型来解读rna的多种调控
RNA的代谢受到顺式元件和反式作用因子的严格调控。大多数指导这种调控的信息都编码在RNA序列中。破译这些调控规则对RNA生物学和治疗学至关重要;然而,预测来自RNA序列的多种调控仍然是一个艰巨的挑战。考虑到RNA和人类语言在语义和句法特征上的相似性,我们提出了一种基于转换器的RNA调控基础语言模型LAMAR,以破译RNA加工的一般规则。该模型是在225种哺乳动物和1569种病毒的基因组和转录组的大约1500万个序列上进行预训练的,并使用标记的数据集对各种任务进行进一步微调。由此产生的微调模型在预测mRNA翻译效率和mRNA半衰期方面优于最先进的方法,同时在预测pre-mRNA剪接位点和内部核糖体进入位点(IRESs)方面达到与专门设计的方法相当的准确性。微调LAMAR进一步应用于预测顺式调控元件的突变效应,并揭示了调节RNA降解的已知和新的调控元件。经过微调的LAMAR也被应用于新型IRESs的硅屏中,从而鉴定出促进circRNA翻译的高活性IRESs。我们的研究结果表明,单一的基础语言模型适用于RNA调控的不同方面的综合分析和新调控元件的预测鉴定,为RNA药物的设计和优化提供了新的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Genome Biology
Genome Biology Biochemistry, Genetics and Molecular Biology-Genetics
CiteScore
21.00
自引率
3.30%
发文量
241
审稿时长
2 months
期刊介绍: Genome Biology stands as a premier platform for exceptional research across all domains of biology and biomedicine, explored through a genomic and post-genomic lens. With an impressive impact factor of 12.3 (2022),* the journal secures its position as the 3rd-ranked research journal in the Genetics and Heredity category and the 2nd-ranked research journal in the Biotechnology and Applied Microbiology category by Thomson Reuters. Notably, Genome Biology holds the distinction of being the highest-ranked open-access journal in this category. Our dedicated team of highly trained in-house Editors collaborates closely with our esteemed Editorial Board of international experts, ensuring the journal remains on the forefront of scientific advances and community standards. Regular engagement with researchers at conferences and institute visits underscores our commitment to staying abreast of the latest developments in the field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信