Mobeen Ur Rehman, Zeeshan Abbas, Farman Ullah, Irfan Hussain
{"title":"AttnW2V-Enhancer:利用注意力和Word2Vec来增强增强预测。","authors":"Mobeen Ur Rehman, Zeeshan Abbas, Farman Ullah, Irfan Hussain","doi":"10.1016/j.csbj.2025.07.008","DOIUrl":null,"url":null,"abstract":"<p><p>Accurate identification of enhancer regions in DNA sequences is essential for understanding gene regulation and its role in diverse biological processes. Enhancers are regulatory elements that influence gene expression, but their detection remains challenging due to the complexity and variability of genomic sequences. In this study, we propose AttnW2V-Enhancer, a novel model that combines Word2Vec-based sequence encoding, convolutional neural networks (CNN), and attention mechanisms to address this challenge. By leveraging Word2Vec embeddings, our model captures biologically meaningful patterns and offers a more efficient and interpretable representation than traditional methods such as one-hot encoding and physicochemical descriptors. We evaluate AttnW2V-Enhancer on an independent test set, where it achieves superior performance with an accuracy of 81.75%, sensitivity of 83.50%, specificity of 80.00%, and a Matthews Correlation Coefficient (MCC) of 0.635, outperforming existing models. Additionally, we demonstrate the effectiveness of the attention mechanism in enhancing feature learning by dynamically focusing on the most relevant sequence regions. These results confirm that integrating Word2Vec encoding with CNNs and attention mechanisms provides a powerful and interpretable framework for enhancer prediction, offering valuable insights into the identification of regulatory sequences. The source code and implementation are publicly available at: https://github.com/Rehman1995/AttnW2V-Enhancer.</p>","PeriodicalId":10715,"journal":{"name":"Computational and structural biotechnology journal","volume":"27 ","pages":"3275-3284"},"PeriodicalIF":4.1000,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12329123/pdf/","citationCount":"0","resultStr":"{\"title\":\"AttnW2V-Enhancer: Leveraging attention and Word2Vec for enhanced enhancer prediction.\",\"authors\":\"Mobeen Ur Rehman, Zeeshan Abbas, Farman Ullah, Irfan Hussain\",\"doi\":\"10.1016/j.csbj.2025.07.008\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Accurate identification of enhancer regions in DNA sequences is essential for understanding gene regulation and its role in diverse biological processes. Enhancers are regulatory elements that influence gene expression, but their detection remains challenging due to the complexity and variability of genomic sequences. In this study, we propose AttnW2V-Enhancer, a novel model that combines Word2Vec-based sequence encoding, convolutional neural networks (CNN), and attention mechanisms to address this challenge. By leveraging Word2Vec embeddings, our model captures biologically meaningful patterns and offers a more efficient and interpretable representation than traditional methods such as one-hot encoding and physicochemical descriptors. We evaluate AttnW2V-Enhancer on an independent test set, where it achieves superior performance with an accuracy of 81.75%, sensitivity of 83.50%, specificity of 80.00%, and a Matthews Correlation Coefficient (MCC) of 0.635, outperforming existing models. Additionally, we demonstrate the effectiveness of the attention mechanism in enhancing feature learning by dynamically focusing on the most relevant sequence regions. These results confirm that integrating Word2Vec encoding with CNNs and attention mechanisms provides a powerful and interpretable framework for enhancer prediction, offering valuable insights into the identification of regulatory sequences. The source code and implementation are publicly available at: https://github.com/Rehman1995/AttnW2V-Enhancer.</p>\",\"PeriodicalId\":10715,\"journal\":{\"name\":\"Computational and structural biotechnology journal\",\"volume\":\"27 \",\"pages\":\"3275-3284\"},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2025-07-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12329123/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computational and structural biotechnology journal\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://doi.org/10.1016/j.csbj.2025.07.008\",\"RegionNum\":2,\"RegionCategory\":\"生物学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"BIOCHEMISTRY & MOLECULAR BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computational and structural biotechnology journal","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.1016/j.csbj.2025.07.008","RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"BIOCHEMISTRY & MOLECULAR BIOLOGY","Score":null,"Total":0}
AttnW2V-Enhancer: Leveraging attention and Word2Vec for enhanced enhancer prediction.
Accurate identification of enhancer regions in DNA sequences is essential for understanding gene regulation and its role in diverse biological processes. Enhancers are regulatory elements that influence gene expression, but their detection remains challenging due to the complexity and variability of genomic sequences. In this study, we propose AttnW2V-Enhancer, a novel model that combines Word2Vec-based sequence encoding, convolutional neural networks (CNN), and attention mechanisms to address this challenge. By leveraging Word2Vec embeddings, our model captures biologically meaningful patterns and offers a more efficient and interpretable representation than traditional methods such as one-hot encoding and physicochemical descriptors. We evaluate AttnW2V-Enhancer on an independent test set, where it achieves superior performance with an accuracy of 81.75%, sensitivity of 83.50%, specificity of 80.00%, and a Matthews Correlation Coefficient (MCC) of 0.635, outperforming existing models. Additionally, we demonstrate the effectiveness of the attention mechanism in enhancing feature learning by dynamically focusing on the most relevant sequence regions. These results confirm that integrating Word2Vec encoding with CNNs and attention mechanisms provides a powerful and interpretable framework for enhancer prediction, offering valuable insights into the identification of regulatory sequences. The source code and implementation are publicly available at: https://github.com/Rehman1995/AttnW2V-Enhancer.
期刊介绍:
Computational and Structural Biotechnology Journal (CSBJ) is an online gold open access journal publishing research articles and reviews after full peer review. All articles are published, without barriers to access, immediately upon acceptance. The journal places a strong emphasis on functional and mechanistic understanding of how molecular components in a biological process work together through the application of computational methods. Structural data may provide such insights, but they are not a pre-requisite for publication in the journal. Specific areas of interest include, but are not limited to:
Structure and function of proteins, nucleic acids and other macromolecules
Structure and function of multi-component complexes
Protein folding, processing and degradation
Enzymology
Computational and structural studies of plant systems
Microbial Informatics
Genomics
Proteomics
Metabolomics
Algorithms and Hypothesis in Bioinformatics
Mathematical and Theoretical Biology
Computational Chemistry and Drug Discovery
Microscopy and Molecular Imaging
Nanotechnology
Systems and Synthetic Biology