Qingqing Yi, Lunwen Wu, Jingjing Tang, Yujian Zeng, Zengchun Song
{"title":"Hybrid contrastive multi-scenario learning for multi-task sequential-dependence recommendation.","authors":"Qingqing Yi, Lunwen Wu, Jingjing Tang, Yujian Zeng, Zengchun Song","doi":"10.1016/j.neunet.2024.106953","DOIUrl":null,"url":null,"abstract":"<p><p>Multi-scenario and multi-task learning are crucial in industrial recommendation systems to deliver high-quality recommendations across diverse scenarios with minimal computational overhead. However, conventional models often fail to effectively leverage cross-scenario information, limiting their representational capabilities. Additionally, multi-step conversion tasks in real-world applications face challenges from sequential dependencies and increased data sparsity, particularly in later stages. To address these issues, we propose a Hybrid Contrastive Multi-scenario learning framework for Multi-task Sequential-dependence Recommendation (HCM<sup>2</sup>SR). In the scenario layer, hybrid contrastive learning captures both shared and scenario-specific information, while a scenario-aware multi-gate network enhances representations by evaluating cross-scenario relevance. In the task layer, an adaptive multi-task network transfers knowledge across sequential stages, mitigating data sparsity in long-path conversions. Extensive experiments on two public datasets and one industrial dataset validate the effectiveness of HCM<sup>2</sup>SR, with ablation studies confirming the contribution of each component.</p>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"183 ","pages":"106953"},"PeriodicalIF":6.0000,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1016/j.neunet.2024.106953","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Multi-scenario and multi-task learning are crucial in industrial recommendation systems to deliver high-quality recommendations across diverse scenarios with minimal computational overhead. However, conventional models often fail to effectively leverage cross-scenario information, limiting their representational capabilities. Additionally, multi-step conversion tasks in real-world applications face challenges from sequential dependencies and increased data sparsity, particularly in later stages. To address these issues, we propose a Hybrid Contrastive Multi-scenario learning framework for Multi-task Sequential-dependence Recommendation (HCM2SR). In the scenario layer, hybrid contrastive learning captures both shared and scenario-specific information, while a scenario-aware multi-gate network enhances representations by evaluating cross-scenario relevance. In the task layer, an adaptive multi-task network transfers knowledge across sequential stages, mitigating data sparsity in long-path conversions. Extensive experiments on two public datasets and one industrial dataset validate the effectiveness of HCM2SR, with ablation studies confirming the contribution of each component.
期刊介绍:
Neural Networks is a platform that aims to foster an international community of scholars and practitioners interested in neural networks, deep learning, and other approaches to artificial intelligence and machine learning. Our journal invites submissions covering various aspects of neural networks research, from computational neuroscience and cognitive modeling to mathematical analyses and engineering applications. By providing a forum for interdisciplinary discussions between biology and technology, we aim to encourage the development of biologically-inspired artificial intelligence.