{"title":"基于分离嵌入交互网络的推荐模型","authors":"Shulei FENG, Zhongyun JIANG","doi":"10.3724/sp.j.1249.2023.04513","DOIUrl":null,"url":null,"abstract":"Aiming at the problems that the existing feature interaction methods in deep learning recommendation models cannot fully utilize the embedding vector information and thus have the insufficient accuracy, we propose a deep learning recommendation model based on separated embedding interaction networks (SEIN). This model first uses the embedding neural network layer to convert the sparse feature vectors into dense embedding vectors, then separates the feature matrices of different dimensions for feature interaction, and explicitly controls the order of feature interaction through the number of SEIN layers. Finally, the obtained hidden layer matrices are pooled by summation, and the final output is obtained through the prediction layer. In public datasets of Criteo, AutoML and Movielens, click-through rate prediction and top-k recommendation experiments are carried out by using the area under the curve (AUC), log-loss, accuracy and recall rate as evaluation indicators. The experimental results demonstrate that compared with the baseline models for click-through rate prediction, namely DeepFM, Deep&Cross Received: 202211-25; Accepted: 2023-04-02; Online (CNKI): 2023-06-05 Foundation: Construction Project of Applied Undergraduate Pilot Program in Shanghai Universities (Z32004-17-84); Special Project of Shanghai Municipal Education Commission for the Construction of First-Class Undergraduate Majors (JYLB202002) Corresponding author: Associate professor JIANG Zhongyun. E-mail: jianqiao_jzy@163.com Citation: FENG Shulei, JIANG Zhongyun. Recommendation model based on separated embedding interaction networks [J]. Journal of Shenzhen University Science and Engineering, 2023, 40(4): 513-520. (in Chinese)","PeriodicalId":35396,"journal":{"name":"Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Recommendation model based on separated embedding interaction networks\",\"authors\":\"Shulei FENG, Zhongyun JIANG\",\"doi\":\"10.3724/sp.j.1249.2023.04513\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at the problems that the existing feature interaction methods in deep learning recommendation models cannot fully utilize the embedding vector information and thus have the insufficient accuracy, we propose a deep learning recommendation model based on separated embedding interaction networks (SEIN). This model first uses the embedding neural network layer to convert the sparse feature vectors into dense embedding vectors, then separates the feature matrices of different dimensions for feature interaction, and explicitly controls the order of feature interaction through the number of SEIN layers. Finally, the obtained hidden layer matrices are pooled by summation, and the final output is obtained through the prediction layer. In public datasets of Criteo, AutoML and Movielens, click-through rate prediction and top-k recommendation experiments are carried out by using the area under the curve (AUC), log-loss, accuracy and recall rate as evaluation indicators. The experimental results demonstrate that compared with the baseline models for click-through rate prediction, namely DeepFM, Deep&Cross Received: 202211-25; Accepted: 2023-04-02; Online (CNKI): 2023-06-05 Foundation: Construction Project of Applied Undergraduate Pilot Program in Shanghai Universities (Z32004-17-84); Special Project of Shanghai Municipal Education Commission for the Construction of First-Class Undergraduate Majors (JYLB202002) Corresponding author: Associate professor JIANG Zhongyun. E-mail: jianqiao_jzy@163.com Citation: FENG Shulei, JIANG Zhongyun. Recommendation model based on separated embedding interaction networks [J]. Journal of Shenzhen University Science and Engineering, 2023, 40(4): 513-520. (in Chinese)\",\"PeriodicalId\":35396,\"journal\":{\"name\":\"Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3724/sp.j.1249.2023.04513\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Engineering\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3724/sp.j.1249.2023.04513","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Engineering","Score":null,"Total":0}
Recommendation model based on separated embedding interaction networks
Aiming at the problems that the existing feature interaction methods in deep learning recommendation models cannot fully utilize the embedding vector information and thus have the insufficient accuracy, we propose a deep learning recommendation model based on separated embedding interaction networks (SEIN). This model first uses the embedding neural network layer to convert the sparse feature vectors into dense embedding vectors, then separates the feature matrices of different dimensions for feature interaction, and explicitly controls the order of feature interaction through the number of SEIN layers. Finally, the obtained hidden layer matrices are pooled by summation, and the final output is obtained through the prediction layer. In public datasets of Criteo, AutoML and Movielens, click-through rate prediction and top-k recommendation experiments are carried out by using the area under the curve (AUC), log-loss, accuracy and recall rate as evaluation indicators. The experimental results demonstrate that compared with the baseline models for click-through rate prediction, namely DeepFM, Deep&Cross Received: 202211-25; Accepted: 2023-04-02; Online (CNKI): 2023-06-05 Foundation: Construction Project of Applied Undergraduate Pilot Program in Shanghai Universities (Z32004-17-84); Special Project of Shanghai Municipal Education Commission for the Construction of First-Class Undergraduate Majors (JYLB202002) Corresponding author: Associate professor JIANG Zhongyun. E-mail: jianqiao_jzy@163.com Citation: FENG Shulei, JIANG Zhongyun. Recommendation model based on separated embedding interaction networks [J]. Journal of Shenzhen University Science and Engineering, 2023, 40(4): 513-520. (in Chinese)