Mingyu Deng;Chao Chen;Wanyi Zhang;Jie Zhao;Wei Yang;Suiming Guo;Huayan Pu;Jun Luo
{"title":"HyperRegion: Integrating Graph and Hypergraph Contrastive Learning for Region Embeddings","authors":"Mingyu Deng;Chao Chen;Wanyi Zhang;Jie Zhao;Wei Yang;Suiming Guo;Huayan Pu;Jun Luo","doi":"10.1109/TMC.2024.3515154","DOIUrl":null,"url":null,"abstract":"Region representations (also called embeddings) are useful for various urban computing tasks. While graph-based region representation learning methods have shown outstanding performance, they encounter two major challenges: 1) the pervasive data noise and missing data can affect the quality of the constructed region graphs; and 2) high-order relationships (i.e., group-wise relationships) among regions are often insufficiently modeled and sometimes entirely overlooked. To this end, we propose <i>HyperRegion</i>, an unsupervised region representation learning framework that integrates graph and hypergraph contrastive learning to learn comprehensive region embeddings from multi-modal data. Built upon a region hybrid graph network, this framework models both pair-wise and group-wise dependencies involving POI semantics, mobility patterns, geographic neighbors, and visual semantics. To mitigate the impact of data noise and missing data, graph and hypergraph contrastive learning are performed in parallel, and a cross-module contrast is further introduced to facilitate information exchange and collaboration. Extensive experiments on real-world datasets across three downstream tasks demonstrate that <i>HyperRegion</i> outperforms all baselines, particularly improving check-in prediction by reducing MAE and RMSE by approximately 8.5% and 8.2%, respectively, and increasing <inline-formula><tex-math>$R^{2}$</tex-math></inline-formula> by about 7%.","PeriodicalId":50389,"journal":{"name":"IEEE Transactions on Mobile Computing","volume":"24 5","pages":"3667-3684"},"PeriodicalIF":7.7000,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Mobile Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10791310/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Region representations (also called embeddings) are useful for various urban computing tasks. While graph-based region representation learning methods have shown outstanding performance, they encounter two major challenges: 1) the pervasive data noise and missing data can affect the quality of the constructed region graphs; and 2) high-order relationships (i.e., group-wise relationships) among regions are often insufficiently modeled and sometimes entirely overlooked. To this end, we propose HyperRegion, an unsupervised region representation learning framework that integrates graph and hypergraph contrastive learning to learn comprehensive region embeddings from multi-modal data. Built upon a region hybrid graph network, this framework models both pair-wise and group-wise dependencies involving POI semantics, mobility patterns, geographic neighbors, and visual semantics. To mitigate the impact of data noise and missing data, graph and hypergraph contrastive learning are performed in parallel, and a cross-module contrast is further introduced to facilitate information exchange and collaboration. Extensive experiments on real-world datasets across three downstream tasks demonstrate that HyperRegion outperforms all baselines, particularly improving check-in prediction by reducing MAE and RMSE by approximately 8.5% and 8.2%, respectively, and increasing $R^{2}$ by about 7%.
期刊介绍:
IEEE Transactions on Mobile Computing addresses key technical issues related to various aspects of mobile computing. This includes (a) architectures, (b) support services, (c) algorithm/protocol design and analysis, (d) mobile environments, (e) mobile communication systems, (f) applications, and (g) emerging technologies. Topics of interest span a wide range, covering aspects like mobile networks and hosts, mobility management, multimedia, operating system support, power management, online and mobile environments, security, scalability, reliability, and emerging technologies such as wearable computers, body area networks, and wireless sensor networks. The journal serves as a comprehensive platform for advancements in mobile computing research.