{"title":"(p,q)-biclique counting and enumeration for large sparse bipartite graphs.","authors":"Jianye Yang, Yun Peng, Dian Ouyang, Wenjie Zhang, Xuemin Lin, Xiang Zhao","doi":"10.1007/s00778-023-00786-0","DOIUrl":null,"url":null,"abstract":"<p><p>In this paper, we study the problem of (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-biclique counting and enumeration for large sparse bipartite graphs. Given a bipartite graph <math><mrow><mi>G</mi><mo>=</mo><mo>(</mo><mi>U</mi><mo>,</mo><mi>V</mi><mo>,</mo><mi>E</mi><mo>)</mo></mrow></math> and two integer parameters <i>p</i> and <i>q</i>, we aim to efficiently count and enumerate all (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-bicliques in <i>G</i>, where a (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-biclique <i>B</i>(<i>L</i>, <i>R</i>) is a complete subgraph of <i>G</i> with <math><mrow><mi>L</mi><mo>⊆</mo><mi>U</mi></mrow></math>, <math><mrow><mi>R</mi><mo>⊆</mo><mi>V</mi></mrow></math>, <math><mrow><mo>|</mo><mi>L</mi><mo>|</mo><mo>=</mo><mi>p</mi></mrow></math>, and <math><mrow><mo>|</mo><mi>R</mi><mo>|</mo><mo>=</mo><mi>q</mi></mrow></math>. The problem of (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-biclique counting and enumeration has many applications, such as graph neural network information aggregation, densest subgraph detection, and cohesive subgroup analysis. Despite the wide range of applications, to the best of our knowledge, we note that there is no efficient and scalable solution to this problem in the literature . This problem is computationally challenging, due to the worst-case exponential number of (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-bicliques. In this paper, we propose a competitive branch-and-bound baseline method, namely BCList, which explores the search space in a depth-first manner, together with a variety of pruning techniques. Although BCList offers a useful computation framework to our problem, its worst-case time complexity is exponential to <math><mrow><mi>p</mi><mo>+</mo><mi>q</mi></mrow></math>. To alleviate this, we propose an advanced approach, called BCList++. Particularly, BCList++ applies a layer-based exploring strategy to enumerate (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-bicliques by anchoring the search on either <i>U</i> or <i>V</i> only, which has a worst-case time complexity exponential to either <i>p</i> or <i>q</i> only. Consequently, a vital task is to choose a layer with the least computation cost. To this end, we develop a cost model, which is built upon an unbiased estimator for the density of 2-hop graph induced by <i>U</i> or <i>V</i>. To improve computation efficiency, BCList++ exploits pre-allocated arrays and vertex labeling techniques such that the frequent subgraph creating operations can be substituted by array element switching operations. We conduct extensive experiments on 16 real-life datasets, and the experimental results demonstrate that BCList++ significantly outperforms the baseline methods by up to 3 orders of magnitude. We show via a case study that (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-bicliques optimizes the efficiency of graph neural networks. In this paper, we extend our techniques to count and enumerate (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-bicliques on uncertain bipartite graphs. An efficient method IUBCList is developed on the top of BCList++, together with a couple of pruning techniques, including common neighbor refinement and search branch early termination, to discard unpromising uncertain (<math><mi>p</mi></math>, <math><mi>q</mi></math>)-bicliques early. The experimental results demonstrate that IUBCList significantly outperforms the baseline method by up to 2 orders of magnitude.</p>","PeriodicalId":49373,"journal":{"name":"Vldb Journal","volume":" ","pages":"1-25"},"PeriodicalIF":2.8000,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10008723/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Vldb Journal","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s00778-023-00786-0","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0
Abstract
In this paper, we study the problem of (, )-biclique counting and enumeration for large sparse bipartite graphs. Given a bipartite graph and two integer parameters p and q, we aim to efficiently count and enumerate all (, )-bicliques in G, where a (, )-biclique B(L, R) is a complete subgraph of G with , , , and . The problem of (, )-biclique counting and enumeration has many applications, such as graph neural network information aggregation, densest subgraph detection, and cohesive subgroup analysis. Despite the wide range of applications, to the best of our knowledge, we note that there is no efficient and scalable solution to this problem in the literature . This problem is computationally challenging, due to the worst-case exponential number of (, )-bicliques. In this paper, we propose a competitive branch-and-bound baseline method, namely BCList, which explores the search space in a depth-first manner, together with a variety of pruning techniques. Although BCList offers a useful computation framework to our problem, its worst-case time complexity is exponential to . To alleviate this, we propose an advanced approach, called BCList++. Particularly, BCList++ applies a layer-based exploring strategy to enumerate (, )-bicliques by anchoring the search on either U or V only, which has a worst-case time complexity exponential to either p or q only. Consequently, a vital task is to choose a layer with the least computation cost. To this end, we develop a cost model, which is built upon an unbiased estimator for the density of 2-hop graph induced by U or V. To improve computation efficiency, BCList++ exploits pre-allocated arrays and vertex labeling techniques such that the frequent subgraph creating operations can be substituted by array element switching operations. We conduct extensive experiments on 16 real-life datasets, and the experimental results demonstrate that BCList++ significantly outperforms the baseline methods by up to 3 orders of magnitude. We show via a case study that (, )-bicliques optimizes the efficiency of graph neural networks. In this paper, we extend our techniques to count and enumerate (, )-bicliques on uncertain bipartite graphs. An efficient method IUBCList is developed on the top of BCList++, together with a couple of pruning techniques, including common neighbor refinement and search branch early termination, to discard unpromising uncertain (, )-bicliques early. The experimental results demonstrate that IUBCList significantly outperforms the baseline method by up to 2 orders of magnitude.
期刊介绍:
The journal is dedicated to the publication of scholarly contributions in areas of data management such as database system technology and information systems, including their architectures and applications. Further, the journal’s scope is restricted to areas of data management that are covered by the combined expertise of the journal’s editorial board.
Submissions with a substantial theory component are welcome, but the VLDB Journal expects such submissions also to embody a systems component.
In relation to data mining, the journal will handle submissions where systems issues play a significant role. Factors that we use to determine whether a data mining paper is within scope include:
The submission targets systems issues in relation to data mining, e.g., by covering integration with a database engine or with other data management functionality.
The submission’s contributions build on (rather than simply cite) work already published in database outlets, e.g., VLDBJ, ACM TODS, PVLDB, ACM SIGMOD, IEEE ICDE, EDBT.
The journal''s editorial board has the necessary expertise on the submission''s topic.
Traditional, stand-alone data mining papers that lack the above or similar characteristics are out of scope for this journal. Criteria similar to the above are applied to submission from other areas, e.g., information retrieval and geographical information systems.