{"title":"通过随机微分方程建立基于复杂分数的组合扩散模型","authors":"Adrien Carrel","doi":"arxiv-2406.04916","DOIUrl":null,"url":null,"abstract":"Graph structures offer a versatile framework for representing diverse\npatterns in nature and complex systems, applicable across domains like\nmolecular chemistry, social networks, and transportation systems. While\ndiffusion models have excelled in generating various objects, generating graphs\nremains challenging. This thesis explores the potential of score-based\ngenerative models in generating such objects through a modelization as\ncombinatorial complexes, which are powerful topological structures that\nencompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic\ndifferential equations. We not only generalize the generation of complex\nobjects such as graphs and hypergraphs, but we also unify existing generative\nmodelling approaches such as Score Matching with Langevin dynamics and\nDenoising Diffusion Probabilistic Models. This innovation overcomes limitations\nin existing frameworks that focus solely on graph generation, opening up new\npossibilities in generative AI. The experiment results showed that our framework could generate these complex\nobjects, and could also compete against state-of-the-art approaches for mere\ngraph and molecule generation tasks.","PeriodicalId":501119,"journal":{"name":"arXiv - MATH - Algebraic Topology","volume":"8 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations\",\"authors\":\"Adrien Carrel\",\"doi\":\"arxiv-2406.04916\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Graph structures offer a versatile framework for representing diverse\\npatterns in nature and complex systems, applicable across domains like\\nmolecular chemistry, social networks, and transportation systems. While\\ndiffusion models have excelled in generating various objects, generating graphs\\nremains challenging. This thesis explores the potential of score-based\\ngenerative models in generating such objects through a modelization as\\ncombinatorial complexes, which are powerful topological structures that\\nencompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic\\ndifferential equations. We not only generalize the generation of complex\\nobjects such as graphs and hypergraphs, but we also unify existing generative\\nmodelling approaches such as Score Matching with Langevin dynamics and\\nDenoising Diffusion Probabilistic Models. This innovation overcomes limitations\\nin existing frameworks that focus solely on graph generation, opening up new\\npossibilities in generative AI. The experiment results showed that our framework could generate these complex\\nobjects, and could also compete against state-of-the-art approaches for mere\\ngraph and molecule generation tasks.\",\"PeriodicalId\":501119,\"journal\":{\"name\":\"arXiv - MATH - Algebraic Topology\",\"volume\":\"8 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - MATH - Algebraic Topology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2406.04916\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - MATH - Algebraic Topology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2406.04916","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations
Graph structures offer a versatile framework for representing diverse
patterns in nature and complex systems, applicable across domains like
molecular chemistry, social networks, and transportation systems. While
diffusion models have excelled in generating various objects, generating graphs
remains challenging. This thesis explores the potential of score-based
generative models in generating such objects through a modelization as
combinatorial complexes, which are powerful topological structures that
encompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic
differential equations. We not only generalize the generation of complex
objects such as graphs and hypergraphs, but we also unify existing generative
modelling approaches such as Score Matching with Langevin dynamics and
Denoising Diffusion Probabilistic Models. This innovation overcomes limitations
in existing frameworks that focus solely on graph generation, opening up new
possibilities in generative AI. The experiment results showed that our framework could generate these complex
objects, and could also compete against state-of-the-art approaches for mere
graph and molecule generation tasks.