通过随机微分方程建立基于复杂分数的组合扩散模型

Adrien Carrel
{"title":"通过随机微分方程建立基于复杂分数的组合扩散模型","authors":"Adrien Carrel","doi":"arxiv-2406.04916","DOIUrl":null,"url":null,"abstract":"Graph structures offer a versatile framework for representing diverse\npatterns in nature and complex systems, applicable across domains like\nmolecular chemistry, social networks, and transportation systems. While\ndiffusion models have excelled in generating various objects, generating graphs\nremains challenging. This thesis explores the potential of score-based\ngenerative models in generating such objects through a modelization as\ncombinatorial complexes, which are powerful topological structures that\nencompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic\ndifferential equations. We not only generalize the generation of complex\nobjects such as graphs and hypergraphs, but we also unify existing generative\nmodelling approaches such as Score Matching with Langevin dynamics and\nDenoising Diffusion Probabilistic Models. This innovation overcomes limitations\nin existing frameworks that focus solely on graph generation, opening up new\npossibilities in generative AI. The experiment results showed that our framework could generate these complex\nobjects, and could also compete against state-of-the-art approaches for mere\ngraph and molecule generation tasks.","PeriodicalId":501119,"journal":{"name":"arXiv - MATH - Algebraic Topology","volume":"8 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations\",\"authors\":\"Adrien Carrel\",\"doi\":\"arxiv-2406.04916\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Graph structures offer a versatile framework for representing diverse\\npatterns in nature and complex systems, applicable across domains like\\nmolecular chemistry, social networks, and transportation systems. While\\ndiffusion models have excelled in generating various objects, generating graphs\\nremains challenging. This thesis explores the potential of score-based\\ngenerative models in generating such objects through a modelization as\\ncombinatorial complexes, which are powerful topological structures that\\nencompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic\\ndifferential equations. We not only generalize the generation of complex\\nobjects such as graphs and hypergraphs, but we also unify existing generative\\nmodelling approaches such as Score Matching with Langevin dynamics and\\nDenoising Diffusion Probabilistic Models. This innovation overcomes limitations\\nin existing frameworks that focus solely on graph generation, opening up new\\npossibilities in generative AI. The experiment results showed that our framework could generate these complex\\nobjects, and could also compete against state-of-the-art approaches for mere\\ngraph and molecule generation tasks.\",\"PeriodicalId\":501119,\"journal\":{\"name\":\"arXiv - MATH - Algebraic Topology\",\"volume\":\"8 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - MATH - Algebraic Topology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2406.04916\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - MATH - Algebraic Topology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2406.04916","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

图结构为表示自然界和复杂系统中的各种模式提供了一个通用框架,适用于分子化学、社交网络和运输系统等领域。虽然扩散模型在生成各种对象方面表现出色,但生成图仍然具有挑战性。本论文通过对组合复合物的建模,探索基于分数的生成模型在生成此类对象方面的潜力,组合复合物是包含高阶关系的强大拓扑结构。在本论文中,我们采用随机微分方程提出了一个统一的框架。我们不仅推广了图和超图等复杂对象的生成,而且还统一了现有的生成建模方法,如分数匹配与朗格文动力学和失真扩散概率模型。这一创新克服了现有框架只关注图生成的局限性,为生成式人工智能开辟了新的可能性。实验结果表明,我们的框架可以生成这些复杂的对象,还可以在图和分子生成任务方面与最先进的方法竞争。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations
Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have excelled in generating various objects, generating graphs remains challenging. This thesis explores the potential of score-based generative models in generating such objects through a modelization as combinatorial complexes, which are powerful topological structures that encompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic differential equations. We not only generalize the generation of complex objects such as graphs and hypergraphs, but we also unify existing generative modelling approaches such as Score Matching with Langevin dynamics and Denoising Diffusion Probabilistic Models. This innovation overcomes limitations in existing frameworks that focus solely on graph generation, opening up new possibilities in generative AI. The experiment results showed that our framework could generate these complex objects, and could also compete against state-of-the-art approaches for mere graph and molecule generation tasks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信