{"title":"通过感知预训练提高代理在流体环境中的性能","authors":"Jin Zhang, Jianyang Xue, Bochao Cao","doi":"arxiv-2409.03230","DOIUrl":null,"url":null,"abstract":"In this paper, we construct a pretraining framework for fluid environment\nperception, which includes an information compression model and the\ncorresponding pretraining method. We test this framework in a two-cylinder\nproblem through numerical simulation. The results show that after unsupervised\npretraining with this framework, the intelligent agent can acquire key features\nof surrounding fluid environment, thereby adapting more quickly and effectively\nto subsequent multi-scenario tasks. In our research, these tasks include\nperceiving the position of the upstream obstacle and actively avoiding shedding\nvortices in the flow field to achieve drag reduction. Better performance of the\npretrained agent is discussed in the sensitivity analysis.","PeriodicalId":501125,"journal":{"name":"arXiv - PHYS - Fluid Dynamics","volume":"1 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improving agent performance in fluid environments by perceptual pretraining\",\"authors\":\"Jin Zhang, Jianyang Xue, Bochao Cao\",\"doi\":\"arxiv-2409.03230\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we construct a pretraining framework for fluid environment\\nperception, which includes an information compression model and the\\ncorresponding pretraining method. We test this framework in a two-cylinder\\nproblem through numerical simulation. The results show that after unsupervised\\npretraining with this framework, the intelligent agent can acquire key features\\nof surrounding fluid environment, thereby adapting more quickly and effectively\\nto subsequent multi-scenario tasks. In our research, these tasks include\\nperceiving the position of the upstream obstacle and actively avoiding shedding\\nvortices in the flow field to achieve drag reduction. Better performance of the\\npretrained agent is discussed in the sensitivity analysis.\",\"PeriodicalId\":501125,\"journal\":{\"name\":\"arXiv - PHYS - Fluid Dynamics\",\"volume\":\"1 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - PHYS - Fluid Dynamics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.03230\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - PHYS - Fluid Dynamics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.03230","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Improving agent performance in fluid environments by perceptual pretraining
In this paper, we construct a pretraining framework for fluid environment
perception, which includes an information compression model and the
corresponding pretraining method. We test this framework in a two-cylinder
problem through numerical simulation. The results show that after unsupervised
pretraining with this framework, the intelligent agent can acquire key features
of surrounding fluid environment, thereby adapting more quickly and effectively
to subsequent multi-scenario tasks. In our research, these tasks include
perceiving the position of the upstream obstacle and actively avoiding shedding
vortices in the flow field to achieve drag reduction. Better performance of the
pretrained agent is discussed in the sensitivity analysis.