Troyle Thomas, Armando Fandango, D. Reed, C. Hoayun, J. Hurter, Alexander Gutierrez, K. Brawner
{"title":"Comparing Physics Effects through Reinforcement Learning in the ARORA Simulator","authors":"Troyle Thomas, Armando Fandango, D. Reed, C. Hoayun, J. Hurter, Alexander Gutierrez, K. Brawner","doi":"10.46354/i3m.2021.emss.015","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.015","url":null,"abstract":"By testing various physics levels for training autonomous-vehicle navigation using a deep deterministic policy gradient algorithm, the present study fills a lack of research on the impact of physics levels for vehicle behaviour, specifically for reinforcement-learning algorithms. Measures from a PointGoal Navigation task were investigated: simulator run-time, training steps, and agent effectiveness through the Success weighted by (normalised inverse) Path Length (SPL) measure. Training and testing occurred in the novel simulator ARORA, or A Realistic Open environment for Rapid Agent training. The goal of ARORA is to provide a high-fidelity, open-source platform for simulation, using physics-based movement, vehicle modelling, and a continuous action space within a large-scale geospecific city environment. Using four physics levels, or models, to create four different curriculum conditions for training, the SPL was highest for the condition using all physics levels defined for the experiment, with two conditions returning zero values. Future researchers should consider providing adequate support when training complex-physics vehicle models. The run-time results revealed a benefit for experimental machines with a better CPU, at least for the vector-only observations we employed.","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122436149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-Resolution Localization of Individual Logs in Wooden Piles Utilizing YOLO with Tiling on Client/Server Architectures","authors":"Christoph Praschl","doi":"10.46354/i3m.2021.emss.042","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.042","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131978155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discrete-Event Simulation For Risk Management In The Overlap Of Two Offshore Wind Manufacturing Projects","authors":"A. Lamas-Rodríguez","doi":"10.46354/i3m.2021.emss.051","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.051","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133912348","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"\"Computer Simulation for Calculation of Expected Train Position at GNSS Signal Failure within a Railway Network Model\"","authors":"J. Fikejz","doi":"10.46354/i3m.2021.emss.031","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.031","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130889702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Flexible Simulation for Manufacturing & Supply Chain Management","authors":"A. Bruzzone","doi":"10.46354/i3m.2021.emss.058","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.058","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126948513","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Digital Twin of Intensive Aquabiotechnological Production Based on a Closed Ecosystem Modeling & Simulation","authors":"M. Zhabitskii, Yuri Andrienko","doi":"10.46354/i3m.2021.emss.034","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.034","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"186 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126074057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Role of Lean manufacturing tools on economic sustainability in the Mexican manufacturing industry","authors":"Jose Roberto Diaz Reza","doi":"10.46354/i3m.2021.emss.050","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.050","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114602199","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A predictive model for an effective maintenance of hospital critical systems","authors":"Marah Al-Tal, R. Al-Aomar, J. Abel","doi":"10.46354/i3m.2021.emss.001","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.001","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117139670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigation of platforms at railway station switch area with regard to capacity using computer simulation","authors":"M. Bažant","doi":"10.46354/i3m.2021.emss.026","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.026","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"589 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123917248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Bruzzone, M. Massei, K. Sinelshchikov, F. Tarone
{"title":"Improving Safety in Ports & Harbor Facilities by MS2G","authors":"A. Bruzzone, M. Massei, K. Sinelshchikov, F. Tarone","doi":"10.46354/i3m.2021.emss.055","DOIUrl":"https://doi.org/10.46354/i3m.2021.emss.055","url":null,"abstract":"","PeriodicalId":322169,"journal":{"name":"Proceedings of the 33rd European Modeling & Simulation Symposium","volume":"58 23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124911792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}