Priscila Silva;Gaspard Baye;Mindy Hotchkiss;Gokhan Kul;Nathaniel D. Bastian;Lance Fiondella
{"title":"回归和时间序列混合方法预测系统性能和评估弹性","authors":"Priscila Silva;Gaspard Baye;Mindy Hotchkiss;Gokhan Kul;Nathaniel D. Bastian;Lance Fiondella","doi":"10.1109/TR.2024.3471409","DOIUrl":null,"url":null,"abstract":"Resilience engineering is the ability to design, build, and sustain systems that can deal effectively with disruptive events. Previous research focused on resilience models that were not designed to predict multiple disruptions and recoveries, and resilience metrics, which are typically calculated after disruptions. Therefore, this article introduces a new approach combining regression and time series methods to track and predict system performance under multiple shocks, offering a framework for planning resilience tests and guiding data collection applicable to various systems and processes. To illustrate, subsets ranging from 50% to 80% of a historical job loss dataset from the 1980 U.S. recession were used for model fitting to assess generalization and stability. Goodness-of-fit measures, confidence intervals, and resilience metrics validated this approach against established statistical methods and a neural network model. The results indicate that traditional statistical models fail to capture minor changes when fitted with small datasets, and neural networks are overly sensitive to the size of the training data. In contrast, the novel mixture approach considering immediate and delayed disruptions exhibits superior long-term predictive performance and greater accuracy in forecasting resilience metrics, even when only 50% of the data is used for model fitting.","PeriodicalId":56305,"journal":{"name":"IEEE Transactions on Reliability","volume":"74 3","pages":"3002-3016"},"PeriodicalIF":5.7000,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Regression and Time Series Mixture Approaches to Predict System Performance and Assess Resilience\",\"authors\":\"Priscila Silva;Gaspard Baye;Mindy Hotchkiss;Gokhan Kul;Nathaniel D. Bastian;Lance Fiondella\",\"doi\":\"10.1109/TR.2024.3471409\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Resilience engineering is the ability to design, build, and sustain systems that can deal effectively with disruptive events. Previous research focused on resilience models that were not designed to predict multiple disruptions and recoveries, and resilience metrics, which are typically calculated after disruptions. Therefore, this article introduces a new approach combining regression and time series methods to track and predict system performance under multiple shocks, offering a framework for planning resilience tests and guiding data collection applicable to various systems and processes. To illustrate, subsets ranging from 50% to 80% of a historical job loss dataset from the 1980 U.S. recession were used for model fitting to assess generalization and stability. Goodness-of-fit measures, confidence intervals, and resilience metrics validated this approach against established statistical methods and a neural network model. The results indicate that traditional statistical models fail to capture minor changes when fitted with small datasets, and neural networks are overly sensitive to the size of the training data. In contrast, the novel mixture approach considering immediate and delayed disruptions exhibits superior long-term predictive performance and greater accuracy in forecasting resilience metrics, even when only 50% of the data is used for model fitting.\",\"PeriodicalId\":56305,\"journal\":{\"name\":\"IEEE Transactions on Reliability\",\"volume\":\"74 3\",\"pages\":\"3002-3016\"},\"PeriodicalIF\":5.7000,\"publicationDate\":\"2024-10-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Reliability\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10726627/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Reliability","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10726627/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
Regression and Time Series Mixture Approaches to Predict System Performance and Assess Resilience
Resilience engineering is the ability to design, build, and sustain systems that can deal effectively with disruptive events. Previous research focused on resilience models that were not designed to predict multiple disruptions and recoveries, and resilience metrics, which are typically calculated after disruptions. Therefore, this article introduces a new approach combining regression and time series methods to track and predict system performance under multiple shocks, offering a framework for planning resilience tests and guiding data collection applicable to various systems and processes. To illustrate, subsets ranging from 50% to 80% of a historical job loss dataset from the 1980 U.S. recession were used for model fitting to assess generalization and stability. Goodness-of-fit measures, confidence intervals, and resilience metrics validated this approach against established statistical methods and a neural network model. The results indicate that traditional statistical models fail to capture minor changes when fitted with small datasets, and neural networks are overly sensitive to the size of the training data. In contrast, the novel mixture approach considering immediate and delayed disruptions exhibits superior long-term predictive performance and greater accuracy in forecasting resilience metrics, even when only 50% of the data is used for model fitting.
期刊介绍:
IEEE Transactions on Reliability is a refereed journal for the reliability and allied disciplines including, but not limited to, maintainability, physics of failure, life testing, prognostics, design and manufacture for reliability, reliability for systems of systems, network availability, mission success, warranty, safety, and various measures of effectiveness. Topics eligible for publication range from hardware to software, from materials to systems, from consumer and industrial devices to manufacturing plants, from individual items to networks, from techniques for making things better to ways of predicting and measuring behavior in the field. As an engineering subject that supports new and existing technologies, we constantly expand into new areas of the assurance sciences.