Lukas Beierlieb, Lukas Iffländer, Aleksandar Milenkoski, Charles F. Gonçalves, Nuno Antunes, Samuel Kounev
{"title":"Towards Testing the Software Aging Behavior of Hypervisor Hypercall Interfaces","authors":"Lukas Beierlieb, Lukas Iffländer, Aleksandar Milenkoski, Charles F. Gonçalves, Nuno Antunes, Samuel Kounev","doi":"10.1109/ISSREW.2019.00075","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00075","url":null,"abstract":"With the continuing rise of cloud technology hypervisors play a vital role in the performance and reliability of current services. As long-running applications, they are susceptible to software aging. Hypervisors offer so-called hypercall interfaces for communication with the hosted virtual machines. These interfaces require thorough robustness to assure performance, security, and reliability. Existing research either deals with the aging properties of hypervisors in general without considering the hypercalls or focusses on finding hypercall related vulnerabilities. In this work, we discuss open challenges regarding hypercall interfaces. To address these challenges, we propose an extensive framework architecture to perform robustness testing on hypercall interfaces. This framework supports extensive test campaigns as well as the modeling of hypercall interfaces.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129785377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Analysis of Software Aging Impacts on Plant Anomaly Detection with Edge Computing","authors":"E. Andrade, F. Machida","doi":"10.1109/ISSREW.2019.00073","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00073","url":null,"abstract":"Edge computing allows data-intensive analytic processes running on a cloud server to migrate to a local computing environment near the data sources, and as a result the architecture can benefit from a significant bandwidth reduction as well as improved security. However, due to the scarcity of resources on an edge device, a problem of software aging is likely to occur after longtime execution. The consequence of software aging should be significant, whereas such a risk has not been studied in the previous literature. In this paper, we propose a deterministic and stochastic Petri Net (DSPN) to quantitatively analyze the impacts of software aging phenomenon on a cyber-physical system using edge computing. As a data analytic application using real-world sensor data, we consider anomaly detection for a water treatment plant. We introduce two application-oriented performance measures, namely detection loss probability and the expected number of false alarms in terms of plant anomaly detection. Our numerical and simulation experiments on the proposed DSPN show that software aging clearly has negative impacts on the defined performance measures that reveal the necessity of greater attention to software aging issues in edge computing systems.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129928157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. A. Johnson, J. Ferreira, A. Mendes, Julien Cordry
{"title":"Lost in Disclosure: On the Inference of Password Composition Policies","authors":"S. A. Johnson, J. Ferreira, A. Mendes, Julien Cordry","doi":"10.1109/ISSREW.2019.00082","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00082","url":null,"abstract":"Large-scale password data breaches are becoming increasingly commonplace, which has enabled researchers to produce a substantial body of password security research utilising real-world password datasets, which often contain numbers of records in the tens or even hundreds of millions. While much study has been conducted on how password composition policies—sets of rules that a user must abide by when creating a password—influence the distribution of user-chosen passwords on a system, much less research has been done on inferring the password composition policy that a given set of user-chosen passwords was created under. In this paper, we state the problem with the naive approach to this challenge, and suggest a simple approach that produces more reliable results. We also present pol-infer, a tool that implements this approach, and demonstrates its use in inferring password composition policies.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127670416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Vara, Eugenio Parra, Luis Alonso, Roy Mendieta, Borja López, J. A. Rodríguez
{"title":"Integration of Tool Support for Assurance and Certification and for Knowledge-Centric Systems Engineering","authors":"J. Vara, Eugenio Parra, Luis Alonso, Roy Mendieta, Borja López, J. A. Rodríguez","doi":"10.1109/ISSREW.2019.00092","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00092","url":null,"abstract":"Assurance and certification are usually required for critical systems. The underlying activities can be complex and labour-intensive, thus tool support can greatly facilitate them. Companies are also adopting the notion of Knowledge-Centric Systems Engineering, which is based on the principle that there exists a knowledge base about any system that tools can exploit for e.g. system quality analysis. This paper presents the initial results towards the integration of both types of tool support to enhance systems engineering and certification. We have worked on the integration of the AMASS Platform for assurance and certification with the tools developed by The REUSE Company. The integration allows the latter tools to analyse the quality of assurance assets, trace them, and support semantic asset search, whereas the Platform can collect assurance evidence from quality analyses on different artefact types. This way, a unified approach for Knowledge-Centric Systems Engineering, assurance, and certification is enabled.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"12 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133002994","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pinpoint Data Races via Testing and Classification","authors":"Marc Hartung, F. Schintke, T. Schütt","doi":"10.1109/ISSREW.2019.00100","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00100","url":null,"abstract":"Data races, i.e. the uncoordinated read/write access of threads to a shared variable resulting in unexpected program behaviour, in parallel shared memory programs occur highly dependent on the timing and scheduling of threads during execution. This makes data races hard to detect manually and automatically. Corresponding tools typically suspect too many code locations to cause data races and miss critical ones as the observed execution and timing did not raise them. We present methods and a tool chain for C/C++ codes with POSIX threads to detect data races and verify their harmfulness. We use automatic instrumentation and repeated test-case execution using a user-space thread scheduler overriding the kernel-space scheduler to intentionally generate specific thread interleavings. As the thread scheduling becomes deterministic and independent from the system in use, targeted testing of thread schedules can reveal and verify otherwise hard to find data races. For each data race we classify its harmfulness based on well-defined attributes and can in most cases identify and report its root cause, i.e. the data race which, when fixed, protects the program from crashing. This and a low false positive rate in the reports greatly reduces the overhead in fixing data races for developers.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133495848","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Governing Regression Testing in Systems of Systems","authors":"A. Bertolino, G. D. Angelis, F. Lonetti","doi":"10.1109/ISSREW.2019.00064","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00064","url":null,"abstract":"Great advances in network technology and software engineering have triggered the development and spread of Systems of Systems (SoSs). The dynamic and evolvable nature of SoSs poses important challenges on the validation of such systems and in particular on their regression testing, aiming at assessing that run-time changes and evolutions do not introduce regression in SoS behavior. This paper outlines issues and challenges of regression testing of SoSs, identifying the main kinds of evolution that can impact on their regression testing activity. Furthermore, it presents a conceptual framework for governing the regression testing of SoSs. The proposed framework leverages the concept of an orchestration graph that describes the flow of test cases and sketches a solution for deriving a regression test plan according to test cases dependencies.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"112 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133565548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michael Beyer, A. Morozov, K. Ding, Sheng Ding, K. Janschek
{"title":"Quantification of the Impact of Random Hardware Faults on Safety-Critical AI Applications: CNN-Based Traffic Sign Recognition Case Study","authors":"Michael Beyer, A. Morozov, K. Ding, Sheng Ding, K. Janschek","doi":"10.1109/ISSREW.2019.00058","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00058","url":null,"abstract":"Nowadays, Artificial Intelligence (AI) rapidly enters almost every safety-critical domain, including the automotive industry. The next generation of functional safety standards has to define appropriate verification and validation techniques and propose adequate fault tolerance mechanisms. Several AI frameworks, such as TensorFlow by Google, have already proven to be effective and reliable platforms. However, similar to any other software, AI-based applications are prone to common random hardware faults, e.g., bit-flips which may occur in RAM or CPU registers and might lead to silent data corruption. Therefore, it is crucial to understand how different hardware faults affect the accuracy of AI applications. This paper introduces our new fault injection framework for TensorFlow and results of first experiments conducted on a Convolutional Neural Network (CNN) based traffic sign classifier. These results demonstrate the feasibility of the fault injection framework. In particular, they help to identify the most critical parts of a neural network under test.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133649714","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Nogueira, Felipe Assis, D. Menasché, G. Xexéo, K. Wolter
{"title":"Software Longevity in the Wild: Folklore and Law","authors":"M. Nogueira, Felipe Assis, D. Menasché, G. Xexéo, K. Wolter","doi":"10.1109/ISSREW.2019.00077","DOIUrl":"https://doi.org/10.1109/ISSREW.2019.00077","url":null,"abstract":"Software rejuvenation is in vogue. Articles in the news indicate that airlines are already enforcing the frequent rejuvenation of airplane software, and other industries are likely to follow the same trend. At the same time, there is a vast folklore on software longevity, appearing in online forums at websites such as Reddit. The goal of this vision paper is to present a broad perspective contrasting the expected lifetime of so called \"epic\" machines with very long uptimes against the purposely short uptimes enforced by recent law regulations. Our aim is to illustrate what can be learned both from forums (folklore) and from the regulations (enforced by legal agencies) about the two ends of the spectrum of software longevity, namely, very long uptimes and relatively short ones. In particular, we indicate that long uptimes typically occur at servers and that there are security concerns about such long lived routers that remain unpatched for long periods of time, whereas short uptimes typically occur due to concerns about safety and performance at critical systems wherein patching is costly but the restart of the system is less expensive. Currently, law enforcement occurs reactively after bugs are found. We envision that this paper will bring awareness to the scientific community and practitioners about the relevance of law enforcement for critical-system software rejuvenation more broadly even before the bugs are founds, given their widespread and recurrent prevalence.","PeriodicalId":166239,"journal":{"name":"2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130336620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}