{"title":"Constraint-Guided Test Execution Scheduling: An Experience Report at ABB Robotics","authors":"A. Gotlieb, Morten Mossige, Helge Spieker","doi":"10.48550/arXiv.2306.01529","DOIUrl":"https://doi.org/10.48550/arXiv.2306.01529","url":null,"abstract":"Automated test execution scheduling is crucial in modern software development environments, where components are frequently updated with changes that impact their integration with hardware systems. Building test schedules, which focus on the right tests and make optimal use of the available resources, both time and hardware, under consideration of vast requirements on the selection of test cases and their assignment to certain test execution machines, is a complex optimization task. Manual solutions are time-consuming and often error-prone. Furthermore, when software and hardware components and test scripts are frequently added, removed or updated, static test execution scheduling is no longer feasible and the motivation for automation taking care of dynamic changes grows. Since 2012, our work has focused on transferring technology based on constraint programming for automating the testing of industrial robotic systems at ABB Robotics. After having successfully transferred constraint satisfaction models dedicated to test case generation, we present the results of a project called DynTest whose goal is to automate the scheduling of test execution from a large test repository, on distinct industrial robots. This paper reports on our experience and lessons learned for successfully transferring constraint-based optimization models for test execution scheduling at ABB Robotics. Our experience underlines the benefits of a close collaboration between industry and academia for both parties.","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115074864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mathieu Dumont, Kevin Hector, Pierre-Alain Moëllic, J. Dutertre, S. Pontié
{"title":"Evaluation of Parameter-based Attacks against Embedded Neural Networks with Laser Injection","authors":"Mathieu Dumont, Kevin Hector, Pierre-Alain Moëllic, J. Dutertre, S. Pontié","doi":"10.48550/arXiv.2304.12876","DOIUrl":"https://doi.org/10.48550/arXiv.2304.12876","url":null,"abstract":"Upcoming certification actions related to the security of machine learning (ML) based systems raise major evaluation challenges that are amplified by the large-scale deployment of models in many hardware platforms. Until recently, most of research works focused on API-based attacks that consider a ML model as a pure algorithmic abstraction. However, new implementation-based threats have been revealed, emphasizing the urgency to propose both practical and simulation-based methods to properly evaluate the robustness of models. A major concern is parameter-based attacks (such as the Bit-Flip Attack, BFA) that highlight the lack of robustness of typical deep neural network models when confronted by accurate and optimal alterations of their internal parameters stored in memory. Setting in a security testing purpose, this work practically reports, for the first time, a successful variant of the BFA on a 32-bit Cortex-M microcontroller using laser fault injection. It is a standard fault injection means for security evaluation, that enables to inject spatially and temporally accurate faults. To avoid unrealistic brute-force strategies, we show how simulations help selecting the most sensitive set of bits from the parameters taking into account the laser fault model.","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116134217","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Janek Groß, R. Adler, Michael Kläs, Jan Reich, Lisa Jöckel, Roman Gansch
{"title":"Architectural patterns for handling runtime uncertainty of data-driven models in safety-critical perception","authors":"Janek Groß, R. Adler, Michael Kläs, Jan Reich, Lisa Jöckel, Roman Gansch","doi":"10.48550/arXiv.2206.06838","DOIUrl":"https://doi.org/10.48550/arXiv.2206.06838","url":null,"abstract":"Data-driven models (DDM) based on machine learning and other AI techniques play an important role in the perception of increasingly autonomous systems. Due to the merely implicit definition of their behavior mainly based on the data used for training, DDM outputs are subject to uncertainty. This poses a challenge with respect to the realization of safety-critical perception tasks by means of DDMs. A promising approach to tackling this challenge is to estimate the uncertainty in the current situation during operation and adapt the system behavior accordingly. In previous work, we focused on runtime estimation of uncertainty and discussed approaches for handling uncertainty estimations. In this paper, we present additional architectural patterns for handling uncertainty. Furthermore, we evaluate the four patterns qualitatively and quantitatively with respect to safety and performance gains. For the quantitative evaluation, we consider a distance controller for vehicle platooning where performance gains are measured by considering how much the distance can be reduced in different operational situations. We conclude that the consideration of context information of the driving situation makes it possible to accept more or less uncertainty depending on the inherent risk of the situation, which results in performance gains.","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"2 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122589396","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Gautham, Georgios Bakirtzis, Alexander Will, A. Jayakumar, C. Elks
{"title":"STPA-driven Multilevel Runtime Monitoring for In-time Hazard Detection","authors":"S. Gautham, Georgios Bakirtzis, Alexander Will, A. Jayakumar, C. Elks","doi":"10.48550/arXiv.2204.08999","DOIUrl":"https://doi.org/10.48550/arXiv.2204.08999","url":null,"abstract":". Runtime verification or runtime monitoring equips safety-critical cyber-physical systems to augment design assurance measures and ensure operational safety and security. Cyber-physical systems have interaction failures, attack surfaces, and attack vectors resulting in unan-ticipated hazards and loss scenarios. These interaction failures pose challenges to runtime verification regarding monitoring specifications and monitoring placements for in-time detection of hazards. We develop a well-formed workflow model that connects system theoretic process analysis, commonly referred to as STPA, hazard causation information to lower-level runtime monitoring to detect hazards at the operational phase. Specifically, our model follows the DepDevOps paradigm to provide evidence and insights to runtime monitoring on what to monitor, where to monitor, and the monitoring context. We demonstrate and evaluate the value of multilevel monitors by injecting hazards on an autonomous emergency braking system model.","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"127 11","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133085664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Koichi Shimizu, D. Suzuki, Ryosuke Muramatsu, H. Mori, Tomoyuki Nagatsuka, Tsutomu Matsumoto
{"title":"Evaluation Framework for Performance Limitation of Autonomous Systems under Sensor Attack","authors":"Koichi Shimizu, D. Suzuki, Ryosuke Muramatsu, H. Mori, Tomoyuki Nagatsuka, Tsutomu Matsumoto","doi":"10.1007/978-3-030-83903-1_1","DOIUrl":"https://doi.org/10.1007/978-3-030-83903-1_1","url":null,"abstract":"","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133672424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Colin Paterson, Haoze Wu, John M. Grese, R. Calinescu, C. Pasareanu, Clark W. Barrett
{"title":"DeepCert: Verification of Contextually Relevant Robustness for Neural Network Image Classifiers","authors":"Colin Paterson, Haoze Wu, John M. Grese, R. Calinescu, C. Pasareanu, Clark W. Barrett","doi":"10.1007/978-3-030-83903-1_5","DOIUrl":"https://doi.org/10.1007/978-3-030-83903-1_5","url":null,"abstract":"","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117257420","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"SASSI: Safety Analysis Using Simulation-Based Situation Coverage for Cobot Systems","authors":"Benjamin Lesage, R. Alexander","doi":"10.1007/978-3-030-83903-1_13","DOIUrl":"https://doi.org/10.1007/978-3-030-83903-1_13","url":null,"abstract":"","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122939980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Compositional Semantics for Repairable BDMPs","authors":"Shahid Khan, J. Katoen, M. Bouissou","doi":"10.1007/978-3-030-54549-9_6","DOIUrl":"https://doi.org/10.1007/978-3-030-54549-9_6","url":null,"abstract":"","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133532424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Securing Electric Vehicle Charging Systems Through Component Binding","authors":"A. Fuchs, Dustin Kern, C. Krauß, M. Zhdanova","doi":"10.1007/978-3-030-54549-9_26","DOIUrl":"https://doi.org/10.1007/978-3-030-54549-9_26","url":null,"abstract":"","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132263431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lukas Gressl, Michael Krisper, C. Steger, U. Neffe
{"title":"Towards an Automated Exploration of Secure IoT/CPS Design-Variants","authors":"Lukas Gressl, Michael Krisper, C. Steger, U. Neffe","doi":"10.1007/978-3-030-54549-9_25","DOIUrl":"https://doi.org/10.1007/978-3-030-54549-9_25","url":null,"abstract":"","PeriodicalId":402659,"journal":{"name":"International Conference on Computer Safety, Reliability, and Security","volume":"36 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120825120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}