{"title":"A Dataset Annotation System for Snowy Weather Road Surface Classification","authors":"Mohamed Karaa;Hakim Ghazzai;Lokman Sboui","doi":"10.1109/OJSE.2024.3391326","DOIUrl":"https://doi.org/10.1109/OJSE.2024.3391326","url":null,"abstract":"In this article, we introduce an artificial-intelligence-based annotation system for a dataset of snow-covered road images. We operate on a large dataset consisting of CCTV images and time and weather metadata. The dataset is fed to a series of data processing techniques to automatically assign each image one of four snow cover categories aligned with snow removal operations. The processing pipeline includes feature learning using convolutional autoencoders and graph clustering using the Louvain community detection algorithm. The resulting dataset comprises over 41 000 images automatically annotated in different weather and time settings. We train and test multiple deep learning models to validate the annotated dataset to classify snow-covered road images. We customize the models to consider the class distribution within the dataset. We achieve precision and recall scores of 97% using an EfficientNet model trained on separate day and night image datasets and using a class-weighted loss function.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"2 ","pages":"71-82"},"PeriodicalIF":0.0,"publicationDate":"2024-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10505782","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140924689","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Niloofar Shadab;Tyler Cody;Alejandro Salado;Peter A. Beling
{"title":"A Systems-Theoretical Formalization of Closed Systems","authors":"Niloofar Shadab;Tyler Cody;Alejandro Salado;Peter A. Beling","doi":"10.1109/OJSE.2024.3369070","DOIUrl":"https://doi.org/10.1109/OJSE.2024.3369070","url":null,"abstract":"There is a lack of formalism for some key foundational concepts in systems engineering. One of the most recently acknowledged deficits is the inadequacy of systems engineering practices for engineering intelligent systems. In our previous works, we proposed that closed systems precepts could be used to accomplish a required paradigm shift for the systems engineering of intelligent systems. However, to enable such a shift, formal foundations for closed systems precepts that expand the theory of systems engineering are needed. The concept of closure is a critical concept in the formalism underlying closed systems precepts. In this article, we provide formal, systems- and information-theoretic definitions of closure to identify and distinguish different types of closed systems. Then, we assert a mathematical framework to evaluate the subjective formation of the boundaries and constraints of such systems. Finally, we present a high-level overview of the engineering implications stemming from this formalism, with a specific focus on its application in engineering intelligent systems. In the main, this framework lays the groundwork for understanding and applying closed systems precepts in the engineering of complex systems, especially those characterized by high levels of intelligence.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"2 ","pages":"26-37"},"PeriodicalIF":0.0,"publicationDate":"2024-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10443926","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140135229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christine M. Edwards;Maximilian Vierlboeck;Roshanak Rose Nilchiani;Ian M. Miller
{"title":"Method for Measuring Resilience of Complex Systems Using Network Theory and Graph Energy","authors":"Christine M. Edwards;Maximilian Vierlboeck;Roshanak Rose Nilchiani;Ian M. Miller","doi":"10.1109/OJSE.2024.3366939","DOIUrl":"https://doi.org/10.1109/OJSE.2024.3366939","url":null,"abstract":"Because of societies’ dependence on systems that have increasing interconnectedness, governments and industries have an increasing interest in managing the resilience of these systems and the risks associated with their disruption or failure. The identification and localization of tipping points in complex systems is essential in predicting system collapse but exceedingly difficult to estimate. At critical tipping-point thresholds, systems may transition from stable to unstable and potentially collapse. One of the approaches to measuring a complex system's resilience to collapse has been to model the system as a network, reduce the network behavior to a simpler model, and measure the resulting model's stability. In particular, Gao et al. introduced a method in 2016 that includes a resilience index that measures precariousness, the distance to tipping points. However, those mathematical reductions can cause the model to lose information on the topological complexity of the system. Using computational experimentation, a new method has been formulated that more-accurately predicts the resilience and location of tipping points in networked systems by integrating Gao et al.’s method with a measurement of a system's topological complexity using graph energy, which arose from molecular orbital theory. Herein, this method for measuring and managing system resilience is outlined with case studies involving ecosystem collapse, supply-chain sustainability, and disruptive technology. The precariousness of these example systems is found using the dimension reduction, and a graph-energy correction is quantified to fine-tune the measurement. Lastly, the integration of this method into systems engineering processes is explored to provide a measurement of precariousness and give insight into how a complex system's topology affects the location of its tipping points.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"2 ","pages":"15-25"},"PeriodicalIF":0.0,"publicationDate":"2024-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10443825","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140052857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abheek Chatterjee;Hao Huang;Richard Malak;Katherine R. Davis;Astrid Layton
{"title":"Extending Ecological Network Analysis to Design Resilient Cyber-Physical System of Systems","authors":"Abheek Chatterjee;Hao Huang;Richard Malak;Katherine R. Davis;Astrid Layton","doi":"10.1109/OJSE.2024.3368921","DOIUrl":"https://doi.org/10.1109/OJSE.2024.3368921","url":null,"abstract":"The design of resilient infrastructure is a critical engineering challenge for the smooth functioning of society. These networks are best described as cyber-physical systems of systems (CPSoS): integration of independent constituent systems, connected by physical and cyber interactions, to achieve novel capabilities. Bioinspired design, using a framework called the ecological network analysis (ENA), has been shown to be a promising solution for improving the resilience of engineering networks. However, the existing ENA framework can only account for one type of flow in a network. Thus, it is not yet applicable for the evaluation of CPSoS. This article addresses this limitation by proposing a novel multigraph model of CPSoS, along with guidelines and modified metrics that enable ENA evaluation of the overall (cyber and physical) network organization of the CPSoS. The application of the extended framework is demonstrated using an energy infrastructure case study. This research lays the critical groundwork for investigating the design of resilient CPSoS using biological ecosystems inspiration.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"2 ","pages":"38-49"},"PeriodicalIF":0.0,"publicationDate":"2024-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10443500","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140310195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jakob Axelsson;Damir Bilic;Daniel Brahneborg;Joakim Fröberg;Henrik Gustavsson;Robbert Jongeling;Daniel Sundmark
{"title":"ALCEA: The Architecture Life-Cycle Effect Analysis Method","authors":"Jakob Axelsson;Damir Bilic;Daniel Brahneborg;Joakim Fröberg;Henrik Gustavsson;Robbert Jongeling;Daniel Sundmark","doi":"10.1109/OJSE.2024.3357243","DOIUrl":"https://doi.org/10.1109/OJSE.2024.3357243","url":null,"abstract":"This article describes the architecture life cycle effect analysis (ALCEA) method, a structured method for evaluating proposed new architectures for software-intensive systems. The method evaluates a proposed architecture by quantifying its effect on the performance of system life-cycle phases. The method is instantiated by identifying the relevant life-cycle phases of the system under investigation and a set of evaluation functions that capture, in terms of basic factors, the effect of different architectural decisions on key life-cycle PAs, such as revenue, operating resources, and investments. The method results in a transparent cost and revenue structure, documented in a tabular form, based on quantifiable factors from the developing organization. The results of the method can be used directly as part of a business case, and their robustness can be estimated by sensitivity analysis. The ALCEA method is designed for system-level architectural analysis, covering both software and hardware aspects. In this article, we introduce the ALCEA method and provide a detailed example of how to apply it in the evolution of embedded systems. Moreover, we share early experiences of using the method in large-scale industrial settings.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"2 ","pages":"1-14"},"PeriodicalIF":0.0,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10412128","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139976221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Enhancing Technology Readiness Assessment: The Engineering Severity Level Methodology and the Technical Readiness Level+ Classification","authors":"Susannah Jones","doi":"10.1109/OJSE.2024.3354777","DOIUrl":"https://doi.org/10.1109/OJSE.2024.3354777","url":null,"abstract":"In this article, the author proposes a novel methodology to overcome the outstanding challenges in accurately assessing technology readiness for final real-world applications. The engineering severity level is a conceptual methodology that provides a simple, standardized, and quantitative method for assessing technology suitability in relation to real-world environments. It is a standalone assessment concept that offers advantages in generating an evidence base for accurate technology readiness assessment and early identification of developmental roadblocks derived from real-world requirements. Moreover, the methodology can be applied as a universal basis to enhance the technical readiness level classification assessment criteria. The benefits are exemplified in assessing quantum technologies for position, navigation, and timing requirements in defense applications.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"2 ","pages":"50-61"},"PeriodicalIF":0.0,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10400902","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140540937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Design Principles for Distributed Context Modeling of Autonomous Systems","authors":"Marvin Zager;Alexander Fay","doi":"10.1109/OJSE.2023.3342572","DOIUrl":"https://doi.org/10.1109/OJSE.2023.3342572","url":null,"abstract":"The use of unmanned aerial vehicles (UAV) has seen a rapid increase due to the advancements in drone technology and the wide range of applications. Their adaptability and versatility make them suitable for a great variety of tasks. To fully realize their potential, an autonomous operation is crucial. For modeling environmental perception (i.e., contextual information) as a key enabler of autonomous operations, guiding principles are needed to support system designers in modeling contextual information for autonomous systems. This article precisely addresses this concern and seeks to establish a set of design principles for the distributed context modeling of autonomous systems, such as autonomous UAVs. This is achieved through a systematic review of the literature and the identification of meta-requirements by leveraging a generic context classification model, which serves as the foundation for deriving the design principles. Subsequently, these design principles undergo evaluation within the context of autonomous UAVs through a use case analysis. The goal of this research is to provide a foundation for the development of autonomous systems that can effectively perceive, interpret, and distribute their context. The design principles can serve as a prescriptive guide for the future development of autonomous systems, ensuring efficient and effective operations.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"1 ","pages":"179-189"},"PeriodicalIF":0.0,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10356718","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139431022","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bryan C. Watson;Isabella V. Hernandez;Marc J. Weissburg;Bert Bras
{"title":"Validation of Biologically Inspired Tactics to Increase Multi-Agent System Resilience","authors":"Bryan C. Watson;Isabella V. Hernandez;Marc J. Weissburg;Bert Bras","doi":"10.1109/OJSE.2023.3327747","DOIUrl":"10.1109/OJSE.2023.3327747","url":null,"abstract":"There is an urgent need to increase multi-agent systems’ resilience. Efforts, however, are hampered by three gaps: current approaches are case study specific, may depend on infrastructure investment, and are often unshared. In response to these needs, we propose 14 biologically inspired Tactics for individual agent design and communication protocols. The Tactics are generalizable and do not depend upon infrastructure investments. The Tactics are applied to a hybrid system dynamic and agent-based model of an electric motor manufacturing supply chain case study. The approach for applying each of the Tactics is clearly described to support future application. Tactic use successfully increased resilience by an average of 6.6%. By reporting a context-neutral solution approach to increase resilience, focusing on agent intervention, and clearly reporting the implementation to a supply chain case study, this article takes an important step toward our goal of using biologically inspired design to increase multi-agent system resilience.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"1 ","pages":"164-178"},"PeriodicalIF":0.0,"publicationDate":"2023-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10297412","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135211149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Raquel Hoffmann;Daniel Patrick Pereira;Hidekazu Nishimura
{"title":"Security Viewpoint and Resilient Performance in the Urban Air Mobility Operation","authors":"Raquel Hoffmann;Daniel Patrick Pereira;Hidekazu Nishimura","doi":"10.1109/OJSE.2023.3327524","DOIUrl":"10.1109/OJSE.2023.3327524","url":null,"abstract":"The rapid development of urban air mobility (UAM) technologies and their integration into the urban environment brings new security challenges. Threats to aviation and mobility systems continue to evolve. The urban space places additional vulnerabilities to which UAM stakeholders strive to enhance and develop UAM security capabilities. Ensuring the security of UAM operations requires a holistic and integrated approach that considers the complex interdependencies between various stakeholders and components of the UAM ecosystem. This article explores security viewpoints and resilient performance in UAM operations using enterprise architecture modeling methodology through the unified architecture framework (UAF). The ecosystem approach recognizes that UAM operations involve a multitude of actors, including UAM designers, operators, service providers, airspace managers, and regulators. Each actor has a unique role and perspective on security, and their actions and decisions can significantly impact the overall security and resilience of the UAM operation. The approach includes a security viewpoint integrating different actors to identify and assess security risks, strategies to mitigate them, and a discussion about resilient performance in the UAM ecosystem. The security viewpoint considers technical and nontechnical security aspects, including human factors, organizational culture, and cybersecurity frameworks. Moreover, a security state diagram for UAF is proposed, supporting the discussion of how different resilient scenarios can avoid undesirable security states. The results include views defining risk and capability taxonomies, security structure, security states, and ground security processes, showing how the UAM enterprise operates to achieve resilient performance.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"1 ","pages":"123-138"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10295998","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135158891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Implementing a Complete Digital Thread: The Need for Data Element Mapping and Analysis","authors":"Allison B. Ledford;Gregory Harris;Gregory Purdy","doi":"10.1109/OJSE.2023.3325189","DOIUrl":"10.1109/OJSE.2023.3325189","url":null,"abstract":"In the age of digitalization and the fourth industrial revolution, the concept of the digital thread has captured both the attention and resources of countless organizations. However, despite its growing popularity and a plethora of technologies being offered that promise to create the digital thread, this research revealed that no current techniques allow for the systematic uncovering of data and information flows in a way that reveals individual threads of data elements. Therefore, data element mapping and analysis (DEMA) is proposed as a tool capable of identifying all the data elements at the granularity necessary to connect digital threads. DEMA is a technology agnostic approach that allows an enterprise to move from a functional, document-centric view of data and information flows to a data element level view, with the data elements serving as the connectors of the digital thread.","PeriodicalId":100632,"journal":{"name":"IEEE Open Journal of Systems Engineering","volume":"1 ","pages":"139-152"},"PeriodicalIF":0.0,"publicationDate":"2023-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10286971","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135002963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}