2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench)最新文献

Moving Beyond Competitions: Extending D-Cube to Seamlessly Benchmark Low-Power Wireless Systems 超越竞争:将D-Cube扩展到无缝基准低功耗无线系统

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-08-07 DOI: 10.1109/CPSBench.2018.00012

Markus Schuss, C. Boano, K. Römer

{"title":"Moving Beyond Competitions: Extending D-Cube to Seamlessly Benchmark Low-Power Wireless Systems","authors":"Markus Schuss, C. Boano, K. Römer","doi":"10.1109/CPSBench.2018.00012","DOIUrl":"https://doi.org/10.1109/CPSBench.2018.00012","url":null,"abstract":"Performance comparisons of low-power wireless systems are often not substantiated by accurate and realistic evaluations, which raises the need of a proper benchmark. In a first attempt towards a rigorous comparison of protocol performance under the exact same settings, we have developed in 2016 a prototype benchmarking infrastructure called D-Cube, and used it to run the first of a series of competitions aiming to quantitatively assess the performance of low-power wireless protocols in specific scenarios. Given the success of the competition among both academia and industry, we have significantly extended the benchmarking infrastructure in the following two editions: D-Cube now also supports, among others, remote experimentation, multiple traffic patterns and loads, a custom description of how to derive performance metrics, and is further able to control the network density as well as the harshness of the RF environment. In this paper we perform a critical analysis of the current capabilities of D-Cube and argue that its main limiting factor is that the traffic patterns and node identities are manually embedded in the source code by developers and cannot be changed automatically. We show that we can overcome this limitation by utilizing a well-known data structure and by having developers describe its memory address using a configuration file that is passed to the benchmarking infrastructure. Following this concept, we extend D-Cube with the ability of building and applying patches to binary files and show that this allows not only to automatically change traffic patterns and node identities, but to also change user-defined protocol parameters. We believe that this extension is one of the last missing stepping stones to make D-Cube a full-fledged benchmarking infrastructure for low-power wireless systems.","PeriodicalId":184792,"journal":{"name":"2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115849835","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 31

Evaluating Low-Power Wireless Cyber-Physical Systems 评估低功耗无线网络物理系统

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-04-10 DOI: 10.1109/CPSBench.2018.00009

Dominik Baumann, Fabian Mager, Harsoveet Singh, Marco Zimmerling, Sebastian Trimpe

引用次数: 17

SODA: 6TiSCH Open Data Action SODA: 6TiSCH开放数据行动

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-04-10 DOI: 10.1109/CPSBench.2018.00014

Mališa Vučinić, M. Pejanovic, T. Watteyne

{"title":"SODA: 6TiSCH Open Data Action","authors":"Mališa Vučinić, M. Pejanovic, T. Watteyne","doi":"10.1109/CPSBench.2018.00014","DOIUrl":"https://doi.org/10.1109/CPSBench.2018.00014","url":null,"abstract":"Industrial-grade performance of wireless networks has become a reality of the open Internet of Things through a low-power wireless technology called 6TiSCH. A standardization group of the same name within the Internet Engineering Task Force (IETF) has been working on a zero-configuration, IPv6-enabled solution applicable to industrial monitoring and control, smart building, home, city and agriculture. The base standardization work is virtually done. Before different stakeholders invest significant resources in developing and deploying 6TiSCH-based solutions, they need to have a certain level of assurance about whether the technology indeed meets their requirements. An unbiased performance benchmark of a standards-compliant 6TiSCH solution is therefore required by the industry, the research community and the standardization group. 6TiSCH Open Data Action (SODA) is a research project that will provide a 6TiSCH benchmark and open datasets in different industry relevant scenarios. SODA will automate the experimentation on these scenarios so benchmarking can remain up-to-date with changes to the standards, and facilitate comparison with future technological developments, resulting in continuous delivery benchmarking. This paper introduces the SODA project and seeks community involvement on the definition of scenarios and Key Performance Indicators, and on the usage of the tools that will be provided.","PeriodicalId":184792,"journal":{"name":"2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench)","volume":"142 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133836645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 9

Evaluating Bluetooth Low Energy for IoT 评估物联网蓝牙低功耗

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-04-10 DOI: 10.1109/CPSBench.2018.00007

Jonathan Fürst, Kaifei Chen, Hyung-Sin Kim, Philippe Bonnet

引用次数: 14

IoTBench: Towards a Benchmark for Low-Power Wireless Networking IoTBench:迈向低功耗无线网络的基准

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-04-10 DOI: 10.1109/CPSBench.2018.00013

C. Boano, S. Duquennoy, Anna Förster, O. Gnawali, Romain Jacob, Hyung-Sin Kim, O. Landsiedel, Ramona Marfievici, L. Mottola, G. Picco, Xavier Vilajosana, T. Watteyne, Marco Zimmerling

引用次数: 44

Toward Standard Non-Line-of-Sight Benchmarking of Ultra-Wideband Radio-Based Localization 基于超宽带无线电定位的标准非视线基准测试研究

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-04-10 DOI: 10.1109/CPSBench.2018.00010

Milad Heydariaan, Hessam Mohammadmoradi, O. Gnawali

引用次数: 16

Benchmarking Networked Control Systems 网络控制系统的基准测试

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-04-01 DOI: 10.1109/CPSBench.2018.00008

Sebastian Gallenmüller, Stephan M. Günther, Maurice Leclaire, Samuele Zoppi, Fabio Molinari, Richard Schöffauer, W. Kellerer, G. Carle

引用次数: 6

Towards Benchmark Optimization by Automated Equivalence Detection 通过自动等效检测实现基准优化

2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench) Pub Date : 2018-04-01 DOI: 10.1109/CPSBench.2018.00011

Daniel Schemmel, René Glebke, Mirko Stoffers, Klaus Wehrle

引用次数: 0