{"title":"HATBED: a distributed hardware assisted testbed for non-invasive profiling of IoT devices","authors":"Yi Li, Junyan Ma, Te Zhang","doi":"10.1145/3312480.3313172","DOIUrl":"https://doi.org/10.1145/3312480.3313172","url":null,"abstract":"Embedded networked sensor systems are deeply coupled with the physical world, and the deployed systems are usually difficult to debug. Therefore, it is especially important to thoroughly test and profile the systems before deploying to the real world. Traditional debugging methods are incompetent for detailed tracing on resource constrained devices due to their intrusiveness. This paper proposes alow-cost Hardware Assisted Tracing testBED (HATBED) to enable non-intrusive tracing and profiling for embedded networked sensor systems independent of operating systems and applications. We hope HATBED will foster research on comprehensive testing and profiling of embedded networked systems based on modern 32-bit architecture.","PeriodicalId":166662,"journal":{"name":"Proceedings of the 2nd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123827572","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Romain Jacob, C. Boano, Usman Raza, Marco Zimmerling, L. Thiele
{"title":"Towards a methodology for experimental evaluation in low-power wireless networking","authors":"Romain Jacob, C. Boano, Usman Raza, Marco Zimmerling, L. Thiele","doi":"10.1145/3312480.3313173","DOIUrl":"https://doi.org/10.1145/3312480.3313173","url":null,"abstract":"Making experimental research on low-power wireless networking repeatable, reproducible, and comparable is a long overdue step that hinders a wide acceptance of this technology within the industry. In this paper, we start to fill this gap by proposing and applying a well-defined methodology that specifies how to plan and execute experiments, as well as how to report their results. We further discuss potential definitions for repeatability, replicability, and reproducibility in the context of low-power wireless networking.","PeriodicalId":166662,"journal":{"name":"Proceedings of the 2nd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134016281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Lessons learned and challenges on benchmarking publish-subscribe IoT platforms","authors":"Ana Aguiar, Ricardo Morla","doi":"10.1145/3312480.3313174","DOIUrl":"https://doi.org/10.1145/3312480.3313174","url":null,"abstract":"The Internet of Things (IoT) emerged simultaneously in various research fields and application domains, leading to the appearence of a multitude of hardware, software technologies, horizontal platforms and data models. Lost in this diversity, adoption decisions are made to a large extent based on familiarity with a technology, or because there is a broad community support for it. In this context, bechmarking different technologies at different horizontal levels would provide a more solid justification for the adoption of a specific technology in a specific context. In this paper, we reflect on our previous work on benchmarking publish-subscribe IoT platforms as a middleware for IoT applications, reporting lessons learned and identifying challenges, thus contributing to the discussion on open topics and relevant downstream work.","PeriodicalId":166662,"journal":{"name":"Proceedings of the 2nd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116308944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The impact of decreasing transmit power levels on FlockLab to achieve a sparse network","authors":"M. Bradbury, A. Jhumka, C. Maple","doi":"10.1145/3312480.3313171","DOIUrl":"https://doi.org/10.1145/3312480.3313171","url":null,"abstract":"For research in Wireless Sensor Networks (WSNs) and the Internet of Things (IoT), while many protocols are either analysed mathematically or simulated to assess performance, it has become necessary that they are tested on hardware in real world environments. Algorithms are often validated in either (i) a densely connected network or (ii) a sparsely connected network. The majority of existing testbeds have implemented dense networks, making evaluation and validation of certain protocols, such as spatially-redundant source location privacy (SLP) protocols, challenging. We explore the use of transmission power to achieve network sparsity and present the results of such experiments performed on the FlockLab testbed. Based upon our experience in using FlockLab, we also identify additional aspects of testbed performance that need to be monitored to ensure reliable and reproducible results.","PeriodicalId":166662,"journal":{"name":"Proceedings of the 2nd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129004072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 2nd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things","authors":"","doi":"10.1145/3312480","DOIUrl":"https://doi.org/10.1145/3312480","url":null,"abstract":"","PeriodicalId":166662,"journal":{"name":"Proceedings of the 2nd Workshop on Benchmarking Cyber-Physical Systems and Internet of Things","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129132842","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}