Wenqiang Chen, Lin Chen, Meiyi Ma, Farshid Salemi Parizi, Shwetak N. Patel, J. Stankovic
{"title":"Continuous micro finger writing recognition with a commodity smartwatch: demo abstract","authors":"Wenqiang Chen, Lin Chen, Meiyi Ma, Farshid Salemi Parizi, Shwetak N. Patel, J. Stankovic","doi":"10.1145/3384419.3430417","DOIUrl":"https://doi.org/10.1145/3384419.3430417","url":null,"abstract":"Input is a significant problem for wearable devices, particularly for head-mounted virtual and augmented reality systems. Contemporary AR/VR systems use in-air gestures or handheld controllers for interactivity. However, mid-air handwriting provides a natural, subtle, and easy-to-use way to input commands and text. In this demo, we propose and investigate ViFin, a new technique for input commands and text entry which tracks continuous micro finger-level writing with a commodity smartwatch through vibrations. Inspired by the recurrent neural aligner and transfer learning, ViFin recognizes continuous finger writing and works across different users and achieves an accuracy of 90% and 91% for recognizing numbers and letters, respectively. Finally, a real-time writing system with two specific applications using AR smartglasses are implemented.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121358792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abdelwahed Khamis, B. Kusy, C. Chou, M. McLaws, Wen Hu
{"title":"RFWash","authors":"Abdelwahed Khamis, B. Kusy, C. Chou, M. McLaws, Wen Hu","doi":"10.1145/3384419.3430733","DOIUrl":"https://doi.org/10.1145/3384419.3430733","url":null,"abstract":"Each year, hundreds of thousands of people contract Healthcare Associated Infections (HAIs). Poor hand hygiene compliance among healthcare workers is thought to be the leading cause of HAIs and methods were developed to measure compliance. Surprisingly, human observation is still considered the gold standard for measuring compliance by World Health Organization (WHO). Moreover, no automated solutions exist for monitoring hand hygiene techniques, such as \"how to hand rub\" technique by WHO. In this paper, we introduce RFWash; the first radio-based device-free system for monitoring Hand Hygiene (HH) technique. On the technical level, HH gestures are performed back-to-back in a continuous sequence and pose a significant challenge to conventional two-stage gesture detection and recognition approaches. We propose a deep model that can be trained on unsegmented naturally-performed HH gesture sequences. RFWash evaluation demonstrates promising results for tracking HH gestures, achieving gesture error rate of < 8% when trained on 10-second segments, which reduces manual labelling overhead by ≈ 67% compared to fully supervised approach. The work is a step towards practical RF sensing that can reliably operate inside future healthcare facilities.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127434247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Meera Radhakrishnan, Darshana Rathnayake, Ong Koon Han, Inseok Hwang, Archan Misra
{"title":"ERICA","authors":"Meera Radhakrishnan, Darshana Rathnayake, Ong Koon Han, Inseok Hwang, Archan Misra","doi":"10.1145/3384419.3430732","DOIUrl":"https://doi.org/10.1145/3384419.3430732","url":null,"abstract":"We present ERICA, a digital personal trainer for users performing free weights exercises, with two key differentiators: (a) First, unlike prior approaches that either require multiple on-body wearables or specialized infrastructural sensing, ERICA uses a single in-ear \"earable\" device (piggybacking on a form factor routinely used by millions of gym-goers) and a simple inertial sensor mounted on each weight equipment; (b) Second, unlike prior work that focuses primarily on quantifying a workout, ERICA additionally identifies a variety of fine-grained exercising mistakes and delivers real-time, in-situ corrective instructions. To achieve this, we (a) design a robust approach for user-equipment association that can handle multiple (even 15) concurrently exercising users; (b) develop a suite of statistical models to detect several commonplace repetition-level mistakes; and (c) experimentally study the efficacy of multiple in-situ corrective feedback strategies. Via an end-to-end evaluation of ERICA with 33 participants naturally performing 3 dumbbell-based exercises, we show that (a) ERICA identifies over 94% of mistakes during the first 5 repetitions of a set, (b) the resulting feedback is viewed favorably by 78% of users, and (c) the feedback is effective, reducing mistakes by 10+% during subsequent repetitions.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125058998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards robust and low-complexity radiometric fingerprint: PhD forum abstract","authors":"Wenqing Yan","doi":"10.1145/3384419.3430573","DOIUrl":"https://doi.org/10.1145/3384419.3430573","url":null,"abstract":"Authentication is challenging in the IoT because most advanced cryptographic algorithms are difficult to afford by constrained devices expected to run many months or years. Radiometric signatures have been used effectively to identify wireless devices based on imperfections in electronic circuits. This technique is also known as Radio frequency (RF) fingerprinting. Previous work proves the feasibility of this technique but mainly considered static channel conditions. In our current work, we systematically and experimentally study the impact of dynamic and complex channel conditions on the radiometric signatures. The results show a threat to identification accuracy for modulation error-based fingerprinting that was considered channel-resilient. Next step, my research aims at improving the robustness of RF fingerprint systems and make this authentication solution ready for widespread implementation.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121887457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pointillism: accurate 3D bounding box estimation with multi-radars","authors":"Kshitiz Bansal, Keshav Rungta, Siyuan Zhu, Dinesh Bharadia","doi":"10.1145/3384419.3430783","DOIUrl":"https://doi.org/10.1145/3384419.3430783","url":null,"abstract":"Autonomous perception requires high-quality environment sensing in the form of 3D bounding boxes of dynamic objects. The primary sensors used in automotive systems are light-based cameras and LiDARs. However, they are known to fail in adverse weather conditions. Radars can potentially solve this problem as they are barely affected by adverse weather conditions. However, specular reflections of wireless signals cause poor performance of radar point clouds. We introduce Pointillism, a system that combines data from multiple spatially separated radars with an optimal separation to mitigate these problems. We introduce a novel concept of Cross Potential Point Clouds, which uses the spatial diversity induced by multiple radars and solves the problem of noise and sparsity in radar point clouds. Furthermore, we present the design of RP-net, a novel deep learning architecture, designed explicitly for radar's sparse data distribution, to enable accurate 3D bounding box estimation. The spatial techniques designed and proposed in this paper are fundamental to radars point cloud distribution and would benefit other radar sensing applications","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129618193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Physical distance monitoring system for COVID-19 using raspberry Pi and a monocular camera: poster abstract","authors":"Yuriko Tachibana, N. Segawa","doi":"10.1145/3384419.3430591","DOIUrl":"https://doi.org/10.1145/3384419.3430591","url":null,"abstract":"During the global pandemic of coronavirus disease 2019 (COVID-19), it is crucial to minimize the spread of the infection until effective drugs and vaccines are developed. Therefore, close contact must be reduced to prevent human-to-human transmission. We propose a simplified inexpensive system using a monocular camera combined with Raspberry Pi, a small single-board computer, to measure physical distancing and warn people of their proximity with others.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124710832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"How robust are malware detection models for Android smartphones against adversarial attacks?: poster abstract","authors":"Hemant Rathore, S. Sahay, Mohit Sewak","doi":"10.1145/3384419.3430462","DOIUrl":"https://doi.org/10.1145/3384419.3430462","url":null,"abstract":"Android-based smartphones and IoT devices have grown at an exponential rate in the last decade. Meanwhile, malicious applications have also increased dramatically, which threaten the Android ecosystem. The anti-malware community has proposed data mining based malware detection models which have shown encouraging results. However, these detection models are vulnerable to adversarial attacks. In this work, we first acted as an adversary and performed adversarial attacks on eight different malware detection models. We found all the eight detection models vulnerable to adversarial attacks and fooling rate of more than 90% was achieved against each of them. We also propose defence against these attacks by adversarial retraining and accomplish encouraging results to improve the overall robustness of malware detection models.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130378486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Guohao Lan, Bailey Heit, T. Scargill, M. Gorlatova
{"title":"GazeGraph","authors":"Guohao Lan, Bailey Heit, T. Scargill, M. Gorlatova","doi":"10.1145/3384419.3430774","DOIUrl":"https://doi.org/10.1145/3384419.3430774","url":null,"abstract":"In this work, we present GazeGraph, a system that leverages human gazes as the sensing modality for cognitive context sensing. GazeGraph is a generalized framework that is compatible with different eye trackers and supports various gaze-based sensing applications. It ensures high sensing performance in the presence of heterogeneity of human visual behavior, and enables quick system adaptation to unseen sensing scenarios with few-shot instances. To achieve these capabilities, we introduce the spatial-temporal gaze graphs and the deep learning-based representation learning method to extract powerful and generalized features from the eye movements for context sensing. Furthermore, we develop a few-shot gaze graph learning module that adapts the `learning to learn' concept from meta-learning to enable quick system adaptation in a data-efficient manner. Our evaluation demonstrates that GazeGraph outperforms the existing solutions in recognition accuracy by 45% on average over three datasets. Moreover, in few-shot learning scenarios, GazeGraph outperforms the transfer learning-based approach by 19% to 30%, while reducing the system adaptation time by 80%.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127013279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jie Wang, Yuewu Wang, Lingguang Lei, Kun Sun, Jiwu Jing, Quan Zhou
{"title":"TrustICT","authors":"Jie Wang, Yuewu Wang, Lingguang Lei, Kun Sun, Jiwu Jing, Quan Zhou","doi":"10.1145/3384419.3430718","DOIUrl":"https://doi.org/10.1145/3384419.3430718","url":null,"abstract":"The Trusted Execution Environment (TEE) has been widely used to protect the security-sensitive sensing systems on Internet-of-Thing (IoT) devices. In the TEE systems, the execution environment is securely divided into a normal domain and a higher privileged secure domain which executing sensing systems through hardware. One common way to achieve the protection is implementing the sensitive functions of the sensing systems as trusted applications (TAs) in the well-isolated secure domain. Users in rich OS have to call TAs through the client applications (CAs), and the invocations must pass through the rich OS kernel. However, an untrusted rich OS may launch man-in-the-middle attacks on the communication between the CAs and TAs, and the misuse of cross-domain communication channel is becoming one severe threat on the TEE systems. In this paper, we develop a defense system named TrustICT to construct a lightweight trusted interaction channel between CAs and TAs without modifying existing TEE architecture. The main idea is to block attacks on the cross-domain interactions via dynamically setting the access permission of domain-shared memory, locking it from kernel mode and unlocking it only to legal CAs in the user mode. Particularly, we propose a multi-core scheduling strategy to defeat potential attacks from all privileged cores. Compared to existing cryptography-based methods, TrustICT dramatically reduces the system overhead since it does not require time-consuming cryptographic computation or sophisticated real-time kernel protection. We implement a prototype of TrustICT on a Freescale i.MX6Quad platform with the OP-TEE software system and evaluate its impacts on rich OS and the cross-domain transactions.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114792097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ye Gao, Meiyi Ma, Kristin D. Gordon, K. Rose, Hongning Wang, J. Stankovic
{"title":"A monitoring, modeling, and interactive recommendation system for in-home caregivers: demo abstract","authors":"Ye Gao, Meiyi Ma, Kristin D. Gordon, K. Rose, Hongning Wang, J. Stankovic","doi":"10.1145/3384419.3430422","DOIUrl":"https://doi.org/10.1145/3384419.3430422","url":null,"abstract":"Family caregivers often report increased anxiety and depression. In order to improve the interactions between in-home patients and caregivers, and reduce strain on caregivers, we build a monitoring, modeling, and interactive recommendation system for caregivers for in-home dementia patient care. The system includes monitoring for mood by speech, building classifiers that work in realistic home settings, and supporting an adaptive recommendation system to reduce stress of the caregiver. This demo shows how our system supports caregivers in practice through several scenarios.","PeriodicalId":309149,"journal":{"name":"Proceedings of the 18th Conference on Embedded Networked Sensor Systems","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121856796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}