Accurately Identify and Localize Commodity Devices from Encrypted Smart Home Traffic

Xing Guo, Jie Quan, Jiahui Hou, Hao Zhou, Xin He, Tao He
{"title":"Accurately Identify and Localize Commodity Devices from Encrypted Smart Home Traffic","authors":"Xing Guo, Jie Quan, Jiahui Hou, Hao Zhou, Xin He, Tao He","doi":"10.1109/MSN57253.2022.00109","DOIUrl":null,"url":null,"abstract":"Nowadays, Internet of Things (IoT) based smart home system is equipped with a large number of smart devices, such as smart speakers and cameras, which can greatly facilitate users to control and automate their home environment. However, recent studies have shown that smart home system is at great risk of privacy leakage. Especially, external attackers can infer user privacy information by passively sniffing encrypted smart home network traffic. Traditional methods mainly focus on sniffing WiFi devices but pay less attention to other commodity devices such as Zigbee and Bluetooth (BLE). In this paper, we focus on inferring fine-grained sensitive details about users using diverse commodity devices. We apply deep learning techniques to infer users' behaviors through identifying and localizing smart home devices being used due to the excellent performance of deep learning in many fields. Specifically, we first pre-process encrypted device traffic, select valid features, and use Convolutional Neural Networks (CNN) for device identification. In addition, we extract the Received Signal Strength Indicator (RSSI) from the frame information of traffic packets and employ Sparse Autoencoder (SAE) to extract stable and distinguishable high-dimensional features for RSSI measurement. Features are fed into a Multilayer Perceptron (MLP) to predict the device's localization. In this way, we can infer human activity by identifying and localizing the devices being used. Extensive experiment results show that our work can achieve a mean position estimation error of 1.34m even in an unseen environment, outperforming other common- used localization algorithms based on RSSI fingerprints.","PeriodicalId":114459,"journal":{"name":"2022 18th International Conference on Mobility, Sensing and Networking (MSN)","volume":"52 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 18th International Conference on Mobility, Sensing and Networking (MSN)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MSN57253.2022.00109","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Nowadays, Internet of Things (IoT) based smart home system is equipped with a large number of smart devices, such as smart speakers and cameras, which can greatly facilitate users to control and automate their home environment. However, recent studies have shown that smart home system is at great risk of privacy leakage. Especially, external attackers can infer user privacy information by passively sniffing encrypted smart home network traffic. Traditional methods mainly focus on sniffing WiFi devices but pay less attention to other commodity devices such as Zigbee and Bluetooth (BLE). In this paper, we focus on inferring fine-grained sensitive details about users using diverse commodity devices. We apply deep learning techniques to infer users' behaviors through identifying and localizing smart home devices being used due to the excellent performance of deep learning in many fields. Specifically, we first pre-process encrypted device traffic, select valid features, and use Convolutional Neural Networks (CNN) for device identification. In addition, we extract the Received Signal Strength Indicator (RSSI) from the frame information of traffic packets and employ Sparse Autoencoder (SAE) to extract stable and distinguishable high-dimensional features for RSSI measurement. Features are fed into a Multilayer Perceptron (MLP) to predict the device's localization. In this way, we can infer human activity by identifying and localizing the devices being used. Extensive experiment results show that our work can achieve a mean position estimation error of 1.34m even in an unseen environment, outperforming other common- used localization algorithms based on RSSI fingerprints.
从加密的智能家居流量中准确识别和定位商品设备
如今,基于物联网(IoT)的智能家居系统配备了大量智能设备,如智能扬声器和智能摄像头,可以极大地方便用户控制和自动化他们的家庭环境。然而,最近的研究表明,智能家居系统存在很大的隐私泄露风险。特别是,外部攻击者可以通过被动嗅探加密的智能家庭网络流量来推断用户隐私信息。传统的方法主要集中在嗅探WiFi设备,而很少关注其他商品设备,如Zigbee和蓝牙(BLE)。在本文中,我们专注于推断用户使用不同商品设备的细粒度敏感细节。由于深度学习在许多领域的优异表现,我们应用深度学习技术通过识别和定位正在使用的智能家居设备来推断用户的行为。具体来说,我们首先预处理加密的设备流量,选择有效的特征,并使用卷积神经网络(CNN)进行设备识别。此外,我们从流量数据包的帧信息中提取接收信号强度指标(RSSI),并采用稀疏自编码器(SAE)提取稳定且可区分的高维特征用于RSSI测量。特征被输入多层感知器(MLP)来预测设备的定位。通过这种方式,我们可以通过识别和定位正在使用的设备来推断人类活动。大量的实验结果表明,即使在不可见的环境下,我们的工作也可以实现1.34m的平均位置估计误差,优于其他常用的基于RSSI指纹的定位算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信