Hyeokhyen Kwon;Chaitra Hegde;Yashar Kiarashi;Venkata Siva Krishna Madala;Ratan Singh;ArjunSinh Nakum;Robert Tweedy;Leandro Miletto Tonetto;Craig M. Zimring;Matthew Doiron;Amy D. Rodriguez;Allan I. Levey;Gari D. Clifford
{"title":"利用边缘计算的稀疏分布摄像机网络进行室内定位和多人跟踪的可行性研究","authors":"Hyeokhyen Kwon;Chaitra Hegde;Yashar Kiarashi;Venkata Siva Krishna Madala;Ratan Singh;ArjunSinh Nakum;Robert Tweedy;Leandro Miletto Tonetto;Craig M. Zimring;Matthew Doiron;Amy D. Rodriguez;Allan I. Levey;Gari D. Clifford","doi":"10.1109/JISPIN.2023.3337189","DOIUrl":null,"url":null,"abstract":"Camera-based activity monitoring systems are becoming an attractive solution for smart building applications with the advances in computer vision and edge computing technologies. In this article, we present a feasibility study and systematic analysis of a camera-based indoor localization and multiperson tracking system implemented on edge computing devices within a large indoor space. To this end, we deployed an end-to-end edge computing pipeline that utilizes multiple cameras to achieve localization, body orientation estimation, and tracking of multiple individuals within a large therapeutic space spanning \n<inline-formula><tex-math>$\\text{1700}\\, \\text{m}^{2}$</tex-math></inline-formula>\n, all while maintaining a strong focus on preserving privacy. Our pipeline consists of 39 edge computing camera systems equipped with tensor processing units (TPUs) placed in the indoor space's ceiling. To ensure the privacy of individuals, a real-time multiperson pose estimation algorithm runs on the TPU of the computing camera system. This algorithm extracts poses and bounding boxes, which are utilized for indoor localization, body orientation estimation, and multiperson tracking. Our pipeline demonstrated an average localization error of 1.41 m, a multiple-object tracking accuracy score of 88.6%, and a mean absolute body orientation error of 29\n<inline-formula><tex-math>$^{\\circ }$</tex-math></inline-formula>\n. These results show that localization and tracking of individuals in a large indoor space is feasible even with the privacy constrains.","PeriodicalId":100621,"journal":{"name":"IEEE Journal of Indoor and Seamless Positioning and Navigation","volume":"1 ","pages":"187-198"},"PeriodicalIF":0.0000,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10329418","citationCount":"0","resultStr":"{\"title\":\"A Feasibility Study on Indoor Localization and Multiperson Tracking Using Sparsely Distributed Camera Network With Edge Computing\",\"authors\":\"Hyeokhyen Kwon;Chaitra Hegde;Yashar Kiarashi;Venkata Siva Krishna Madala;Ratan Singh;ArjunSinh Nakum;Robert Tweedy;Leandro Miletto Tonetto;Craig M. Zimring;Matthew Doiron;Amy D. Rodriguez;Allan I. Levey;Gari D. Clifford\",\"doi\":\"10.1109/JISPIN.2023.3337189\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Camera-based activity monitoring systems are becoming an attractive solution for smart building applications with the advances in computer vision and edge computing technologies. In this article, we present a feasibility study and systematic analysis of a camera-based indoor localization and multiperson tracking system implemented on edge computing devices within a large indoor space. To this end, we deployed an end-to-end edge computing pipeline that utilizes multiple cameras to achieve localization, body orientation estimation, and tracking of multiple individuals within a large therapeutic space spanning \\n<inline-formula><tex-math>$\\\\text{1700}\\\\, \\\\text{m}^{2}$</tex-math></inline-formula>\\n, all while maintaining a strong focus on preserving privacy. Our pipeline consists of 39 edge computing camera systems equipped with tensor processing units (TPUs) placed in the indoor space's ceiling. To ensure the privacy of individuals, a real-time multiperson pose estimation algorithm runs on the TPU of the computing camera system. This algorithm extracts poses and bounding boxes, which are utilized for indoor localization, body orientation estimation, and multiperson tracking. Our pipeline demonstrated an average localization error of 1.41 m, a multiple-object tracking accuracy score of 88.6%, and a mean absolute body orientation error of 29\\n<inline-formula><tex-math>$^{\\\\circ }$</tex-math></inline-formula>\\n. These results show that localization and tracking of individuals in a large indoor space is feasible even with the privacy constrains.\",\"PeriodicalId\":100621,\"journal\":{\"name\":\"IEEE Journal of Indoor and Seamless Positioning and Navigation\",\"volume\":\"1 \",\"pages\":\"187-198\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-11-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10329418\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Indoor and Seamless Positioning and Navigation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10329418/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Indoor and Seamless Positioning and Navigation","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10329418/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Feasibility Study on Indoor Localization and Multiperson Tracking Using Sparsely Distributed Camera Network With Edge Computing
Camera-based activity monitoring systems are becoming an attractive solution for smart building applications with the advances in computer vision and edge computing technologies. In this article, we present a feasibility study and systematic analysis of a camera-based indoor localization and multiperson tracking system implemented on edge computing devices within a large indoor space. To this end, we deployed an end-to-end edge computing pipeline that utilizes multiple cameras to achieve localization, body orientation estimation, and tracking of multiple individuals within a large therapeutic space spanning
$\text{1700}\, \text{m}^{2}$
, all while maintaining a strong focus on preserving privacy. Our pipeline consists of 39 edge computing camera systems equipped with tensor processing units (TPUs) placed in the indoor space's ceiling. To ensure the privacy of individuals, a real-time multiperson pose estimation algorithm runs on the TPU of the computing camera system. This algorithm extracts poses and bounding boxes, which are utilized for indoor localization, body orientation estimation, and multiperson tracking. Our pipeline demonstrated an average localization error of 1.41 m, a multiple-object tracking accuracy score of 88.6%, and a mean absolute body orientation error of 29
$^{\circ }$
. These results show that localization and tracking of individuals in a large indoor space is feasible even with the privacy constrains.