{"title":"Some New Observations on SLO-aware Edge Stream Processing","authors":"Amna Shahid, Peng Kang, P. Lama, S. Khan","doi":"10.1109/CloudSummit57601.2023.00011","DOIUrl":"https://doi.org/10.1109/CloudSummit57601.2023.00011","url":null,"abstract":"The emergence of edge stream processing has created a new way of processing real-time data from the Internet of Things (IoT), which comprises a plethora of geographically dispersed physical devices equipped with sensors and actuators that exchange data with the Cloud. Nevertheless, edge stream processing systems face new challenges, including dynamic workloads, resource limitations, and multi-tenant application hosting. Adaptive resource management has been proposed to address these issues. However, this technique may lead to Service Level Objective (SLO) violations when the system encounters resource constraints. To mitigate this problem, we investigate the benefits of using priority-based stream data to reduce the SLO violations associated with adaptive resource management. Our findings demonstrate that segregating data according to their priority levels and processing them accordingly can significantly enhance the efficiency and stability of the system. We implemented this technique on the Storm Streaming system and used RIOT as a benchmark, employing VRebalance and other approaches to adjust system resources dynamically.","PeriodicalId":185645,"journal":{"name":"2023 IEEE Cloud Summit","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116551052","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-Tenant Deep Learning Acceleration with Competitive GPU Resource Sharing","authors":"Yongbo Yu, Xiang Chen","doi":"10.1109/CloudSummit57601.2023.00014","DOIUrl":"https://doi.org/10.1109/CloudSummit57601.2023.00014","url":null,"abstract":"As Deep Learning (DL) continues to drive a variety of applications in edge and cloud data centers, co-locating multiple DL models onto the same GPU become widely deployed to improve resource utilization, and achieve acceleration. For example, a self-driving system hosts multiple tasks simultaneously (e.g., detection, classification, segmentation, etc.) and expects concurrent computing on one single device. However, our analysis demonstrates that, when deploying compound DNN models for multiple tenants on a GPU, certain issues arise: As different models’ structure heterogeneities and skewed data distributions, corresponding models cause highly imbalanced computing workloads. However, current GPU scheduling methods lack effective resource allocations. To address these issues, we propose a novel resource allocation method – competitive resource sharing, which is beneficial for parallel model executions, and the proposed concept of “virtual resource” could effectively characterize and guide the practical per-task resource utilization and allocation. Our experiments demonstrate that the DNN computing throughput could be significantly escalated by $2.16 times sim 2.80 times$ in various multitenant scenarios.","PeriodicalId":185645,"journal":{"name":"2023 IEEE Cloud Summit","volume":"8 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117336936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Geofencing Implement For Self-Monitoring Wandering Behavior And Sharing Location In Realtime With Firebase","authors":"Dennis Flynn, H. Kimm","doi":"10.1109/CloudSummit57601.2023.00020","DOIUrl":"https://doi.org/10.1109/CloudSummit57601.2023.00020","url":null,"abstract":"Geofencing is an advanced technique that collects geolocation data in order to test whether a path of travel has crossed into or out of a geographical area represented by a geometric shape. The Firebase Backend-as-a-Service (Baas) supports Android applications with data store and realtime share capabilities. These techniques are applied in location based services and areas of human activity recognition research, especially for problems in medicine like dementia/Alzheimer patients, HIV transmission prevention, and monitoring COVID-19 patients’ movements. In this paper, we present an Android application with a two-stage geofencing trigger used to initiate communication with the Firebase BaaS and trigger features that address wandering behavior in geriatric healthcare patients. The proposed tool uses the Android Location API, the Google Maps SDK and the Firebase BaaS. In order to integrate geofencing into our existing Firebase feature platform, this paper investigates use of the Android Location Library’s Geofence. Our toolchain and methods for analyzing geofence location data to address wandering behavior were preferred after review of related research and comparison with existing commercial solutions. Lastly, our geofence integration tool is developed, implemented and field-tested in order to calibrate user options for the primary geofence parameters. We also provide analysis and discussion of our geofencing optimizations in the context of geriatric healthcare.","PeriodicalId":185645,"journal":{"name":"2023 IEEE Cloud Summit","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121648725","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Chen Yuli, Songwu Shen, Wang Yuan, Zhu Tong, Mannepalli Veerendranath
{"title":"Providing Reliable Services for Hardware Cryptography Accelerator in Virtualization","authors":"Chen Yuli, Songwu Shen, Wang Yuan, Zhu Tong, Mannepalli Veerendranath","doi":"10.1109/CloudSummit57601.2023.00018","DOIUrl":"https://doi.org/10.1109/CloudSummit57601.2023.00018","url":null,"abstract":"Hardware Cryptography Accelerator has been used as a cost saving solution to provide services for web servers which face high computational consumption from SSL/TLS processing in Cloud Computing. However, services provided by the hardware accelerator can’t be continuous during hardware maintenance phases in virtualized environment. To provide reliable(24*365) services in cloud, we introduce a “Crypto Fallback Architecture for Virtualization” that combines the hypervisor, VM(Virtual Machine) and hardware. Our solution has been deployed successfully on Intel® QuickAssist Technology (QAT) which are used widely by Microsoft, Facebook, Alibaba and so on. The evaluation shows that our solution could provide reliable services for nginx/openssl in the cloud.","PeriodicalId":185645,"journal":{"name":"2023 IEEE Cloud Summit","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115351122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Larry Zhou, Jordan Lambert, Yanyan Zheng, Zheng Li, Alan Yen, Sandra Liu, Vivian Ye, Maggie Zhou, D. Mahar, J. Gibbons, M. Satterlee
{"title":"Distributed Scalable Edge Computing Infrastructure for Open Metaverse","authors":"Larry Zhou, Jordan Lambert, Yanyan Zheng, Zheng Li, Alan Yen, Sandra Liu, Vivian Ye, Maggie Zhou, D. Mahar, J. Gibbons, M. Satterlee","doi":"10.1109/CloudSummit57601.2023.00007","DOIUrl":"https://doi.org/10.1109/CloudSummit57601.2023.00007","url":null,"abstract":"In order to create and distribute the immense computing power required for the Metaverse, the industry must make strategic investments. AT&T believes that networking and edge computing are among the most essential components of a successful Metaverse ecosystem. AT&T proposes an “end-toend distributed edge computing network infrastructure” using its innovative uCPE [1] Whitebox platform. This innovation includes GPU virtualization, low-latency graphic rendering at the edge, and real-time streaming of 3D immersive content to end users. The groundbreaking design leverages existing wireless/wired home networks to create an overlay network that offloads heavy computing from head-mounted displays (HMDs) to the edge uCPE and distributes the virtual computing power to every end user with high scalability and low costs. In addition, AT&T introduces hardware and software probes to proactively monitor the end-to-end network performance with fault detection and self-healing capabilities, optimizing network paths and providing an uninterrupted immersive experience to users.","PeriodicalId":185645,"journal":{"name":"2023 IEEE Cloud Summit","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129609852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Quantum-based Distributed Algorithms for Edge Node Placement and Workload Allocation","authors":"Duong The Do, Ni Trieu, D. Nguyen","doi":"10.1109/CloudSummit57601.2023.00015","DOIUrl":"https://doi.org/10.1109/CloudSummit57601.2023.00015","url":null,"abstract":"Edge computing is a promising technology that offers a superior user experience and enables various innovative Internet of Things applications. In this paper, we present a mixed-integer linear programming (MILP) model for optimal edge server placement and workload allocation, which is known to be NP-hard. To this end, we explore the possibility of addressing this computationally challenging problem using quantum computing. However, existing quantum solvers are limited to solving unconstrained binary programming problems. To overcome this obstacle, we propose a hybrid quantum-classical solution that decomposes the original problem into a quadratic unconstrained binary optimization (QUBO) problem and a linear program (LP) subproblem. The QUBO problem can be solved by a quantum solver, while the LP subproblem can be solved using traditional LP solvers. Our numerical experiments demonstrate the practicality of leveraging quantum supremacy to solve complex optimization problems in edge computing.","PeriodicalId":185645,"journal":{"name":"2023 IEEE Cloud Summit","volume":"150 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115128723","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}