IEEE Transactions on Services Computing最新文献

筛选
英文 中文
TPI-LLM: Serving 70B-Scale LLMs Efficiently on Low-Resource Mobile Devices TPI-LLM:在低资源移动设备上高效地服务70b级llm
IF 5.8 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-08-08 DOI: 10.1109/TSC.2025.3596892
Zonghang Li;Wenjiao Feng;Mohsen Guizani;Hongfang Yu
{"title":"TPI-LLM: Serving 70B-Scale LLMs Efficiently on Low-Resource Mobile Devices","authors":"Zonghang Li;Wenjiao Feng;Mohsen Guizani;Hongfang Yu","doi":"10.1109/TSC.2025.3596892","DOIUrl":"https://doi.org/10.1109/TSC.2025.3596892","url":null,"abstract":"LLM serving is shifting from cloud to edge due to privacy concerns over user interaction data. However, mobile devices struggle with very limited computing power and memory, requiring collaboration among multiple devices to run LLM apps. The mainstream solution, pipeline parallelism, is inefficient for such cases because mobile devices typically run only one inference task at a time. This article argues that tensor parallelism, despite its high communication cost, can better fit such scenarios. We introduce TPI-LLM, a compute and memory-efficient tensor parallel inference system designed to run 70B-scale LLMs on low-resource mobile devices. It keeps sensitive raw data local on users’ devices and employs a sliding window memory scheduler to dynamically manage layer weights. It overlaps disk I/O with computation and communication, enabling efficient operation of large models on memory-limited devices. Extensive experiments show that TPI-LLM reduces token latency by 80%–90% compared to Transformers, Accelerate, and Galaxy. It also cuts the peak memory footprint by 90%, requiring just 3.1 GiB of memory for 70B-scale models.","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"18 5","pages":"3321-3333"},"PeriodicalIF":5.8,"publicationDate":"2025-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145248073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IRS-Assisted Hyperspectral Image Processing in Satellite Edge Computing Services 卫星边缘计算服务中irs辅助高光谱图像处理
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-08-04 DOI: 10.1109/tsc.2025.3595166
Xiaoteng Yang, Jie Feng, Lei Liu, Qingqi Pei, Shahid Mumtaz, Keqin Li, Schahram Dustdar
{"title":"IRS-Assisted Hyperspectral Image Processing in Satellite Edge Computing Services","authors":"Xiaoteng Yang, Jie Feng, Lei Liu, Qingqi Pei, Shahid Mumtaz, Keqin Li, Schahram Dustdar","doi":"10.1109/tsc.2025.3595166","DOIUrl":"https://doi.org/10.1109/tsc.2025.3595166","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"29 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144778233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
E-Log: Fine-Grained Elastic Log-Based Anomaly Detection and Diagnosis for Databases E-Log:基于细粒度弹性日志的数据库异常检测与诊断
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-08-01 DOI: 10.1109/tsc.2025.3594870
Lingzhe Zhang, Tong Jia, Xinyu Tan, Xiangdong Huang, Mengxi Jia, Hongyi Liu, Zhonghai Wu, Ying Li
{"title":"E-Log: Fine-Grained Elastic Log-Based Anomaly Detection and Diagnosis for Databases","authors":"Lingzhe Zhang, Tong Jia, Xinyu Tan, Xiangdong Huang, Mengxi Jia, Hongyi Liu, Zhonghai Wu, Ying Li","doi":"10.1109/tsc.2025.3594870","DOIUrl":"https://doi.org/10.1109/tsc.2025.3594870","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"31 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144763230","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multi-Objective Unlearning in Recommender Systems via Preference Guided Pareto Exploration 基于偏好引导Pareto探索的推荐系统多目标遗忘
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-07-31 DOI: 10.1109/tsc.2025.3593906
Yuyuan Li, Yizhao Zhang, Weiming Liu, Xiaohua Feng, Zhongxuan Han, Chaochao Chen, Chenggang Yan
{"title":"Multi-Objective Unlearning in Recommender Systems via Preference Guided Pareto Exploration","authors":"Yuyuan Li, Yizhao Zhang, Weiming Liu, Xiaohua Feng, Zhongxuan Han, Chaochao Chen, Chenggang Yan","doi":"10.1109/tsc.2025.3593906","DOIUrl":"https://doi.org/10.1109/tsc.2025.3593906","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"1 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144755938","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data-Locality-Aware Task Assignment and Scheduling for Distributed Job Executions 分布式作业执行的数据位置感知任务分配和调度
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-07-31 DOI: 10.1109/tsc.2025.3594158
Hailiang Zhao, Xueyan Tang, Peng Chen, Jianwei Yin, Shuiguang Deng
{"title":"Data-Locality-Aware Task Assignment and Scheduling for Distributed Job Executions","authors":"Hailiang Zhao, Xueyan Tang, Peng Chen, Jianwei Yin, Shuiguang Deng","doi":"10.1109/tsc.2025.3594158","DOIUrl":"https://doi.org/10.1109/tsc.2025.3594158","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"26 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144755937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
FrigateBird: Decoupling Metadata/Data Services for Continuously Fast Object Storage 为持续快速对象存储解耦元数据/数据服务
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-07-31 DOI: 10.1109/tsc.2025.3594340
Yiming Zhang, Kekun Hu, Gang Dong, Hailiang Chen, Rengang Li
{"title":"FrigateBird: Decoupling Metadata/Data Services for Continuously Fast Object Storage","authors":"Yiming Zhang, Kekun Hu, Gang Dong, Hailiang Chen, Rengang Li","doi":"10.1109/tsc.2025.3594340","DOIUrl":"https://doi.org/10.1109/tsc.2025.3594340","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"721 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144755935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ARMM: Sandwich-Attack Resilient Automated Market Maker ARMM:三明治攻击弹性自动做市商
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-07-30 DOI: 10.1109/tsc.2024.3376195
Shunrong Jiang, Jingwei Chen, Jinpeng Li, Zhihui Liu, Yonggang Li
{"title":"ARMM: Sandwich-Attack Resilient Automated Market Maker","authors":"Shunrong Jiang, Jingwei Chen, Jinpeng Li, Zhihui Liu, Yonggang Li","doi":"10.1109/tsc.2024.3376195","DOIUrl":"https://doi.org/10.1109/tsc.2024.3376195","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"140 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144747311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Effective Multi-Scale Contrastive Learning System for Online Group Recommendation Services in Event-Based Social Networks 基于事件的社交网络中在线群组推荐服务的多尺度对比学习系统
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-07-28 DOI: 10.1109/tsc.2025.3593346
Xiaomei Huang, Zhiheng Zhou, Jianjun Li, Neal N. Xiong, Yugen Yi, Jin Liu, Guoqiong Liao
{"title":"An Effective Multi-Scale Contrastive Learning System for Online Group Recommendation Services in Event-Based Social Networks","authors":"Xiaomei Huang, Zhiheng Zhou, Jianjun Li, Neal N. Xiong, Yugen Yi, Jin Liu, Guoqiong Liao","doi":"10.1109/tsc.2025.3593346","DOIUrl":"https://doi.org/10.1109/tsc.2025.3593346","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"11 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144736812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Learning to Hash for Time-aware QoS Prediction Based on VQ-VAE 基于VQ-VAE的时间感知QoS预测的深度学习哈希算法
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-07-25 DOI: 10.1109/tsc.2025.3592409
Lingzhen Kong, Xiyuan Hu, Lianyong Qi, Xiaolong Xu, Yiwen Zhang, Lina Yao, Xuyun Zhang
{"title":"Deep Learning to Hash for Time-aware QoS Prediction Based on VQ-VAE","authors":"Lingzhen Kong, Xiyuan Hu, Lianyong Qi, Xiaolong Xu, Yiwen Zhang, Lina Yao, Xuyun Zhang","doi":"10.1109/tsc.2025.3592409","DOIUrl":"https://doi.org/10.1109/tsc.2025.3592409","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"68 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144712336","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
CATScaler: A Convolution-Augmented Transformer Scaling Framework for Cloud-Native Applications CATScaler:一个用于云原生应用的卷积增强变压器缩放框架
IF 8.1 2区 计算机科学
IEEE Transactions on Services Computing Pub Date : 2025-07-24 DOI: 10.1109/tsc.2025.3592383
Fan'an Meng, Hongjun Dai, Guoqing Cong, Bo Zhu, Hailiang Zhao
{"title":"CATScaler: A Convolution-Augmented Transformer Scaling Framework for Cloud-Native Applications","authors":"Fan'an Meng, Hongjun Dai, Guoqing Cong, Bo Zhu, Hailiang Zhao","doi":"10.1109/tsc.2025.3592383","DOIUrl":"https://doi.org/10.1109/tsc.2025.3592383","url":null,"abstract":"","PeriodicalId":13255,"journal":{"name":"IEEE Transactions on Services Computing","volume":"21 1","pages":""},"PeriodicalIF":8.1,"publicationDate":"2025-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144701900","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信