{"title":"TaskRouter:一个新设计的在线数据处理框架","authors":"M. Gu, K. Zhu, Fei Li, W. Shen","doi":"10.1109/RTC.2016.7543088","DOIUrl":null,"url":null,"abstract":"TaskRouter is a newly designed framework for distributed computing. It can be used to develop online processing system for High Energy Physics experiments. The framework takes the responsibility of data transmission. Users can determine how data being processed and routed on each node by implementing a single callback interface. One or more backup slaves can be configured for critical nodes in TaskRouter system. The processing procedure can recover from any single-point failure without data loss. TaskRouter is flexible, easy to use and with high availability. This paper presents the core design and implementation of TaskRouter. For function and performance test, a dummy online processing software based on TaskRouter is developed.","PeriodicalId":383702,"journal":{"name":"2016 IEEE-NPSS Real Time Conference (RT)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"TaskRouter: A newly designed online data processing framework\",\"authors\":\"M. Gu, K. Zhu, Fei Li, W. Shen\",\"doi\":\"10.1109/RTC.2016.7543088\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"TaskRouter is a newly designed framework for distributed computing. It can be used to develop online processing system for High Energy Physics experiments. The framework takes the responsibility of data transmission. Users can determine how data being processed and routed on each node by implementing a single callback interface. One or more backup slaves can be configured for critical nodes in TaskRouter system. The processing procedure can recover from any single-point failure without data loss. TaskRouter is flexible, easy to use and with high availability. This paper presents the core design and implementation of TaskRouter. For function and performance test, a dummy online processing software based on TaskRouter is developed.\",\"PeriodicalId\":383702,\"journal\":{\"name\":\"2016 IEEE-NPSS Real Time Conference (RT)\",\"volume\":\"15 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-06-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2016 IEEE-NPSS Real Time Conference (RT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/RTC.2016.7543088\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 IEEE-NPSS Real Time Conference (RT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/RTC.2016.7543088","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
TaskRouter: A newly designed online data processing framework
TaskRouter is a newly designed framework for distributed computing. It can be used to develop online processing system for High Energy Physics experiments. The framework takes the responsibility of data transmission. Users can determine how data being processed and routed on each node by implementing a single callback interface. One or more backup slaves can be configured for critical nodes in TaskRouter system. The processing procedure can recover from any single-point failure without data loss. TaskRouter is flexible, easy to use and with high availability. This paper presents the core design and implementation of TaskRouter. For function and performance test, a dummy online processing software based on TaskRouter is developed.