Overhead Reduction in the Network Communication for Web Computing

Juil Oh, Ju-wook Jang, T. Han
{"title":"Overhead Reduction in the Network Communication for Web Computing","authors":"Juil Oh, Ju-wook Jang, T. Han","doi":"10.1142/S0129053300000114","DOIUrl":null,"url":null,"abstract":"One major source of overhead for conventional network communication is the involvement of operating system to allow for virtual sharing of the network interface card among applications and its processing of the UDP/TCP/IP headers on behalf of applications. The involvement of operating system results in overheads such as extra write/read operations to the kernel buffer through which each inbound/outbound messages should pass. Another overhead comes from scheduling which may hinder immdiate sending or receiving of messages to and from network interface buffer. Recently, U-Net over Fast Ethernet [9] addressed this problem and proposed a new scheme which circumvents the operating system in processing the network communication. However, since the approach has removed IP header and provides multiplexing in the ethernet layer, it is only applicable to an ethernet LAN. In this paper, we define a new protocol by which messages are allowed to move across routers and the virtual sharing of network interface card is supported with minimal overhead. In a word, we extended the U-Net over Fast Ethernet [9] beyond routers to WAN and hence opening a new way to exploit vast amount of computing resources all over Internet. With our protocol, cluster computing over any part of WAN is realizable as far as total delay caused by intervening routers is tolerable to the application. As a justification of our approach, we show a small part of WAN containing a router exhibits latency comparable to (differ by less than 1 ms) that of a shared ethernet. Another motivation for our approach is the observation that the aggregate bandwidth of two subnets (part of WAN) is greater than that of a single subnet (LAN). With same number of hosts, each connection will experience more available bandwidth with the part of WAN than the LAN. The experiment over WAN involving a router shows reduction of latency comparable to that of U-Net over Fast Ethernet.","PeriodicalId":270006,"journal":{"name":"Int. J. High Speed Comput.","volume":"57 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2000-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Int. J. High Speed Comput.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1142/S0129053300000114","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

One major source of overhead for conventional network communication is the involvement of operating system to allow for virtual sharing of the network interface card among applications and its processing of the UDP/TCP/IP headers on behalf of applications. The involvement of operating system results in overheads such as extra write/read operations to the kernel buffer through which each inbound/outbound messages should pass. Another overhead comes from scheduling which may hinder immdiate sending or receiving of messages to and from network interface buffer. Recently, U-Net over Fast Ethernet [9] addressed this problem and proposed a new scheme which circumvents the operating system in processing the network communication. However, since the approach has removed IP header and provides multiplexing in the ethernet layer, it is only applicable to an ethernet LAN. In this paper, we define a new protocol by which messages are allowed to move across routers and the virtual sharing of network interface card is supported with minimal overhead. In a word, we extended the U-Net over Fast Ethernet [9] beyond routers to WAN and hence opening a new way to exploit vast amount of computing resources all over Internet. With our protocol, cluster computing over any part of WAN is realizable as far as total delay caused by intervening routers is tolerable to the application. As a justification of our approach, we show a small part of WAN containing a router exhibits latency comparable to (differ by less than 1 ms) that of a shared ethernet. Another motivation for our approach is the observation that the aggregate bandwidth of two subnets (part of WAN) is greater than that of a single subnet (LAN). With same number of hosts, each connection will experience more available bandwidth with the part of WAN than the LAN. The experiment over WAN involving a router shows reduction of latency comparable to that of U-Net over Fast Ethernet.
Web计算中网络通信开销的降低
传统网络通信开销的一个主要来源是操作系统的介入,它允许在应用程序之间虚拟共享网络接口卡,并代表应用程序处理UDP/TCP/IP报头。操作系统的介入会导致额外的开销,例如对内核缓冲区的额外写/读操作,每个入站/出站消息都应该通过内核缓冲区。另一个开销来自调度,这可能会阻碍从网络接口缓冲区发送或接收消息。最近,U-Net over Fast Ethernet[9]解决了这一问题,提出了一种绕过操作系统处理网络通信的新方案。但是,由于该方法去掉了IP报头,并在以太网层提供了多路复用,因此只适用于以太网局域网。在本文中,我们定义了一个新的协议,该协议允许消息在路由器之间移动,并以最小的开销支持网络接口卡的虚拟共享。总之,我们将U-Net通过快速以太网[9]从路由器扩展到广域网,从而开辟了一种利用互联网上大量计算资源的新途径。使用我们的协议,只要应用程序可以容忍由中间路由器引起的总延迟,就可以实现广域网上任何部分的集群计算。为了证明我们的方法,我们展示了一小部分包含路由器的广域网的延迟与共享以太网的延迟相当(相差不到1毫秒)。我们采用这种方法的另一个动机是观察到两个子网(WAN的一部分)的总带宽大于单个子网(LAN)的总带宽。对于相同数量的主机,每个连接将体验到WAN部分比LAN部分更多的可用带宽。在广域网上进行的涉及路由器的实验显示,与U-Net在快速以太网上的延迟减少相当。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信