{"title":"Performance Improvement of Hadoop ext4-based Disk I/O","authors":"Makoto Nakagami, J. Fortes, Saneyasu Yamaguchi","doi":"10.1109/CANDAR51075.2020.00032","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00032","url":null,"abstract":"Hadoop is one of the most popular big-data analytics platforms, often relying on hard disk drives for storage of big-data amounts that exceed the capacity of solid-state drives. Unlike other data-intensive applications, such as database management systems, big-data processing jobs frequently require extensive sequential I/O requests. Previously proposed methods for improving sequential I/O performance modified the block usage bitmap of the Ext2/3 filesystem in order to actively use the faster disk zones, which are the outer zones in each hard disk drive. However, these methods do not support Ext4, which is the current version of Ext filesystems. In this paper, we discuss a method for improving the sequential I/O performance of the Ext4 filesystem. First, we evaluate the sequential file access throughputs on Ext3, Ext4, and XFS filesystems. We point out that Ext4 does not actively utilize the area freed by deleting existing files, causing declines in file access performance. Second, we propose a method for improving the Ext4 sequential file access performance. The improved Ext4 actively utilizes the faster zones of storage devices by controlling file placement location. Third, we evaluate the proposed filesystem and show that it outperforms existing filesystems. In the case of TeraSort, Hadoop with the proposed Ext4 filesystem performs better than when using the original Ext4 filesystem by as much as 30.1%.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116776417","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Virtual Machine Monitor-based Hiding Method for Access to Debug Registers","authors":"Masaya Sato, H. Taniguchi, Ryosuke Nakamura","doi":"10.1109/CANDAR51075.2020.00036","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00036","url":null,"abstract":"To secure a guest operating system running on a virtual machine (VM), a monitoring method using hardware breakpoints by a virtual machine monitor is required. However, debug registers are visible to guest operating systems; thus, malicious programs on a guest operating system can detect or disable the monitoring method. This paper presents a method to hide access to debug registers from programs running on a VM. Our proposed method detects programs’ access to debug registers and disguises the access as having succeeded. The register’s actual value is not visible or modifiable to programs, so the monitoring method is hidden. This paper presents the basic design and evaluation results of our method.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132546299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haruki Ishizaki, Ryohei Saka, Eitaro Kohno, Y. Kakuda
{"title":"On the Loop Suppression Method by Utilizing Information of Master Terminals for Neighboring Terminals in Bluetooth MANETs","authors":"Haruki Ishizaki, Ryohei Saka, Eitaro Kohno, Y. Kakuda","doi":"10.1109/CANDAR51075.2020.00025","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00025","url":null,"abstract":"Bluetooth MANETs are ad hoc networks consist of mobile terminals using Bluetooth. Recently, a fast connection-establishment method between terminals in piconets has been proposed. In the existing method, however, as the density of terminals increases, the existing method can generate many connections between the slaves in the piconets and can easily form loops. Since Bluetooth MANETs utilize flooding for data packet forwarding, the amount of data packets increases due to the loops. In this paper, we propose a method to control excessive connection-establishment between slave terminals in piconets for Bluetooth MANETs to suppress the loops. In order to suppress the loops, our proposed method considers information of master terminals for neighboring terminals. From the simulation experiments, we have confirmed that our proposed method can suppress the number of loops regardless of the terminal density, and our proposed method also can suppress the amount of data packets while keeping the time to complete the dissemination of data packets at the same level as the existing method.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134545637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shungo Kumazawa, Kazushi Kawamura, Thiem Van Chu, M. Motomura, Jaehoon Yu
{"title":"ExtraFerns: Fully Parallel Ensemble Learning Technique with Non-Greedy yet Minimal Memory Access Training","authors":"Shungo Kumazawa, Kazushi Kawamura, Thiem Van Chu, M. Motomura, Jaehoon Yu","doi":"10.1109/CANDAR51075.2020.00027","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00027","url":null,"abstract":"Training machine learning models on edge devices is always a conflict with power consumption and computing cost. This paper proposes a hardware-oriented training method called extraFerns for a unique subset of decision tree ensembles, which drastically decreases memory access and optimizes each tree in parallel. The extraFerns gets the best of both worlds: extraTrees and randomFerns. As extraTrees does, it generates nodes by randomly selecting attributes and generating thresholds. After that, as randomFerns does, it builds ferns that are decision trees sharing an identical node in each depth. In contrast to other ensemble methods using greedy optimization, extraFerns try searching global optimization of each fern. The experimental results show that extraFerns requires only 4.3% and 4.1% memory access for training models with 3.0% and 1.2% accuracy drop compared with randomForest and extraTrees, respectively.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128830228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bandit-based Run-time Adaptation of Cache Replacement Policies in Content Management Systems","authors":"Srivattsan Sridharan, Shravan Gaonkar, J. Fortes","doi":"10.1109/CANDAR51075.2020.00017","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00017","url":null,"abstract":"Web traffic is increasingly complex, in terms of both content accessed and geographical distribution of requests. Content providers usually employ geographically distributed web-caches to reduce latency in delivering content. A web-cache configured with a single replacement policy cannot provide optimal performance due to the inherent variability associated with the request pattern. We describe an adaptation mechanism (DETACH) that utilizes a multi-armed bandit approach to adapt the replacement policy depending on a new metric, the rank of evicted objects, which indirectly characterizes run-time request patterns. The proposed mechanism requires very minimal modifications to existing cache systems and does not maintain any history (ghost entries). We also describe the implementation of a cache system that uses the proposed mechanism to adapt the replacement policy at runtime. We consider two replacement policies, LRU and LFU, but the system is expandable to other policies. Our experiments with various datasets show that the system adapts quickly to the best performing replacement policy. We compare the performance of the system to a recently proposed approach called LeCaR, and baseline LRU and LFU policies. Of the 7 datasets used on our experiments, DETACH outperformed LeCaR in 4 of them by up to a factor of two. In the remaining 3 datasets LeCaR outperformed DETACH by up to 5%. Our proposed system consistently outperforms the baseline LRU and LFU replacement policies for all the datasets.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127136627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ángel Dacal-Nieto, J. J. Areal, Miguel García-Fernández, Marcos Lluch
{"title":"Use cases and success stories of a data analytics system in an automotive Paint Shop","authors":"Ángel Dacal-Nieto, J. J. Areal, Miguel García-Fernández, Marcos Lluch","doi":"10.1109/CANDAR51075.2020.00019","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00019","url":null,"abstract":"Manufacturing companies are currently developing transformation plans from the 3.0 paradigm, based on automation, robotics and Lean, to the 4.0 approach, based on digitalization of production and data exploitation. In this paper, a specific case of an automotive factory digital transformation is presented, including the description of a roadmap, an architecture, and a first set of analyses regarding quality, reliability and predictive maintenance in the Paint Shop. Data gathering, data visualization and statistical control are also commented. Some of the success stories include reduction of defect rates, optimization of processes and early detection of deviation of parameters, by using Artificial Intelligence algorithms on datasets with thousands of variables and hundreds of thousands of produced cars. These actions have meant savings for the factory, as well as productivity and efficiency improvements, showing that it is possible to obtain short-term victories while implementing a long-term tool. This methodology is currently being transferred to the rest of the factory, including stamping, body in white and assembly line.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123959841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An In-Network Parameter Aggregation using DPDK for Multi-GPU Deep Learning","authors":"Masaki Furukawa, Tomoya Itsubo, Hiroki Matsutani","doi":"10.1109/CANDAR51075.2020.00021","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00021","url":null,"abstract":"In distributed deep neural network using remote GPU nodes, communication occurs iteratively between remote nodes for gradient aggregation. This communication latency limits the benefit of distributed training with faster GPUs. In distributed deep learning using the remote GPUs, workload of gradient aggregation is imposed on a host machine. In this paper, we therefore propose to offload the gradient aggregation to a DPDK (Data Plane Development Kit) based network switch between the host machine and remote GPUs. In this approach, the aggregation process is completed in the network using extra computation resources in the network switch. We evaluate the proposed switch when GPUs and the host communicate with a standard IP communication and a PCI Express (PCIe) over 40Gbit Ethernet (40GbE) product, respectively. The evaluation results using a standard IP communication show that the aggregation is accelerated by 2.2-2.5x compared to the aggregation executed by a host machine. The results using the PCIe over 40GbE product show that the proposed switch outperforms the aggregation done by the host machine by 1.16x. This approach is thus useful for distributed training with multiple GPUs.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133473767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"[Title page i]","authors":"","doi":"10.1109/candar51075.2020.00001","DOIUrl":"https://doi.org/10.1109/candar51075.2020.00001","url":null,"abstract":"","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127584755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Maximum Expressive Number of Threshold Neural Networks","authors":"Kenta Inoue","doi":"10.1109/CANDAR51075.2020.00023","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00023","url":null,"abstract":"Expressive power of neural networks is one of important factors for understanding machine learning. It is wellknown that a deeper neural network also has much higher expressive power than shallower one experimentally, but the difference in expressive powers between activation functions and theoretical explanation have still not been clear. In this paper, we focus on the expressive power of neural networks with threshold activation function and study it by an index of expressive power named \"expressive number\". Expressive number gives us a type of theoretical limit of learning and enable us to compare expressive powers of different activation functions easily. In this paper, we find the exact value of the maximum expressive number of threshold neural networks, and prove it. Our result suggests deeper neural networks do not always have higher expressive power, and in some cases, rather shallower neural networks have higher expressive power than deeper one.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"179 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122333417","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Efficient GPU Implementation for Solving the Maximum Independent Set Problem","authors":"Tomohiro Imanaga, K. Nakano, Masaki Tao, Ryota Yasudo, Yasuaki Ito, Yuya Kawamata, Ryota Katsuki, Yusuke Tabata, Takashi Yazane, Kenichiro Hamano","doi":"10.1109/CANDAR51075.2020.00012","DOIUrl":"https://doi.org/10.1109/CANDAR51075.2020.00012","url":null,"abstract":"An independent set of a graph is a subset of the nodes such that no two nodes in it are adjacent. The maximum independent set (MIS) problem is an optimization problem to find an independent set with the largest possible number of nodes. Since the MIS problem is NP-hard, finding optimal solutions for large graphs is quite difficult and approximation or heuristic algorithms are used to find independent sets as large as possible. The main contribution of this paper is to present an annealing-based parallel heuristic algorithm for finding approximate solutions for the MIS problem. We have implemented it to run on a computing server with multiple GPUs. The performance of our GPU implementation is compared with the other approaches including a GPU QUBO solver, Gurobi optimizer running on an Intel multicore server, and D-wave 2000Q quantum annealer. The experimental results for random graphs show that our GPU implementation for the MIS problem can find optimal or better solutions than the other approaches. In particular, for small random graphs with 128 nodes or less, our GPU implementation can find optimal solutions of the MIS problem in less than 20µs, while the other approaches take more than 10ms. Further, for large regular random graphs with 32M nodes, our GPU implementation can obtain 22.6%-38.5% larger independent sets. Thus, our parallel GPU implementation for solving the MIS problem is a potent approach to solve the MIS problem.","PeriodicalId":215489,"journal":{"name":"2020 Eighth International Symposium on Computing and Networking (CANDAR)","volume":"157 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115681818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}