2022 7th International Conference on Business and Industrial Research (ICBIR)最新文献_第10页

Ensemble Compressed Language Model Based on Knowledge Distillation and Multi-Task Learning 基于知识蒸馏和多任务学习的集成压缩语言模型

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786508

Kun Xiang, Akihiro Fujii

{"title":"Ensemble Compressed Language Model Based on Knowledge Distillation and Multi-Task Learning","authors":"Kun Xiang, Akihiro Fujii","doi":"10.1109/ICBIR54589.2022.9786508","DOIUrl":"https://doi.org/10.1109/ICBIR54589.2022.9786508","url":null,"abstract":"The success of pre-trained language representation models such as BERT benefits from their “overparameterized” nature, resulting in training time consuming, high computational complexity and superior requirement of devices. Among the variety of model compression and acceleration techniques, Knowledge Distillation(KD) has attracted extensive attention for compressing pre-trained language models. However, the major two challenges for KD are: (i)Transfer more knowledge from the teacher model to student model without scarifying accuracy while accelerating. (ii)Higher training speed of the lightweight model is accompanied by the risk of overfitting due to the noise influence. To address these problems, we propose a novel model based on knowledge distillation, called Theseus-BERT Guided Distill CNN(TBG-disCNN). BERT-of-Theseus [1] is employed as the teacher model and CNN as the student model. Aiming at the inherent noise problem, we propose coordinated CNN-BiLSTM as a parameter-sharing layer for Multi-Task Learning (MTL), in order to capture both regional and long-term dependence information. Our approach has approximately good performance as BERT-base and teacher model with $12 times$ and $281 times$ speedup of inference and $19.58 times$ and $8.94 times$ fewer parameters usage, respectively.","PeriodicalId":216904,"journal":{"name":"2022 7th International Conference on Business and Industrial Research (ICBIR)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114961422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Business Process Improvement in Distributor Company to Increase The Timeliness of Delivery 改进经销商公司的业务流程，提高交货的及时性

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786523

S. Angelita, Komarudin

引用次数: 0

IoT Based Cold Chain Logistics with Blockchain for Food Monitoring Application 基于物联网的冷链物流与区块链食品监控应用

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786493

Krittaphas Wisessing, Napaphat Vichaidis

引用次数: 1

Technology Management Framework for Alternative Learning System 另类学习系统的技术管理框架

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786492

Karen Joyce Ison, Ronaldo Juanatas, Ma. Divina E. Elvambuena

{"title":"Technology Management Framework for Alternative Learning System","authors":"Karen Joyce Ison, Ronaldo Juanatas, Ma. Divina E. Elvambuena","doi":"10.1109/ICBIR54589.2022.9786492","DOIUrl":"https://doi.org/10.1109/ICBIR54589.2022.9786492","url":null,"abstract":"Literacy is something that we can consider as a contributor to nation-building. Improving the education system is the key to eradicating illiteracy in every nation. The education sectors are seeking ways to educate each citizen so that they will be able to work competitively and live a comfortable life without depending so much on government aid. However, no matter how the government work to educate the younger generations and the underprivileged adults in the society, there is always issues and challenges that the education sector is facing. This study focuses on developing a technology management framework that allows technology adoption for ALS delivery systems like the Philippines. The implementation of ALS in the Philippines is under the Department of Education (DepEd) administration. The feasibility of the proposed framework and how it can be managed and implemented, including its sustainability, was likewise considered. The framework includes strategies that are vital in the implementation of ALS. DepEd will serve as the primary implementor of the framework and technology adoption of the ALS programs.","PeriodicalId":216904,"journal":{"name":"2022 7th International Conference on Business and Industrial Research (ICBIR)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116282072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Experimental Study of Plant Morphology on LoRa UG2AG Transmission 植物形态对LoRa UG2AG传输的实验研究

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786397

Y. Jiabao, Wang Xuefen, Li Xinyun, Hu Weiyu, Cai Tingting, Yang Yi

引用次数: 0

The Identification of Waste in Mineral Water Company Using Waste Assessment Management Method and Lean Manufacturing Approach 用废物评估管理方法和精益生产方法识别矿泉水公司的废物

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786417

R. Fitriana, D. Gabriel

引用次数: 0

Recursive Feature Elimination Algorithm for Intrusion Detection Systems 入侵检测系统的递归特征消除算法

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786411

H. Nguyen

引用次数: 0

An Exploratory Study of The Gen Z and E Generation in the Digital Era for the Modern Business Environment 面向现代商业环境的数字时代Z世代和E世代探索性研究

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786526

M. Bhore, Deepika Pandita

引用次数: 0

Real-Time Clinical Gait Analysis and Foot Anomalies Detection Using Pressure Sensors and Convolutional Neural Network 基于压力传感器和卷积神经网络的实时临床步态分析和足部异常检测

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786472

Mahdi Islam, Musarrat Tabassum, M. M. Nishat, Fahim Faisal, Muhammad Sayem Hasan

{"title":"Real-Time Clinical Gait Analysis and Foot Anomalies Detection Using Pressure Sensors and Convolutional Neural Network","authors":"Mahdi Islam, Musarrat Tabassum, M. M. Nishat, Fahim Faisal, Muhammad Sayem Hasan","doi":"10.1109/ICBIR54589.2022.9786472","DOIUrl":"https://doi.org/10.1109/ICBIR54589.2022.9786472","url":null,"abstract":"This research presents a novel insight on gait disorder detection using transfer learning algorithms on sensor-acquired data based on the implementation of popular Convolutional Neural Network (CNN) models. The paper proposes the use of pressure sensors to extract heatmap images during gait, which are then trained and tested in various classification algorithms for gait abnormality diagnosis and detection. Gait is a biological and scientific study of body movement and locomotion that emphatically serves as a reliable parameter for inspecting the human body’s neuromuscular and skeletal systems. To build a convenient and precise classification system for possible application, synthetic data was generated in multiple preexisting CNN models, which were then evaluated using conventional performance metrics. The proposed notion yielded experimental findings that showed higher accuracies for all transfer learning schemes tested, with the Vgg16 model achieving a notable accuracy of 97.15%. As a result, the analysis demonstrated not only a significant performance in terms of accuracy, but also reduced complexity and computing time, making the approach efficient yet effective.","PeriodicalId":216904,"journal":{"name":"2022 7th International Conference on Business and Industrial Research (ICBIR)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125325489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 12

The Role of Digital Transformation on Strategic Leader: A Systematic Literature Review 数字化转型对战略领导者的作用:系统文献综述

2022 7th International Conference on Business and Industrial Research (ICBIR) Pub Date : 2022-05-19 DOI: 10.1109/ICBIR54589.2022.9786422

Chwen-Li Chang, Edgar Octoyuda, Ivon Arisanti

引用次数: 1