Haiyan Cui, Zhe Xue, Junping Du, Xin Xu, Junqing Xi
{"title":"A Novel Topic Extraction Model for Science and Technology Demand Data","authors":"Haiyan Cui, Zhe Xue, Junping Du, Xin Xu, Junqing Xi","doi":"10.1109/CCIS53392.2021.9754535","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754535","url":null,"abstract":"There are few studies focus on enterprise science and technology demand data, which is very important for enterprise development and innovation. These data are scattered on several websites and contain a lot of noise, which make it difficult to accurately analyze their topic. In this paper, the topic extraction algorithm based on deep learning is proposed to obtain the topic of demand in various industries. We adopt topic features clustering method to refine the classification of science and technology demand data. Keyword extraction method is proposed to filter the extracted theme words. The extracted topics are combined with time series to analyze the evolution of the topics and show the applicability of the extracted results of the science and technology demand data. A lot of experiments are conducted to verify the effectiveness of our algorithm. The optimal parameters and the number of topics are also analyzed in the experiments.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127854774","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Key-phrase Extraction Method Based on Multi-size Convolution Windows for Scientific Literatures","authors":"Yuhong Zhang, Yuxin Xie, Peipei Li, Xuegang Hu","doi":"10.1109/CCIS53392.2021.9754645","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754645","url":null,"abstract":"The key-phrase extraction is important for the downstream tasks in natural language process, and has attracted a lot of attention. Compared with other documents, scientific literatures contain many long phrases. Most existing methods perform poor on these literatures. To address this problem, a key-phrase extraction method based on multi-size convolution windows (KE-MCW) is proposed for scientific literatures in this paper. More specifically, in order to represent more contextual information, a convolutional neural network(CNN) with multi-size filters is introduced to map the documents into distributed feature vectors, then each vector can represent different size phrases. Next, in order to determine whether each word is a part of a keyphrase, a deep recurrent neural network is used to mark the role of each word. Finally, the attention mechanism is used to further judge the importance of each phrase. Experimental results show that our proposed method performs better than some competitive methods for technology literatures.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"183 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115071660","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fudong Li, Dongyang Gao, Yuequan Yang, Zhiqiang Cao, Wei Wang
{"title":"ReCUS: Reconvolution and Upsampling Network for Object Detection","authors":"Fudong Li, Dongyang Gao, Yuequan Yang, Zhiqiang Cao, Wei Wang","doi":"10.1109/CCIS53392.2021.9754606","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754606","url":null,"abstract":"Most of the mainstream object detection models such as RetinaNet, SSD, YOLO, and Faster RCNN hardly achieve a good balance between detection accuracy and speed. A major reason is rich deep feature semantic information of images is not fully exploited. To solve this problem, a novel deep convolutional network structure termed as reconvolution and upsampling network (ReCUS) is proposed. In the ReCUS, a modified path aggregation network(mPAN) is added after the backbone, which is beneficial to strengthen the foreground salient feature information and weaken background information. Moreover, two new spatial pyramid pooling (SPP) modules are embedded before output heads for multi-scale fusion of local and global features. The experiments show that the effectiveness of our proposed ReCUS. Furthermore, the better detectability of the ReCUS network is demonstrated for both small scale objects and large scale objects.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117060580","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Review on Indicator-based Multi-objective Evolutionary Algorithms","authors":"Zilu Huang, Feng Wang","doi":"10.1109/CCIS53392.2021.9754639","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754639","url":null,"abstract":"In this paper, we provide a review of indicator based multi-objective evolutionary algorithms (IBEAs). 1) A taxonomy that classifies IBEAs into two categories has been given, including volume-based IBEAs and distance-based IBEAs; 2) The characteristics of IBEAs have been discussed in detail based on the calculation process of different indicators; and 3) Some future research directions on IBEAs have been put forward.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123500588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"CESMP: Chinese-English Segment-aligned Multi-field Patent Data","authors":"Wuying Liu, Lin Wang, Fumao Hu","doi":"10.1109/CCIS53392.2021.9754662","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754662","url":null,"abstract":"Patent data from various countries in the world implies the essence of scientific discovery and technological innovation of all human beings, but language differences have become a huge obstacle to patent data retrieval and communication. We hope to build a bridge from Chinese to English in the patent domain, so that English speakers can make better use of Chinese patent data. With the help of natural language processing technologies such as optical character recognition, Chinese text processing, machine translation and English text processing, we construct digital Chinese-English segment-aligned multi-field patent (CESMP) data from scanned Chinese patents. The current CESMP data consists of 610,310 patent documents in XML format. Each patent document contains six required fields (date, publication, ipc, title, abstract, and claim) and four optional fields (cpc, wipo, originalapplicant, and currentowner), among which the wipo, title, abstract, and claim fields are aligned with Chinese and English segments. Supported by well-structured bilingual patent data, on the one hand, the resource construction algorithms can efficiently build a bilingual patent dictionary and a parallel patent segment bank; on the other hand, the deep natural language processing algorithms can be effectively implemented into many practical intelligent applications such as cross-language patent retrieval, patent spam filtering, patent network analysis, patent machine translation, etc.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"24 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120854910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
D. Niu, Min Yu, Ruoyun Du, Lijie Sun, Xiaomin Xu, Huanfen Zhang
{"title":"Manufacturing Multi-value Chain Product Demand Forecasting Based on KPCA-PSO-SVM : -Taking the Demand of the Ring Network Cabinet as an Example","authors":"D. Niu, Min Yu, Ruoyun Du, Lijie Sun, Xiaomin Xu, Huanfen Zhang","doi":"10.1109/CCIS53392.2021.9754531","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754531","url":null,"abstract":"With the growth of social demand and economy, the ring network cabinet (RNC) has become the key link of the last kilometer of distribution. Forecasting the demand of RNC from the perspective of enterprises can provide suggestions for the production plan and business decisions of enterprises. Starting from the manufacturing multi-value chain, this paper fully taps the effective information of supply chain, production chain and marketing chain as the input variables of demand forecasting. Considering too many factors involved, this paper uses KPCA to reduce the data dimension, and uses the support vector machine optimized by particle swarm optimization (PSO) to predict the demand of A ring-main unit manufacturing enterprises. In order to verify the validity of the model, ARMA, SVM and PSO-SVM are selected to compare the models. The results show that the KPCA-PSO-SVM adopted in this paper has higher prediction accuracy and efficiency. According to the prediction results, this paper gives corresponding decision-making suggestions.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"15 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125945762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multiple Adaptive Strategies-based Rat Swarm Optimizer","authors":"Ziyue Xu, Xiaodan Liang, Maowei He, Hanning Chen","doi":"10.1109/CCIS53392.2021.9754632","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754632","url":null,"abstract":"Rat Swarm Optimizer (RSO) is a novel Swarm-intelligence based algorithms for solving global optimization problems. Its main idea is simulating the behavior of rats chasing and fighting their prey. There is an improved RSO according to multiple adaptive strategies, named as MARSO, is proposed. The multiple adaptive strategies include adaptive learning exemplars (ALE) and adaptive population size (APS). In this paper, the performance of MARSO was validated on the 29 IEEE CEC2017 functions by comparing with several classic or novel optimization algorithms. The experimental results show these two strategies enable RSO to get more excellent performance.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128528504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Hyper-parameter Tuning of Federated Learning Based on Particle Swarm Optimization","authors":"Zhiyuan Li, Hao Li, Mingyang Zhang","doi":"10.1109/CCIS53392.2021.9754676","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754676","url":null,"abstract":"The learning task of federated learning (FL) is solved by a federation of a center server and individual clients. Contrary to traditional deep learning models, federated learning consists of two parts, the global model and individual models. However, since the process is carried out by two parts of equal importance, it is ideal to deal with both parts simultaneously. To achieve superior performance, federated learning requires carefully selected hyper-parameters, which has more hyper-parameters than those of traditional deep learning models. To solve this tuning problem, we propose a method using particle swarm optimization (PSO) algorithm to tune the hyperparameters of federated learning. PSO algorithm is a gradient-free, stochastic optimization method which is better than grid search method when it comes to large search space. It helps locate the optimal combination of multiple parameters. In this article, we focus on applying PSO method on tuning the hyper-parameters of FL models, and prove that it is an efficient way to acquire satisfactory results. Experiments on MNIST dataset with convolution neural networks have proved the superiority of the proposed method.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127429367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Target-based Sentiment Analysis in Finance with Domain Knowledge","authors":"Caihua Yang, Jianzhu Bao, Xiaoqi Yu, Ruifeng Xu","doi":"10.1109/CCIS53392.2021.9754611","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754611","url":null,"abstract":"In order to apply the target-based sentiment analysis to finance domain, this paper constructs a corpus with eight types of entities and four types of emotions. Compared to previous works, the corpus proposed in this paper is more fine-grained. Furthermore, we propose a complete and universal framework for target-based sentiment analysis, which contains two subtasks, i.e. named entity recognition and entity-level sentiment classification. We incorporate the pre-trained language model with financial domain knowledge and achieve significant performance improvement.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116727529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xiangping Zhang, H. Fan, Hongjin Zhu, Xianzhen Huang, Tao Wu, Hong-bin Zhou
{"title":"Improvement of YOLOV5 Model Based on the Structure of Multiscale Domain Adaptive Network for Crowdscape","authors":"Xiangping Zhang, H. Fan, Hongjin Zhu, Xianzhen Huang, Tao Wu, Hong-bin Zhou","doi":"10.1109/CCIS53392.2021.9754600","DOIUrl":"https://doi.org/10.1109/CCIS53392.2021.9754600","url":null,"abstract":"In this paper, we propose an improved model DAN-YOLOV5 based on YOLOV5. First, we use a mosaic enhancement strategy, which creates a large number of new samples on the existing VOC2007 dataset. Second, an innovative adaptive network module DAN is used on top of YOLOV5. The adaptive network module DAN is used to fuse features from same-layer scenes or cross-layer scenes. Finally, the experimental results show that the accuracy of the YOLOV5 dataset enhanced with shear-mixing and mosaic enhancement strategies is 71.02%, which is 13.56% better than the unenhanced data, and the average accuracy Figure is 80.05%, which is 33.11 percentage points better than the data. Applying the adaptive network module DAN to the YOLOV5 model, it improves the accuracy by 2.61% relative to YOLOV5 at 75.28%. Achieving such experimental results without increasing the computational effort and complexity at the grassroots level is well worth studying.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121688401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}