{"title":"Research on Sentence Embeddings for Text Matching through Multiview Interactive Features","authors":"Xiaohui Liu, Fumin Chen, Yong Hu, Xinjian Li","doi":"10.1109/NNICE58320.2023.10105673","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105673","url":null,"abstract":"In this paper, we propose a sentence embedding for text matching method through multi-view interactive features: SBERT-Inter. This method is improved from the Sentence-BERT(SBERT) model based on semantic matching. Existing text matching models including representation-based methods get the vector representation of two sentences and calculate the similarity, but the interaction between sentences is lost. Or based on the interactive method to splice two sentences and directly output the similarity, but not through the sentence representation. Aiming at the problems of the two methods, a text matching method based on representation and interaction is proposed, which combines more fine-grained interaction modules after obtaining the representation features, through the multi-view and multi-perspective fusion of sentence and token features such as embedding difference, embeddings similarity, and token's self-attention, we can better learn the fine-grained interactive features between embeddings and we can get better semantic representation. It improves the matching performance between sentence pairs. On the public dataset semantic textual similarity benchmark(STS-B), the Spearman correlation of this method is enhanced by 6% compared with other sentence embedding methods.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"51 11","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113937632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Soil Nutrient Evaluation System Based on Improved Recurrent Neural Network","authors":"Yingbo Bu, Xinjie Yu, Yao-Tai Yang","doi":"10.1109/NNICE58320.2023.10105705","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105705","url":null,"abstract":"Soil nutrients are a comprehensive reflection of soil characteristics, and this paper proposes a recurrent neural network method with a fusion mechanism to construct a soil nutrient evaluation model in this area. Soil nutrient indicators are used as the input of the neural network, and soil nutrient levels are used as the output. The results obtained by the recurrent neural network are better through experimental simulation training and prediction, and the experimental comparison with related neural network models shows that the grade results obtained by the recurrent neural network are more accurate, and the establishment and prediction of this model provides a new way for soil nutrient fertility grade evaluation, and the MSE 0.031 of the fused recurrent neural network proposed in this paper is smaller than the mean square error value of the traditional model. The decision coefficient R2 of 0.978 is closer to 1 compared with other models, indicating that the initial weights and thresholds of the recurrent neural network optimized using the algorithm of this paper can effectively improve the prediction accuracy and fitting performance of the model.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121488282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"BeiDou Short Message Transmission Method Based on High-quality Image Compression and Reconstruction","authors":"Nanxu Gong, Zijun Li, Jie Tan, Hu Chen","doi":"10.1109/NNICE58320.2023.10105730","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105730","url":null,"abstract":"Limited by bandwidth, Beidou short message system has certain limitations in the application of image transmission. To improve the problem, this paper proposes a Beidou short message transmission method based on high-quality image compression and reconstruction. We introduce the current mainstream deep learning framework based on variational autoencoders as our baseline. In order to achieve high-quality image compression and reconstruction, firstly, the attention mechanism is added to make the network automatically pay attention to beneficial information. Secondly, the image quality discriminator is designed that can provide the image definition score explicitly and is differentiable. Furthermore, based on the discriminator, a two-stage training method is proposed: first, the discriminator is trained with the data set synthesized by the Gaussian Blur, then the weights of the discriminator are fixed and the output of the discriminator is used to guide the network to generate images with high quality. The effectiveness of the method is verified by a series of experiments.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"216 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123026252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shunjiang Wang, Dianyang Li, Gang Liu, Zhaowei Ling, Duo Wang
{"title":"Short-term PV Power Prediction Based on Bi-directional Gated Recurrent Unit Network and Adaptive Chirp Mode Decomposition","authors":"Shunjiang Wang, Dianyang Li, Gang Liu, Zhaowei Ling, Duo Wang","doi":"10.1109/NNICE58320.2023.10105683","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105683","url":null,"abstract":"With the increasing proportion of installed PV capacity and access to the system, accurate short-term PV power forecasting is critical to maintain safe and stable operation of grids containing a high proportion of PV power sources. In addition, a single prediction model has limited ability to improve the accuracy. To address the above issues, this paper proposes a short-term PV power prediction method based on bi-directional gated recursive unit (Bi-GRU) network and adaptive chirp modal decomposition (ACMD). First, to reduce the complexity of the historical PV power time series data, the ACMD algorithm is used for signal decomposition. Then a Bi-GRU network is built for the prediction of the sequences after noise reduction processing. The model is validated using actual power output data from a PV plant in Xinjiang, China. By comparing with SVM, ELM and BiGRU prediction models, it is verified that the ACMD-BiGRU model proposed in this paper has better results and can effectively improve the short-term PV power prediction accuracy.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133449769","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Research on pavement marking recognition method based on MATLAB","authors":"Ruchun Li, Xinxiu Zhang","doi":"10.1109/NNICE58320.2023.10105794","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105794","url":null,"abstract":"Pavement markings are an important part of traffic. Effective automatic identification of pavement markings can help traffic achieve efficient operation. In this paper, the median filtering method is adopted, and the window selects 5 * 5 template to de-noise the image, and then the image is enhanced with linear gray transform, which effectively improves the accuracy of automatic recognition of road markings. Design the Matlab GUI interface, add the main functions to the interface, and realize the automatic recognition of human-computer interactive pavement markings.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134507782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Complex-Valued Relative Positional Encodings for Transformer","authors":"Gang Yang, Hongzhe Xu","doi":"10.1109/NNICE58320.2023.10105716","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105716","url":null,"abstract":"Recently, the self-attention mechanism (Transformer) has shown its advantages in various natural language processing (NLP) tasks. Since positional information is crucial to NLP tasks, the positional encoding has become a critical factor in improving the performance of the Transformer. In this paper, we present a simple but effective complex-valued relative positional encoding (CRPE) method. Specifically, we map the query and key vectors to the complex domain based on their positions. Hence, the attention weights will directly contain the relative positional information by the dot product between the complex-valued query and key vectors. To demonstrate the effectiveness of our method, we use four typical NLP tasks: named entity recognition, text classification, machine translation, and language modeling. The datasets of these tasks comprise texts of varying lengths. In the experiments, our method outperforms the baseline positional encodings across all datasets. The results show that our method is more effective for long and short texts while containing fewer parameters.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133846027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cycling image encryption algorithm based on the new composite chaotic mapping","authors":"Chengshuai Li, Wanbo Yu","doi":"10.1109/NNICE58320.2023.10105707","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105707","url":null,"abstract":"In this paper, a new two-dimensional chaotic system (BTCS) that is based on composite of Bezier surface and trigonometric function is proposed. This system has large key space and demonstrates good chaotic behavior. In the meantime, using BTCS, a new encryption scheme (CIEA), named the Cycling image encryption algorithm, is proposed for encrypting numerous same-size images. The kernel of the scheme is that using the newly encrypted image encrypts a new image, circularly, which can improve security and is very efficient. Generation of pseudo-random matrices, scrambling based on matrix and XOR diffusion operation are included in each loop of CIEA. Security analyses and experiment results show that the CIEA performs well in key space, key sensitivity, histogram, information entropy, correlation analysis and anti-differential attack test.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125619333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Urban Road Semantic Segmentation Method Based on Bilateral Segmentation Network","authors":"Linshan Du, Ye Zhang, B. Liu, He Yan","doi":"10.1109/NNICE58320.2023.10105801","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105801","url":null,"abstract":"In the task of constructing complex urban road scene semantic segmentation, continuous downsampling operation in the Context Path module of the Bisenet network may cause the loss of some pixel feature information. To solve this problem, a supervised block that can be inserted into the Context Path module was proposed. It consisted of 3*3 convolution, batch normalization and ReLU linear correction and 1*1 convolution. The downsampling operation of each layer was inserted into a supervised block to guide the training process, so that the current layer can obtain feature information from the previous layer and retain rich context information. In this way, feature representation was enhanced to improve semantic segmentation accuracy. The experimental results showed that the method in this paper had better semantic segmentation results on the Cityscapes and CamVid urban road datasets, and its MIOU evaluation index had increased by 2.3% and 3.8%, respectively.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124879831","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Subspace-based Optimization Method with Adaptive Total Variation for Microwave Imaging","authors":"Wenjin Zhu, Wanyu Li, Xing Jiang, F. Sun","doi":"10.1109/NNICE58320.2023.10105668","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105668","url":null,"abstract":"Microwave imaging problems are nonlinear and ill-posed due to multiple scattering and a lack of observed data. The optimization method with total variation (TV) regularization can be used to address the ill-posed problems. However, TV regularization is susceptible to the staircase effect, which blurs the edges. In order to alleviate the staircase effect, in this study, the $boldsymbol{mathrm{L}^{mathrm{p}}}$ -norm TV as the regularization factor is applied to the subspace-based optimization method, and parameter p is adaptively adjusted to the gradient of the image. It can not only avoid the staircase effect but also eliminate noise in measured scattering data. Numerical experiments prove that the method not only has good reliability but also preserves the local feature of the object.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124948983","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Polynomial Improved Convolution Kernel Graph Network For Fault Diagnosis","authors":"Huan Zhang, Zili Wang, Le-miao Qiu, Shuyou Zhang, Gaopeng Yang, Feifan Xiang","doi":"10.1109/NNICE58320.2023.10105666","DOIUrl":"https://doi.org/10.1109/NNICE58320.2023.10105666","url":null,"abstract":"Diagnosis is widely performed using convolutional neural networks (CNN). There are, however, limitations to CNN in non-Euclidean space. Based on the superiority of the graph convolutional neural networks (GCN) in non-Euclidean space, the GCN was adopted in this paper. In order to optimize the convolution process, the convolution kernel is approximated by four orthogonal polynomials, Chebyshev, Legendre, Laguerre, and Hermite. Then, ChebyNet, LegenNet, LargerNet, and HermiNet models are constructed using these four polynomials. According to the experimental results, HermiNet is superior when time-domain vibration signals are used as input, and LargerNet is superior when frequency-domain vibration signals are used.","PeriodicalId":263114,"journal":{"name":"2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129099477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}