IEEE Open Journal of the Computer Society最新文献

{"title":"The Metaverse for Industry 5.0 in NextG Communications: Potential Applications and Future Challenges","authors":"Prabadevi Boopathy;Natarajan Deepa;Praveen Kumar Reddy Maddikunta;Nancy Victor;Thippa Reddy Gadekallu;Gokul Yenduri;Wei Wang;Quoc-Viet Pham;Thien Huynh-The;Madhusanka Liyanage","doi":"10.1109/OJCS.2024.3497335","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3497335","url":null,"abstract":"With the advent of new technologies and endeavours for automation in almost all day-to-day activities, the recent discussions on the metaverse life have a greater expectation. The metaverse enables people to communicate with each other by combining the physical world with the virtual world. However, realizing the Metaverse requires symmetric content delivery, low latency, dynamic network control, etc. Industry 5.0 is expected to reform the manufacturing processes through human-robot collaboration and effective utilization of technologies like Artificial intelligence for increased productivity and less maintenance. The metaverse with Industry 5.0 may have tremendous technological integration for a more immersive experience and enhanced productivity. In this review, we present an overview of the metaverse and Industry 5.0, focusing on key technologies that enable the industrial metaverse, including virtual and augmented reality, 3D modeling, artificial intelligence, edge computing, digital twins, blockchain, and 6G communication networks. The article then discusses the metaverse's diverse applications across various Industry 5.0 sectors, such as agriculture, supply chain management, healthcare, education, and transportation, illustrated through several research initiatives. Additionally, the article addresses the challenges of implementing the industrial metaverse, proposes potential solutions, and outlines directions for future research.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"6 ","pages":"4-24"},"PeriodicalIF":0.0,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10752374","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142938073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Object Re-Identification Based on Federated Incremental Subgradient Proximal Optimization","authors":"Li Kang;Chuanghong Zhao;Jianjun Huang","doi":"10.1109/OJCS.2024.3489875","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3489875","url":null,"abstract":"Object Re-identification (Object ReID) is one of the key tasks in the field of computer vision. However, traditional centralized ReID methods face challenges related to privacy protection and data storage. Federated learning, as a distributed machine learning framework, can utilize dispersed data for model training without sharing raw data, thereby reducing communication costs and ensuring data privacy. However, the real statistical heterogeneity in federated object re-identification leads to domain shift issues, resulting in decreased performance and generalization ability of the ReID model. Therefore, to address the privacy constraints and real statistical heterogeneity in object re-identification, this article focuses on studying the object re-identification method based on the Federated Incremental Subgradient Proximal(FedISP) framework. FedISP effectively alleviates weight divergence and low communication efficiency issues through incremental sub-gradient proximal methods and ring topology, ensuring stable model convergence and efficient communication. Considering the complexity of ReID scenarios, this article adopts a ViT-based task model to cope with feature skew across clients. Additionally, it defines camera federated scenarios and dataset federated scenarios for problem modeling and analysis. Furthermore, due to the heterogeneous classifiers that clients may have, the approach intergrates personalized layers. In the experiments, instance datasets of two federated scenarios were constructed for model training. The final test results show that FedISP can effectively address the privacy protection and statistical heterogeneity issues faced by ReID.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"6 ","pages":"60-71"},"PeriodicalIF":0.0,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10742512","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142938075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A Framework to Design Efficent Blockchain-Based Decentralized Federated Learning Architectures","authors":"Yannis Formery;Leo Mendiboure;Jonathan Villain;Virginie Deniau;Christophe Gransart","doi":"10.1109/OJCS.2024.3488512","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3488512","url":null,"abstract":"Distributed machine learning, and Decentralized Federated Learning in particular, is emerging as an effective solution to cope with the ever-increasing amount of data and the need to process it faster and more reliably. It enables machine learning models to be trained without centralizing user data, which improves data confidentiality and optimizes performance compared with centralized approaches. However, scaling up such systems can have limitations in terms of data and model traceability and security. To address this limitation, the integration of Blockchain has been proposed, forming a global system leveraging Blockchain, called Blockchain Based Decentralized Federated Learning (BDFL), and taking advantage of the benefits of this technology, namely transparency, immutability and decentralization. For the time being, few studies have sought to characterize these BDFL systems, although it seems that they can be broken down into a set of layers (blockchain, interconnection of DFL nodes, client selection, data transmission, consensus management) that could have a major impact on the operation of the BDFL as a whole. The aim of this article is therefore to respond to this limitation by highlighting the different layers existing in the architecture of a BDFL system and the solutions proposed in the literature that can be integrated to optimise both the performance and the security of the system. This could ultimately lead to the design of more secure and efficient architectures with greater resilience to attacks and architectural changes.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"705-723"},"PeriodicalIF":0.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10738377","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142694673","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Enhancing Cross-Language Multimodal Emotion Recognition With Dual Attention Transformers","authors":"Syed Aun Muhammad Zaidi;Siddique Latif;Junaid Qadir","doi":"10.1109/OJCS.2024.3486904","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3486904","url":null,"abstract":"Despite the recent progress in emotion recognition, state-of-the-art systems are unable to achieve improved performance in cross-language settings. In this article we propose a Multimodal Dual Attention Transformer (MDAT) model to improve cross-language multimodal emotion recognition. Our model utilises pre-trained models for multimodal feature extraction and is equipped with dual attention mechanisms including graph attention and co-attention to capture complex dependencies across different modalities and languages to achieve improved cross-language multimodal emotion recognition. In addition, our model also exploits a transformer encoder layer for high-level feature representation to improve emotion classification accuracy. This novel construct preserves modality-specific emotional information while enhancing cross-modality and cross-language feature generalisation, resulting in improved performance with minimal target language data. We assess our model's performance on four publicly available emotion recognition datasets and establish its superior effectiveness compared to recent approaches and baseline models.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"684-693"},"PeriodicalIF":0.0,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10736634","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142663505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An Auditable, Privacy-Preserving, Transparent Unspent Transaction Output Model for Blockchain-Based Central Bank Digital Currency","authors":"Md. Mainul Islam;Hoh Peter IN","doi":"10.1109/OJCS.2024.3486193","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3486193","url":null,"abstract":"Auditability, privacy, transparency, and resiliency are four essential properties of a central bank digital currency (CBDC) system. However, it is difficult to satisfy these properties at once. This issue has become a crucial challenge to ongoing CBDC projects worldwide. In this article, we propose a novel unspent transaction output (UTXO) model, which offers auditable, privacy-preserving, transparent CBDC payments in a consortium blockchain network. The proposed model adopts a high-speed, non-interactive zero-knowledge proof scheme named zero-knowledge Lightweight Transparent ARgument of Knowledge (zk-LTARK) scheme to verify the ownership of UTXOs. The scheme provides low-latency proof generation and verification while maintaining 128-bit security with a smaller proof size. It also provides memory-efficient, privacy-preserving multi-party computation and multi-signature protocols. By using zk-LTARKs, users do not require numerous private–public key pairs to preserve privacy, which reduces risks in key management. Decentralized identifiers are used to authenticate users without interacting with any centralized server and avoid a single point of failure. The model was implemented in a customized consortium blockchain network with the proof-of-authority consensus algorithm.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"671-683"},"PeriodicalIF":0.0,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10734236","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142663504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Video-Based Deception Detection via Capsule Network With Channel-Wise Attention and Supervised Contrastive Learning","authors":"Shuai Gao;Lin Chen;Yuancheng Fang;Shengbing Xiao;Hui Li;Xuezhi Yang;Rencheng Song","doi":"10.1109/OJCS.2024.3485688","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3485688","url":null,"abstract":"Deception detection is essential for protecting the public interest and maintaining social order. Its application in various fields helps to establish a safer and trustworthy social environment. This study focuses on the problem of deception detection in videos and proposes a visual deception detection method based on a capsule network (DDCapsNet). The DDCapsNet model predicts deception classification using the fusion of facial expression features and video-based heart rate feature via a channel attention mechanism. Supervised contrastive learning is further introduced to enhance the generalization ability of the DDCapsNet. The proposed model is evaluated on a self-collected dataset (physiological-assisted visual deception detection dataset, PV3D) and the public Bag-of-Lies (BOL) dataset, respectively. The results show that DDCapsNet outperforms the unimodal system and other state-of-the-art (SOTA) methods, where the ACC reaches 77.97% and the AUC reaches 78.45% on PV3D, and the ACC reaches 73.19% and the AUC reaches 72.78% on BOL dataset.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"660-670"},"PeriodicalIF":0.0,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10734158","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An Innovative Dense ResU-Net Architecture With T-Max-Avg Pooling for Advanced Crack Detection in Concrete Structures","authors":"Ali Sarhadi;Mehdi Ravanshadnia;Armin Monirabbasi;Milad Ghanbari","doi":"10.1109/OJCS.2024.3481000","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3481000","url":null,"abstract":"Computer vision which uses Convolutional Neural Network (CNN) models is a robust and accurate tool for precise monitoring and pixel-level detection of potential damage in concrete structures. Using a state-of-the-art Dense ResU-Net model integrated with T-Max-Avg pooling layers, the present study introduces a novel and effective method for crack detection in concrete structures. The major innovation of this research is the introduction of the T-Max-Avg pooling layer within the Dense ResU-Net architecture which synergistically combines the strengths of both max and average pooling to improve feature retention and minimize information loss during crack detection. In addition, the incorporation of Residual and Dense blocks within the U-Net framework significantly enhances feature extraction and network depth, resulting in a more robust anomaly detection. The implementation of extensive data augmentation techniques improves the robustness of the model while the application of spatial dropout and L2 regularization techniques prevents overfitting. The proposed model showed a superior performance, outperforming traditional and state-of-the-art models. It had a Dice Coefficient score of 97.41%, an Intersection-over-Union (IoU) score of 98.63%, and an accuracy of 99.2% using a batch size of 32. These results confirmed the reliability and efficacy of the Dense ResU-Net with T-Max-Avg pooling layer for accurate crack detection, demonstrating its potential for real-world applications in structural health monitoring. By taking advantage of advanced deep learning techniques, the proposed method addressed the limitations of traditional crack detection techniques and offered significant improvements in robustness and accuracy.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"636-647"},"PeriodicalIF":0.0,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10720206","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142555104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"MusicTalk: A Microservice Approach for Musical Instrument Recognition","authors":"Yi-Bing Lin;Chang-Chieh Cheng;Shih-Chuan Chiu","doi":"10.1109/OJCS.2024.3476416","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3476416","url":null,"abstract":"Musical instrument recognition is the process of using machine learning or audio signal processing to identify and classify different musical instruments from an audio recording. This capability enables more precise analysis of musical pieces, aiding in tasks like transcription, music recommendation, and automated composition. The challenges include (1) recognition models not being accurate enough, (2) the need to retrain the entire model when a new instrument is added, and (3) differences in audio formats that prevent direct usage. To address these challenges, this article introduces MusicTalk, a microservice based musical instrument (MI) detection system, with several key contributions. Firstly, MusicTalk introduces a novel patchout mechanism named Brightness Characteristic Based Patchout for the ViT algorithm, which enhances MI detection accuracy compared to existing solutions. Secondly, MusicTalk integrates individual MI detectors as microservices, facilitating efficient interaction with other microservices. Thirdly, MusicTalk incorporates an audio shaper that unifies diverse music open datasets such as Audioset, Openmic-2018, MedleyDB, URMP, and INSTDB. By employing Grad-CAM analysis on Mel-Spectrograms, we elucidate the characteristics of the MI detection model. This analysis allows us to optimize ensemble combinations of ViT with patchout and CNNs within MusicTalk, resulting in high accuracy rates. For instance, the system achieves precision and recall rates of 96.17% and 95.77% respectively for violin detection, which are the highest among previous approaches. An additional advantage of MusicTalk lies in its microservice-driven visualization capabilities. By integrating MI detectors as microservices, MusicTalk enables seamless visualization of songs using animated avatars. In a case study featuring “Peter and the Wolf,” we demonstrate that improved MI detection accuracy enhances the visual storytelling impact of music. The overall F1-score improvement of MusicTalk over previous approaches for this song is up to 12%.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"612-623"},"PeriodicalIF":0.0,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10709650","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142518112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Polarity Classification of Low Resource Roman Urdu and Movie Reviews Sentiments Using Machine Learning-Based Ensemble Approaches","authors":"Muhammad Ehtisham Hassan;Iffat Maab;Masroor Hussain;Usman Habib;Yutaka Matsuo","doi":"10.1109/OJCS.2024.3476378","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3476378","url":null,"abstract":"The complex linguistic characteristics and limited resources present sentiment analysis in Roman Urdu as a unique challenge, necessitating the development of accurate NLP models. In this study, we investigate the performance of prominent ensemble methods on two diverse datasets of UCL and IMDB movie reviews with Roman Urdu and English dialects, respectively. We perform a comparative examination to assess the effectiveness of ensemble techniques including stacking, bagging, random subspace, and boosting, optimized through grid search. The ensemble techniques employ four base learners (Support Vector Machine, Random Forest, Logistic Regression, and Naive Bayes) for sentiment classification. The experiment analysis focuses on different N-gram feature sets (unigrams, bigrams, and trigrams), Chi-square feature selection, and text representation schemes (Bag of Words and TF-IDF). Our empirical findings underscore the superiority of stacking across both datasets, achieving high accuracies and F1-scores: 80.30% and 81.76% on the UCL dataset, and 90.92% and 91.12% on the IMDB datasets, respectively. The proposed approach has significant performance compared to baseline approaches on the relevant tasks and improves the accuracy up to 7% on the UCL dataset.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"599-611"},"PeriodicalIF":0.0,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10707202","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142517837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Verifiable Random Function Schemes Based on SM2 Digital Signature Algorithm and its Applications for Committee Elections","authors":"Yongxin Zhang;Jiacheng Yang;Hong Lei;Zijian Bao;Ning Lu;Wenbo Shi;Bangdao Chen","doi":"10.1109/OJCS.2024.3463649","DOIUrl":"https://doi.org/10.1109/OJCS.2024.3463649","url":null,"abstract":"A verifiable random function (VRF) is a pseudorandom function that enables source verification. By providing a public verification key and accompanying proof with the output, all parties can verify the correctness of the output without interaction. VRF has gained widespread adoption in blockchain applications, including Algorand, Ouroboros, and ChainLink. This article introduces SM2VRF, the first VRF based on the Chinese standard SM2 cryptographic algorithm, and extends it to a batch construction called SM2VRF-B for efficient verification of multiple sources. We showcase the applicability of SM2VRF in an electronic random committee election scenario, where the blockchain is utilized for storing candidate parameters and votes. By employing the Hamming distance, our scheme eliminates the risk of election failure. We provide a security proof for the proposed scheme, followed by an evaluation of the performance of both SM2VRF and SM2VRF-B. We implement our committee election scheme with Ethereum to assess the feasibility and efficiency.","PeriodicalId":13205,"journal":{"name":"IEEE Open Journal of the Computer Society","volume":"5 ","pages":"480-490"},"PeriodicalIF":0.0,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10699362","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142377066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}