{"title":"Intelligent classification of construction quality problems based on unbalanced short text data mining","authors":"Dan Wang , Kai Yin , Hailong Wang","doi":"10.1016/j.asej.2024.102983","DOIUrl":null,"url":null,"abstract":"<div><p>Construction Quality Management (CQM) is important for achieving project quality objectives. Currently, CQM is mainly achieved through cyclical inspections and various tests and subsequent analysis of the generated text records. These texts record various construction quality problems (CQPs) that need to be categorized and analyzed by quality managers. However, the current classification and analysis of CQPs is mainly achieved by manual analysis or natural language processing (NLP), the former is time-consuming and labor-intensive, while the latter improves the processing efficiency but is limited by the classification perspective and fails to fully capture the root causes of the CQPs. CQPs text usually describes the problems based on the inspection area, and multiple types of problems may exist simultaneously in each record. The previous classification model of CQPs based on sub-projects can only distinguish the frequent quality problems of sub-projects but cannot analyze the essential characteristics of CQPs, and ignores the comprehensive characteristics of CQPs, such as short text and unbalanced data. Therefore, aiming at the problem of mixed text information and diverse categories of CQPs, this study constructs a TDA-WV-TextCNN model for automatic text categorization by combining the characteristics of unbalanced data and short text of CQPs, taking the actual on-site inspection reports from multiple sources as the data base, and determining the classification labels based on the perspective of CQPs result orientation. The model combines the part-of-speech-based Text Data Augmentation (TDA) method, Word2vec (WV) technique and Text Convolutional Neural Network (TextCNN) algorithm. The results show that the TDA-WV-TextCNN model has a short training time and a high accuracy in short text classification; the part-of-speech-based TDA method expands the small sample data by extracting the core feature words and the word position change, realizing the text data equalization and subsequently improving the accuracy of the model; multiple sources of data increase the diversity of data, redundant text increases the amount of data, both play an important role in improving the performance of the model, so the deletion of duplicate text is related to the model’s demand for the amount of data The research results provide a method to categorize quality reports quickly and accurately, which helps to construct the engineering quality knowledge system.</p></div>","PeriodicalId":48648,"journal":{"name":"Ain Shams Engineering Journal","volume":"15 10","pages":"Article 102983"},"PeriodicalIF":6.0000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2090447924003587/pdfft?md5=bf655363e7cb4bde9304105666e04f6a&pid=1-s2.0-S2090447924003587-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ain Shams Engineering Journal","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2090447924003587","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Construction Quality Management (CQM) is important for achieving project quality objectives. Currently, CQM is mainly achieved through cyclical inspections and various tests and subsequent analysis of the generated text records. These texts record various construction quality problems (CQPs) that need to be categorized and analyzed by quality managers. However, the current classification and analysis of CQPs is mainly achieved by manual analysis or natural language processing (NLP), the former is time-consuming and labor-intensive, while the latter improves the processing efficiency but is limited by the classification perspective and fails to fully capture the root causes of the CQPs. CQPs text usually describes the problems based on the inspection area, and multiple types of problems may exist simultaneously in each record. The previous classification model of CQPs based on sub-projects can only distinguish the frequent quality problems of sub-projects but cannot analyze the essential characteristics of CQPs, and ignores the comprehensive characteristics of CQPs, such as short text and unbalanced data. Therefore, aiming at the problem of mixed text information and diverse categories of CQPs, this study constructs a TDA-WV-TextCNN model for automatic text categorization by combining the characteristics of unbalanced data and short text of CQPs, taking the actual on-site inspection reports from multiple sources as the data base, and determining the classification labels based on the perspective of CQPs result orientation. The model combines the part-of-speech-based Text Data Augmentation (TDA) method, Word2vec (WV) technique and Text Convolutional Neural Network (TextCNN) algorithm. The results show that the TDA-WV-TextCNN model has a short training time and a high accuracy in short text classification; the part-of-speech-based TDA method expands the small sample data by extracting the core feature words and the word position change, realizing the text data equalization and subsequently improving the accuracy of the model; multiple sources of data increase the diversity of data, redundant text increases the amount of data, both play an important role in improving the performance of the model, so the deletion of duplicate text is related to the model’s demand for the amount of data The research results provide a method to categorize quality reports quickly and accurately, which helps to construct the engineering quality knowledge system.
期刊介绍:
in Shams Engineering Journal is an international journal devoted to publication of peer reviewed original high-quality research papers and review papers in both traditional topics and those of emerging science and technology. Areas of both theoretical and fundamental interest as well as those concerning industrial applications, emerging instrumental techniques and those which have some practical application to an aspect of human endeavor, such as the preservation of the environment, health, waste disposal are welcome. The overall focus is on original and rigorous scientific research results which have generic significance.
Ain Shams Engineering Journal focuses upon aspects of mechanical engineering, electrical engineering, civil engineering, chemical engineering, petroleum engineering, environmental engineering, architectural and urban planning engineering. Papers in which knowledge from other disciplines is integrated with engineering are especially welcome like nanotechnology, material sciences, and computational methods as well as applied basic sciences: engineering mathematics, physics and chemistry.