Alex Cevallos-Culqui, Claudia Pons, Gustavo Rodriguez
{"title":"Semi-supervised learning models for document classification: A systematic review and meta-analysis","authors":"Alex Cevallos-Culqui, Claudia Pons, Gustavo Rodriguez","doi":"10.4114/intartif.vol26iss72pp30-60","DOIUrl":null,"url":null,"abstract":"The continuous increase of digital documents on the web creates the need to search for information patterns that allow the categorization of organizational documents to generate knowledge in an institution. An Artificial Intelligence technique for this purpose is text classification, it for its application uses labels (previously categorized documents) with supervised (with labels) or unsupervised (without labels) training models. Both traditional models with their advantages and disadvantages have been joined into semi-supervised models that extract the best qualities of each one, however, the labeling process involves resources and time that try to be optimized to improve classification accuracy.
 An analysis of the different semi-supervised models would show us the advantages of their training and the way how the structure of each of them affects the accuracy of their classification. In the present study, a classification structure of the semi-supervised models in the classification of documents is proposed to analyze their qualities and categorization process, through an SLR (Revision of systematic literature) that extracts performance metrics from the identified studies to perform a meta-analysis through forest plots.
 To define the search strategy for studies, the PICOC (Population, Intervention, Comparison, Outputs, Context) method has been used, it is supported by the research question defines a search string, which has allowed the collection of 228 research, these are filtered with the PRISMA declaration method and the determination of exclusion criteria, in this way 35 researches are selected for the present study.
 The analysis of the selected studies identifies a structure for the different semi-supervised learning models, and a scheme of their work process is obtained, it has been used to extract advantages, disadvantages, and performance metrics. Through a meta-analysis with forest diagrams, the classification accuracy performance of the researches in each learning model is evaluated, determining as results that regardless of the characteristics of its process, active learning (0.89) and assembled learning (0.83) present the best performance levels.","PeriodicalId":43470,"journal":{"name":"Inteligencia Artificial-Iberoamerical Journal of Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2023-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Inteligencia Artificial-Iberoamerical Journal of Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4114/intartif.vol26iss72pp30-60","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
The continuous increase of digital documents on the web creates the need to search for information patterns that allow the categorization of organizational documents to generate knowledge in an institution. An Artificial Intelligence technique for this purpose is text classification, it for its application uses labels (previously categorized documents) with supervised (with labels) or unsupervised (without labels) training models. Both traditional models with their advantages and disadvantages have been joined into semi-supervised models that extract the best qualities of each one, however, the labeling process involves resources and time that try to be optimized to improve classification accuracy.
An analysis of the different semi-supervised models would show us the advantages of their training and the way how the structure of each of them affects the accuracy of their classification. In the present study, a classification structure of the semi-supervised models in the classification of documents is proposed to analyze their qualities and categorization process, through an SLR (Revision of systematic literature) that extracts performance metrics from the identified studies to perform a meta-analysis through forest plots.
To define the search strategy for studies, the PICOC (Population, Intervention, Comparison, Outputs, Context) method has been used, it is supported by the research question defines a search string, which has allowed the collection of 228 research, these are filtered with the PRISMA declaration method and the determination of exclusion criteria, in this way 35 researches are selected for the present study.
The analysis of the selected studies identifies a structure for the different semi-supervised learning models, and a scheme of their work process is obtained, it has been used to extract advantages, disadvantages, and performance metrics. Through a meta-analysis with forest diagrams, the classification accuracy performance of the researches in each learning model is evaluated, determining as results that regardless of the characteristics of its process, active learning (0.89) and assembled learning (0.83) present the best performance levels.
期刊介绍:
Inteligencia Artificial is a quarterly journal promoted and sponsored by the Spanish Association for Artificial Intelligence. The journal publishes high-quality original research papers reporting theoretical or applied advances in all branches of Artificial Intelligence. The journal publishes high-quality original research papers reporting theoretical or applied advances in all branches of Artificial Intelligence. Particularly, the Journal welcomes: New approaches, techniques or methods to solve AI problems, which should include demonstrations of effectiveness oor improvement over existing methods. These demonstrations must be reproducible. Integration of different technologies or approaches to solve wide problems or belonging different areas. AI applications, which should describe in detail the problem or the scenario and the proposed solution, emphasizing its novelty and present a evaluation of the AI techniques that are applied. In addition to rapid publication and dissemination of unsolicited contributions, the journal is also committed to producing monographs, surveys or special issues on topics, methods or techniques of special relevance to the AI community. Inteligencia Artificial welcomes submissions written in English, Spaninsh or Portuguese. But at least, a title, summary and keywords in english should be included in each contribution.