Félix González‐Carrasco, Felipe Espinosa Parra, Izaskun Álvarez‐Aguado, Sebastián Ponce Olguín, Vanessa Vega Córdova, Miguel Roselló‐Peñaloza
{"title":"利用机器学习减少智障人士 \"支持强度量表 \"的项目","authors":"Félix González‐Carrasco, Felipe Espinosa Parra, Izaskun Álvarez‐Aguado, Sebastián Ponce Olguín, Vanessa Vega Córdova, Miguel Roselló‐Peñaloza","doi":"10.1111/bld.12616","DOIUrl":null,"url":null,"abstract":"BackgroundThe study focuses on the need to optimise assessment scales for support needs in individuals with intellectual and developmental disabilities. Current scales are often lengthy and redundant, leading to exhaustion and response burden. The goal is to use machine learning techniques, specifically item‐reduction methods and selection algorithms, to develop shorter and more efficient scales.MethodsA data set of 93 participants was analysed using the Supports Needs Scale. Five feature‐selection algorithms were evaluated to create a shortened questionnaire. For each algorithm, a Random Forest model was trained, and performance was assessed using metrics like accuracy, precision, recall and F1‐score to measure how well each model predicted support needs.FindingsThe \"Select from Model\" algorithm successfully identified key items that could predict the level of Support Needs using the Random Forest model. Only 51 variables, out of the original 147, were needed to maintain predictive accuracy. The reduced questionnaire maintained good reliability and internal consistency compared to the original instrument, with a strong F1 score indicating excellent predictive performance.ConclusionsThe study demonstrates that machine learning techniques are effective in reducing the length of support needs questionnaires while preserving their psychometric properties. These methods can help institutions provide more efficient access to information about support needs without compromising validity or reliability, potentially leading to better resource allocation and improved care for individuals with intellectual disabilities.","PeriodicalId":47232,"journal":{"name":"British Journal of Learning Disabilities","volume":"41 1","pages":""},"PeriodicalIF":1.2000,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Item reduction of the “Support Intensity Scale” for people with intellectual disabilities, using machine learning\",\"authors\":\"Félix González‐Carrasco, Felipe Espinosa Parra, Izaskun Álvarez‐Aguado, Sebastián Ponce Olguín, Vanessa Vega Córdova, Miguel Roselló‐Peñaloza\",\"doi\":\"10.1111/bld.12616\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"BackgroundThe study focuses on the need to optimise assessment scales for support needs in individuals with intellectual and developmental disabilities. Current scales are often lengthy and redundant, leading to exhaustion and response burden. The goal is to use machine learning techniques, specifically item‐reduction methods and selection algorithms, to develop shorter and more efficient scales.MethodsA data set of 93 participants was analysed using the Supports Needs Scale. Five feature‐selection algorithms were evaluated to create a shortened questionnaire. For each algorithm, a Random Forest model was trained, and performance was assessed using metrics like accuracy, precision, recall and F1‐score to measure how well each model predicted support needs.FindingsThe \\\"Select from Model\\\" algorithm successfully identified key items that could predict the level of Support Needs using the Random Forest model. Only 51 variables, out of the original 147, were needed to maintain predictive accuracy. The reduced questionnaire maintained good reliability and internal consistency compared to the original instrument, with a strong F1 score indicating excellent predictive performance.ConclusionsThe study demonstrates that machine learning techniques are effective in reducing the length of support needs questionnaires while preserving their psychometric properties. These methods can help institutions provide more efficient access to information about support needs without compromising validity or reliability, potentially leading to better resource allocation and improved care for individuals with intellectual disabilities.\",\"PeriodicalId\":47232,\"journal\":{\"name\":\"British Journal of Learning Disabilities\",\"volume\":\"41 1\",\"pages\":\"\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2024-08-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"British Journal of Learning Disabilities\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/bld.12616\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"EDUCATION, SPECIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"British Journal of Learning Disabilities","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/bld.12616","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION, SPECIAL","Score":null,"Total":0}
引用次数: 0
摘要
背景这项研究的重点是需要优化智力和发育障碍人士的支持需求评估量表。目前的量表通常冗长而多余,会导致疲惫和回答负担。我们的目标是利用机器学习技术,特别是项目缩减方法和选择算法,开发出更简短、更高效的量表。我们对五种特征选择算法进行了评估,以制作出更简短的问卷。对每种算法都训练了一个随机森林模型,并使用准确率、精确度、召回率和 F1 分数等指标对性能进行评估,以衡量每个模型预测支持需求的效果。在原来的 147 个变量中,只需要 51 个变量就能保持预测的准确性。与原始问卷相比,缩减后的问卷保持了良好的可靠性和内部一致性,强大的 F1 分数表明问卷具有出色的预测性能。这些方法可以帮助机构更有效地获取有关支持需求的信息,同时又不会影响有效性或可靠性,从而有可能改善资源分配和对智障人士的护理。
Item reduction of the “Support Intensity Scale” for people with intellectual disabilities, using machine learning
BackgroundThe study focuses on the need to optimise assessment scales for support needs in individuals with intellectual and developmental disabilities. Current scales are often lengthy and redundant, leading to exhaustion and response burden. The goal is to use machine learning techniques, specifically item‐reduction methods and selection algorithms, to develop shorter and more efficient scales.MethodsA data set of 93 participants was analysed using the Supports Needs Scale. Five feature‐selection algorithms were evaluated to create a shortened questionnaire. For each algorithm, a Random Forest model was trained, and performance was assessed using metrics like accuracy, precision, recall and F1‐score to measure how well each model predicted support needs.FindingsThe "Select from Model" algorithm successfully identified key items that could predict the level of Support Needs using the Random Forest model. Only 51 variables, out of the original 147, were needed to maintain predictive accuracy. The reduced questionnaire maintained good reliability and internal consistency compared to the original instrument, with a strong F1 score indicating excellent predictive performance.ConclusionsThe study demonstrates that machine learning techniques are effective in reducing the length of support needs questionnaires while preserving their psychometric properties. These methods can help institutions provide more efficient access to information about support needs without compromising validity or reliability, potentially leading to better resource allocation and improved care for individuals with intellectual disabilities.
期刊介绍:
The British Journal of Learning Disabilities is an interdisciplinary international peer-reviewed journal which aims to be the leading journal in the learning disability field. It is the official Journal of the British Institute of Learning Disabilities. It encompasses contemporary debate/s and developments in research, policy and practice that are relevant to the field of learning disabilities. It publishes original refereed papers, regular special issues giving comprehensive coverage to specific subject areas, and especially commissioned keynote reviews on major topics. In addition, there are reviews of books and training materials, and a letters section. The focus of the journal is on practical issues, with current debates and research reports. Topics covered could include, but not be limited to: Current trends in residential and day-care service Inclusion, rehabilitation and quality of life Education and training Historical and inclusive pieces [particularly welcomed are those co-written with people with learning disabilities] Therapies Mental health issues Employment and occupation Recreation and leisure; Ethical issues, advocacy and rights Family and carers Health issues Adoption and fostering Causation and management of specific syndromes Staff training New technology Policy critique and impact.