José Ventura-León, Ariana Lluncor-Vasquez, Marco Chuquillanqui-Silva
{"title":"艾肯系数计算计算机工具:在临床和研究中的应用","authors":"José Ventura-León, Ariana Lluncor-Vasquez, Marco Chuquillanqui-Silva","doi":"10.1111/jep.14134","DOIUrl":null,"url":null,"abstract":"<p><strong>Rationale: </strong>In clinical and research settings, the validity and reliability of measurement instruments are crucial for reliable results. Current methods for computing validation metrics like Aiken's coefficients are often complex and error-prone, highlighting the need for a standardized computational tool to simplify and enhance this process.</p><p><strong>Aims and objectives: </strong>The objective of this study was to develop AikenCalc, a tool created to automate the calculation of Aiken coefficients. This tool provides a quantitative method for examining the validity and reliability of consensus among expert judges.</p><p><strong>Method: </strong>AikenCalc was developed with Shiny app, an R library that allows an easy-to-use interface and improved computational efficiency. It was validated using a convergence method by comparing the manual calculations with those obtained using AikenCalc. Additionally, to examine usability and interface, six experts evaluated their experience using AikenCalc and provided improvement feedback.</p><p><strong>Results: </strong>AikenCalc demonstrated good convergent validity, closely aligning with the results obtained manually, and the six experts gave favorable ratings regarding the usability and interface of AikenCalc. Finally, it was shown that AikenCalc significantly reduced the time required for calculations, thanks to its user-friendly interface.</p><p><strong>Conclusion: </strong>AikenCalc represents a significant improvement in the validation of measurement instruments by automating and simplifying the calculation of Aiken's coefficients through a Shiny web application. Additionally, it fills a knowledge gap, as there is currently no similar calculator available in the field of research.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":null,"pages":null},"PeriodicalIF":2.1000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A computer tool for Aiken's coefficients calculation: Applications in clinical and research settings.\",\"authors\":\"José Ventura-León, Ariana Lluncor-Vasquez, Marco Chuquillanqui-Silva\",\"doi\":\"10.1111/jep.14134\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Rationale: </strong>In clinical and research settings, the validity and reliability of measurement instruments are crucial for reliable results. Current methods for computing validation metrics like Aiken's coefficients are often complex and error-prone, highlighting the need for a standardized computational tool to simplify and enhance this process.</p><p><strong>Aims and objectives: </strong>The objective of this study was to develop AikenCalc, a tool created to automate the calculation of Aiken coefficients. This tool provides a quantitative method for examining the validity and reliability of consensus among expert judges.</p><p><strong>Method: </strong>AikenCalc was developed with Shiny app, an R library that allows an easy-to-use interface and improved computational efficiency. It was validated using a convergence method by comparing the manual calculations with those obtained using AikenCalc. Additionally, to examine usability and interface, six experts evaluated their experience using AikenCalc and provided improvement feedback.</p><p><strong>Results: </strong>AikenCalc demonstrated good convergent validity, closely aligning with the results obtained manually, and the six experts gave favorable ratings regarding the usability and interface of AikenCalc. Finally, it was shown that AikenCalc significantly reduced the time required for calculations, thanks to its user-friendly interface.</p><p><strong>Conclusion: </strong>AikenCalc represents a significant improvement in the validation of measurement instruments by automating and simplifying the calculation of Aiken's coefficients through a Shiny web application. Additionally, it fills a knowledge gap, as there is currently no similar calculator available in the field of research.</p>\",\"PeriodicalId\":15997,\"journal\":{\"name\":\"Journal of evaluation in clinical practice\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-09-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of evaluation in clinical practice\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/jep.14134\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of evaluation in clinical practice","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/jep.14134","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
A computer tool for Aiken's coefficients calculation: Applications in clinical and research settings.
Rationale: In clinical and research settings, the validity and reliability of measurement instruments are crucial for reliable results. Current methods for computing validation metrics like Aiken's coefficients are often complex and error-prone, highlighting the need for a standardized computational tool to simplify and enhance this process.
Aims and objectives: The objective of this study was to develop AikenCalc, a tool created to automate the calculation of Aiken coefficients. This tool provides a quantitative method for examining the validity and reliability of consensus among expert judges.
Method: AikenCalc was developed with Shiny app, an R library that allows an easy-to-use interface and improved computational efficiency. It was validated using a convergence method by comparing the manual calculations with those obtained using AikenCalc. Additionally, to examine usability and interface, six experts evaluated their experience using AikenCalc and provided improvement feedback.
Results: AikenCalc demonstrated good convergent validity, closely aligning with the results obtained manually, and the six experts gave favorable ratings regarding the usability and interface of AikenCalc. Finally, it was shown that AikenCalc significantly reduced the time required for calculations, thanks to its user-friendly interface.
Conclusion: AikenCalc represents a significant improvement in the validation of measurement instruments by automating and simplifying the calculation of Aiken's coefficients through a Shiny web application. Additionally, it fills a knowledge gap, as there is currently no similar calculator available in the field of research.
期刊介绍:
The Journal of Evaluation in Clinical Practice aims to promote the evaluation and development of clinical practice across medicine, nursing and the allied health professions. All aspects of health services research and public health policy analysis and debate are of interest to the Journal whether studied from a population-based or individual patient-centred perspective. Of particular interest to the Journal are submissions on all aspects of clinical effectiveness and efficiency including evidence-based medicine, clinical practice guidelines, clinical decision making, clinical services organisation, implementation and delivery, health economic evaluation, health process and outcome measurement and new or improved methods (conceptual and statistical) for systematic inquiry into clinical practice. Papers may take a classical quantitative or qualitative approach to investigation (or may utilise both techniques) or may take the form of learned essays, structured/systematic reviews and critiques.