Enhancing Measurement Precision in the Ms. Olsen Test of Clinical Competence: Further Examinations

IF 1.6 4区医学 Q4 GERIATRICS & GERONTOLOGY

International Journal of Older People Nursing Pub Date : 2024-09-19 DOI:10.1111/opn.12648

Pia Cecilie Bing-Jonsson, Lene Svendsen, Erika Boman, Guro-Marie Eiken, Jeanette Melin

{"title":"Enhancing Measurement Precision in the Ms. Olsen Test of Clinical Competence: Further Examinations","authors":"Pia Cecilie Bing-Jonsson, Lene Svendsen, Erika Boman, Guro-Marie Eiken, Jeanette Melin","doi":"10.1111/opn.12648","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Aim</h3>\n \n <p>This paper aims to report on two modifications made to improve the measurement precision of the Ms. Olsen test. Specifically, three items were added to the Ms. Olsen test and an extended scoring was applied to some items.</p>\n </section>\n \n <section>\n \n <h3> Design</h3>\n \n <p>The competence assessment had a quantitative cross-sectional design comprising of test results from 111 Registered Nurses in four municipalities in South-Eastern Norway.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>The Rasch model was applied to evaluate the measurement properties in four versions: the Ms. Olsen test with 19 items and the same with three added items, and the Ms. Olsen test with 19 items with an expanded scoring for the original and expanded version, respectively.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>The person separation indexes were improved from 0.50 to 0.62. Other measurement properties were not alternating between the four versions; all had shortcomings in terms of targeting (person measure means 3.02–3.87) and unidimensionality (% <i>t</i>-test >5% 9.01%–13.51%).</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>The clinical relevance and relatively short time spent on testing makes the Ms. Olsen test a reasonable choice and a step in the right direction for assessing competence as a means of targeting continuous professional development of nurses throughout their career. Nevertheless, depending on what kind of decisions are to be made, reliability might still be too low and further development is suggested.</p>\n </section>\n \n <section>\n \n <h3> Public Contribution</h3>\n \n <p>The initiative for the competence assessment came from nursing leaders in the four municipalities involved. The municipalities were represented in all stages of the research process through co-author LS, that is, design, data collection, data analysis, writing of the manuscript as well as dissemination of the results to the four municipalities.</p>\n </section>\n \n <section>\n \n <h3> Implications for Practice</h3>\n \n <p>The Ms. Olsen test exemplifies a move towards objective assessments in nursing. Precise and reliable measurements are essential to support the ongoing professional development of nurses.</p>\n </section>\n </div>","PeriodicalId":48651,"journal":{"name":"International Journal of Older People Nursing","volume":"19 5","pages":""},"PeriodicalIF":1.6000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/opn.12648","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Older People Nursing","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/opn.12648","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

Aim

This paper aims to report on two modifications made to improve the measurement precision of the Ms. Olsen test. Specifically, three items were added to the Ms. Olsen test and an extended scoring was applied to some items.

Design

The competence assessment had a quantitative cross-sectional design comprising of test results from 111 Registered Nurses in four municipalities in South-Eastern Norway.

Methods

The Rasch model was applied to evaluate the measurement properties in four versions: the Ms. Olsen test with 19 items and the same with three added items, and the Ms. Olsen test with 19 items with an expanded scoring for the original and expanded version, respectively.

Results

The person separation indexes were improved from 0.50 to 0.62. Other measurement properties were not alternating between the four versions; all had shortcomings in terms of targeting (person measure means 3.02–3.87) and unidimensionality (% t-test >5% 9.01%–13.51%).

Conclusion

The clinical relevance and relatively short time spent on testing makes the Ms. Olsen test a reasonable choice and a step in the right direction for assessing competence as a means of targeting continuous professional development of nurses throughout their career. Nevertheless, depending on what kind of decisions are to be made, reliability might still be too low and further development is suggested.

Public Contribution

The initiative for the competence assessment came from nursing leaders in the four municipalities involved. The municipalities were represented in all stages of the research process through co-author LS, that is, design, data collection, data analysis, writing of the manuscript as well as dissemination of the results to the four municipalities.

Implications for Practice

The Ms. Olsen test exemplifies a move towards objective assessments in nursing. Precise and reliable measurements are essential to support the ongoing professional development of nurses.

Abstract Image

查看原文本刊更多论文

提高奥尔森女士临床能力测试的测量精度：进一步考试。

本文旨在报告为提高奥尔森女士测试的测量精度而进行的两项修改。具体来说，在奥尔森女士测验中增加了三个项目，并对某些项目进行了扩展计分。设计能力评估采用定量横断面设计，包括挪威东南部四个城市111名注册护士的测验结果。方法应用 Rasch 模型评估了四个版本的测量属性：19 个项目的奥尔森女士测试和增加了三个项目的相同版本，以及 19 个项目的奥尔森女士测试，并分别对原始版本和扩展版本进行了扩展计分。结论临床相关性和相对较短的测试时间使奥尔森女士测验成为一个合理的选择，并在能力评估的正确方向上迈出了一步，成为护士在整个职业生涯中持续专业发展的一种手段。然而，根据需要做出的决定，可靠性可能仍然太低，建议进一步开发。在研究过程的所有阶段，即设计、数据收集、数据分析、撰写手稿以及向四个城市传播结果的阶段，四个城市都有代表参与。精确、可靠的测量对于支持护士的持续专业发展至关重要。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

International Journal of Older People Nursing Nursing-Gerontology

CiteScore

3.60

自引率

9.10%

发文量

期刊介绍： International Journal of Older People Nursing welcomes scholarly papers on all aspects of older people nursing including research, practice, education, management, and policy. We publish manuscripts that further scholarly inquiry and improve practice through innovation and creativity in all aspects of gerontological nursing. We encourage submission of integrative and systematic reviews; original quantitative, qualitative, and mixed methods research; secondary analyses of existing data; historical works; theoretical and conceptual analyses; evidence based practice projects and other practice improvement reports; and policy analyses. All submissions must reflect consideration of IJOPN''s international readership and include explicit perspective on gerontological nursing. We particularly welcome submissions from regions of the world underrepresented in the gerontological nursing literature and from settings and situations not typically addressed in that literature. Editorial perspectives are published in each issue. Editorial perspectives are submitted by invitation only.