Evaluating the Study Designs and Outcome Measures Used in Service User Involvement in Health Professional Entry-Level Education: A Systematic Review

IF 3.2 3区医学 Q2 HEALTH CARE SCIENCES & SERVICES

Health Expectations Pub Date : 2025-09-27 DOI:10.1111/hex.70439

Jonathan Green, Jennifer Oates, Sam Robertson, Elizabeth Barley, Chris Jacobs

{"title":"Evaluating the Study Designs and Outcome Measures Used in Service User Involvement in Health Professional Entry-Level Education: A Systematic Review","authors":"Jonathan Green, Jennifer Oates, Sam Robertson, Elizabeth Barley, Chris Jacobs","doi":"10.1111/hex.70439","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>It is a regulatory requirement in the United Kingdom and Australia that people who use services are involved in health professional education. Evaluating service user involvement aims to inform curriculum development and improvement. However, although there is research evaluating service user involvement in medical education, optimal outcome measures for other health professionals have not been identified.</p>\n </section>\n \n <section>\n \n <h3> Objective</h3>\n \n <p>This study focused on service user involvement in entry-level education for nurses, midwives, allied health professionals, social workers and pharmacists. The aim was to (i) identify study characteristics, designs and methods used to measure outcomes, (ii) describe the characteristics of outcome measures used and (iii) identify the extent to which the outcome measures aligned with the modified Kirkpatrick Evaluation Framework.</p>\n </section>\n \n <section>\n \n <h3> Search Strategy</h3>\n \n <p>Medline, CINAHL and PsychINFO databases were systematically searched for studies published over a 24-year period between 2000 and 2024. Two reviewers independently screened studies. A narrative synthesis was conducted. Measures were mapped to the modified Kirkpatrick Evaluation Framework.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Nineteen studies using 29 measures were selected. Study designs were mostly quasi-experimental with small university-based samples. Data were typically collected pre- and post-service user involvement, assessing changes in student knowledge and attitudes. Measures assessed the perspective of students (<i>n</i> = 29) and educators (<i>n</i> = 1), but not the service users' perspective (<i>n</i> = 0). Eight of the measures were validated; four for student health professionals and four for other populations. No measures aligned with the highest levels of the modified Kirkpatrick Evaluation Framework regarding the impact of service user involvement on the health system and patients.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>Limitations in the study designs reduced the comparability and generalisability of the identified studies. None of the measures evaluated the impact of service user involvement on the health system or patients. Educators' perspectives on the service users' involvement in the education were limited. Service users' perspectives were absent. To embed a culture of involvement, future research is needed to identify the requirements of outcome measures from the perspective of service users and educators.</p>\n </section>\n \n <section>\n \n <h3> Patient and Public Contribution</h3>\n \n <p>Co-author (S.R.), a lead for service user and carer involvement at an NHS Trust, guided the study design, data analysis and manuscript development.</p>\n </section>\n </div>","PeriodicalId":55070,"journal":{"name":"Health Expectations","volume":"28 5","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2025-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476030/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health Expectations","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/hex.70439","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}

引用次数: 0

Abstract

Background

It is a regulatory requirement in the United Kingdom and Australia that people who use services are involved in health professional education. Evaluating service user involvement aims to inform curriculum development and improvement. However, although there is research evaluating service user involvement in medical education, optimal outcome measures for other health professionals have not been identified.

Objective

This study focused on service user involvement in entry-level education for nurses, midwives, allied health professionals, social workers and pharmacists. The aim was to (i) identify study characteristics, designs and methods used to measure outcomes, (ii) describe the characteristics of outcome measures used and (iii) identify the extent to which the outcome measures aligned with the modified Kirkpatrick Evaluation Framework.

Search Strategy

Medline, CINAHL and PsychINFO databases were systematically searched for studies published over a 24-year period between 2000 and 2024. Two reviewers independently screened studies. A narrative synthesis was conducted. Measures were mapped to the modified Kirkpatrick Evaluation Framework.

Results

Nineteen studies using 29 measures were selected. Study designs were mostly quasi-experimental with small university-based samples. Data were typically collected pre- and post-service user involvement, assessing changes in student knowledge and attitudes. Measures assessed the perspective of students (n = 29) and educators (n = 1), but not the service users' perspective (n = 0). Eight of the measures were validated; four for student health professionals and four for other populations. No measures aligned with the highest levels of the modified Kirkpatrick Evaluation Framework regarding the impact of service user involvement on the health system and patients.

Conclusion

Limitations in the study designs reduced the comparability and generalisability of the identified studies. None of the measures evaluated the impact of service user involvement on the health system or patients. Educators' perspectives on the service users' involvement in the education were limited. Service users' perspectives were absent. To embed a culture of involvement, future research is needed to identify the requirements of outcome measures from the perspective of service users and educators.

Patient and Public Contribution

Co-author (S.R.), a lead for service user and carer involvement at an NHS Trust, guided the study design, data analysis and manuscript development.

Abstract Image

查看原文本刊更多论文

评价服务使用者参与卫生专业入门级教育的研究设计和结果测量：一项系统回顾。

背景：在英国和澳大利亚，使用服务的人参与卫生专业教育是一项监管要求。评估服务使用者参与的目的是为课程的发展和改进提供信息。然而，虽然有研究评价服务使用者参与医学教育，但尚未确定其他卫生专业人员的最佳结果措施。目的：本研究的重点是服务用户参与初级教育护士，助产士，专职卫生专业人员，社会工作者和药剂师。目的是(i)确定用于测量结果的研究特征、设计和方法，（ii）描述所使用的结果测量的特征，（iii）确定结果测量与修改后的Kirkpatrick评估框架一致的程度。检索策略：系统检索Medline， CINAHL和PsychINFO数据库，检索2000年至2024年24年间发表的研究。两名评论者独立筛选研究。进行了叙事综合。测量被映射到修改后的Kirkpatrick评估框架。结果：选取了19项研究，采用29种测量方法。研究设计大多是准实验的，以大学为基础的小样本。数据通常收集服务前和服务后用户参与，评估学生的知识和态度的变化。测量评估了学生（n = 29）和教育工作者（n = 1）的观点，但没有评估服务使用者的观点（n = 0）。其中8项措施得到了验证；4名学生健康专业人员和4名其他人群。关于服务使用者参与对卫生系统和患者的影响，没有措施符合经修订的柯克帕特里克评估框架的最高水平。结论：研究设计的局限性降低了研究的可比性和普遍性。没有一项措施评估服务使用者参与对卫生系统或患者的影响。教育工作者对服务使用者参与教育的看法有限。没有服务用户的观点。为了嵌入一种参与文化，未来的研究需要从服务使用者和教育工作者的角度确定结果测量的要求。患者和公众贡献：合著者（S.R.）， NHS信托服务用户和护理人员参与的领导者，指导研究设计，数据分析和手稿开发。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Health Expectations 医学-公共卫生、环境卫生与职业卫生

CiteScore

5.20

自引率

9.40%

发文量

251

审稿时长

>12 weeks

期刊介绍： Health Expectations promotes critical thinking and informed debate about all aspects of patient and public involvement and engagement (PPIE) in health and social care, health policy and health services research including: • Person-centred care and quality improvement • Patients'' participation in decisions about disease prevention and management • Public perceptions of health services • Citizen involvement in health care policy making and priority-setting • Methods for monitoring and evaluating participation • Empowerment and consumerism • Patients'' role in safety and quality • Patient and public role in health services research • Co-production (researchers working with patients and the public) of research, health care and policy Health Expectations is a quarterly, peer-reviewed journal publishing original research, review articles and critical commentaries. It includes papers which clarify concepts, develop theories, and critically analyse and evaluate specific policies and practices. The Journal provides an inter-disciplinary and international forum in which researchers (including PPIE researchers) from a range of backgrounds and expertise can present their work to other researchers, policy-makers, health care professionals, managers, patients and consumer advocates.