Journal of evaluation in clinical practice最新文献

{"title":"Quality problems in clinical practice guidelines and guideline appraisal studies: Should we tolerate or eradicate?","authors":"Guo-Xun Yang, Shu-Qian Dou, Xiao-Bo Liu, Ting Que, Yong Tang, Xin Wang, Long-Zong Yan, Li-Na Zhou, Cheng-Bo Jin, Yuan Wang, Qi Wang, Kong-Jia Wu, Wen-Jun Liu","doi":"10.1111/jep.14227","DOIUrl":"https://doi.org/10.1111/jep.14227","url":null,"abstract":"<p><strong>Background: </strong>Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument have been widely used by scholars around the world to assess the methodological quality of clinical practice guidelines (CPGs). We sought to identify items or domains that are commonly scored low in the assessment, and to systematically review the issues that emerged when evaluators used the AGREE II tool for guideline quality assessment.</p><p><strong>Methods: </strong>A systematic search was conducted to identify articles published in medically relevant databases from 2022 to 2023 regarding the use of the AGREE II tool for the assessment of CPGs. We extracted six quality domains and overall quality assessment data of CPGs included in the literature, and processed the data using descriptive statistical analysis, difference analysis, regression analysis, and correlation analysis. A seven-point Likert scale was used to assess the reporting quality of the included articles.</p><p><strong>Results: </strong>151 relevant publications were identified, including 2081 guidelines published between 1990 and 2022. The results of the regression analysis showed a statistically significant impact of all domains on overall guideline quality (p < 0.001; R² = 0.777). Domain 1, 2, 3, 4, and 6 scores differed significantly over time (p < 0.001) and were increasing. The score was good for Domain 4 (median 78.00 [IQR: 62.75-89.00]; mean 74.34 [SD 18.85]) and Domain 1 (median 78.00 [IQR: 61.00-90.00]; mean 73.57 [SD 21.12]). Scores were generic for Domain 6 (median 58.33 [IQR: 25.00-83.33]; mean 53.98 [SD 34.13]), Domain 2 (median 53.00 [IQR: 33.30-72.10]; mean 53.30 [SD 24.52]) and Domain 3 (median 51.00 [IQR: 26.02-73.00]; mean 50.44 [SD 27.19]). The score was poor for Domain 5 (median 36.20 [IQR: 20.20-58.32]; mean 40.21 [SD 24.90]). In addition, the quality evaluation results of the included articles showed that 33.1% were evaluated as low and 11.9% as very low.</p><p><strong>Conclusions: </strong>AGREE II tools have facilitated the development of methodological quality for CPGs. Although the quality of CPGs has improved over time, some general low-quality problems still exist, and solving these problems will be an effective way for developers to upgrade the quality of guidelines. In addition, addressing critical issues in the evaluation of guidelines to present high-quality study reports would be another way to guide guideline development.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Impact of COVID-19 on health-related quality of life in patients with cardiovascular disease: A cross-sectional study.","authors":"Dinara Nurmukanova, Kuralbay Kurakbayev, Madamin Karataev, Venera Baisugurova, Gulzhakhan Kashafutdinova","doi":"10.1111/jep.14233","DOIUrl":"https://doi.org/10.1111/jep.14233","url":null,"abstract":"<p><strong>Background: </strong>The COVID-19 pandemic disrupted healthcare access for cardiovascular patients, potentially worsening their health outcomes and quality of life through both medical and psychological impacts.</p><p><strong>Aims: </strong>This cross-sectional study was conducted to assess the quality of life of patients with cardiovascular disease before and after the COVID-19 pandemic.</p><p><strong>Materials and methods: </strong>The work was conducted from January 9 to April 28, 2023, in Almaty city and the Almaty region. 3026 outpatients with cardiovascular pathology participated in the survey using a standardised European Quality of Life Questionnaire. The study utilized cluster, frequency analysis, and discrete statistics to analyze the impact of COVID-19 on quality of life parameters, revealing significant changes in anxiety and depression among cardiovascular patients, resulting in reduced quality of life (from 0.3% to 5.5% and 0.4; to 7.5% in the categories of extremely severe and severe manifestations, respectively).</p><p><strong>Results: </strong>An analysis of the nosological structure of cardiovascular diseases in the study group was performed and revealed that coronary heart disease occurred in 51.6% of cases, arterial hypertension in 88%, and diabetes mellitus in 34.6%. The availability of both outpatient and inpatient medical services in Almaty region and Almaty city was also assessed, and their comparative analysis was conducted, during which it was found that the need for these services in the district settlements is 10% and 12% higher, respectively, than in the city, which is particularly important for understanding the effectiveness of the public health system in the context of the COVID-19 pandemic, both at the regional and republican levels.</p><p><strong>Conclusion: </strong>This study is of practical importance for health care workers, as it allows assessing the impact of the COVID-19 pandemic on the quality of life of patients with cardiovascular diseases, which provides an opportunity to develop effective rehabilitation protocols and psychological support for this vulnerable category.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Implementation of bedside handover that includes patients or carers in hospital settings: A systematic review.","authors":"Amy Maher, Henry Hsu, Mohamed Eftal Bin Mohamed Ebrahim, Matthew Vukasovic, Andrew Coggins","doi":"10.1111/jep.14223","DOIUrl":"https://doi.org/10.1111/jep.14223","url":null,"abstract":"<p><strong>Objective: </strong>Increasing complexity in healthcare systems necessitates effective handover. While a universal structure is often recommended, many frameworks do not include the patient. A systematic review was completed examining outcomes following handover that included patients or carers using a realist-orientated paradigm.</p><p><strong>Methods: </strong>The research group used Covidence™ software and followed PRISMA guidelines. A librarian-led search of Embase, Medline, PsycINFO and SCOPUS yielded 5,790 relevant studies for screening. Included studies reported on peer-reviewed studies that assessed qualitative or quantitative outcomes resulting from patient-centred handover. To assess quality, we used the McMaster Mixed Methods Appraisal Tool (MMAT). Patient-orientated and quantitative outcomes are reported descriptively. For qualitative outcomes, we employed a deductive analytical approach. Braun and Clarke's steps were followed to develop themes with group work used to clarify and discuss the various codes. Heterogenous reporting precluded meta-analysis.</p><p><strong>Results: </strong>Thirty studies were eligible (10 mixed methods; 11 quantitative; 9 qualitative) with variable quality and scope. Most studies related to nursing-led bedside handover and originated in Anglophone countries. Positive effects were reported for patient satisfaction, engagement, autonomy and effective information exchange. Providers reported a positive experience but also barriers to implementation, cognitive load and reducing compliance over time. There were contradicting findings for patient-orientated outcomes including falls risk. Publication bias may have led to under reporting of negative trials. There was limited reporting on physician-led handovers that included patients.</p><p><strong>Conclusions: </strong>Patient-centred handover was associated with self-reported benefits for patients and providers but potential advantages over conventional handover could be undermined by barriers such as time, implementation challenges and a perceived increase in staff workload.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Measuring guideline adherence in physiotherapy: A scoping review of methodological approaches.","authors":"Carolin Bahns, Bettina Scheffler, Alexander Bremer, Christian Kopkow","doi":"10.1111/jep.14218","DOIUrl":"https://doi.org/10.1111/jep.14218","url":null,"abstract":"<p><strong>Rationale: </strong>Clinical practice guidelines summarise the existing evidence on specific health conditions and aim to optimise quality of care by providing evidence-based recommendations. Studies have reported a gap between research findings and clinical practice in physiotherapy. Guideline adherence is often used as a measure of agreement between therapeutic care and guideline recommendations. However, there is currently no standardised methodological approach for measuring guideline adherence.</p><p><strong>Aims and objective: </strong>The objective of this scoping review was to summarise the methods and results of studies that assessed guideline adherence in physiotherapy.</p><p><strong>Methods: </strong>MEDLINE, EMBASE, PEDro and CENTRAL databases were searched for relevant literature up to December 2022. Published reports of observational studies and controlled clinical trials that provided information on the assessment of guideline adherence in physiotherapists were included. The selection process was performed independently by two reviewers. The methodological quality of the identified reports was not assessed. Results were summarised narratively.</p><p><strong>Results: </strong>From a total of 2560 potentially relevant records, 53 reports were included in the analysis. Physiotherapists' adherence to guidelines was primarily assessed in the context of musculoskeletal conditions, such as low back pain (n = 25, 47.2%) and osteoarthritis (n = 8, 15.1%). A wide range of measurement approaches were used with the majority of reports using web-based surveys (n = 21, 39.6%), followed by chart reviews (n = 17, 32.1%). Most reports (n = 21, 39.6%) provided information on the level of adherence in terms of frequency dichotomising (self-reported) clinical practice as adherent or non-adherent. Adherence rates varied widely between included reports.</p><p><strong>Conclusions: </strong>Although the large number of included reports indicates a high level of interest in the topic of guideline adherence, there is considerable heterogeneity between studies regarding the methodological approaches used to assess guideline adherence in physiotherapists. This reduces the comparability of the study results.</p><p><strong>Trial registration: </strong>INPLASY (registration no. 202250081). Registered on 12th May 2022.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Turkish validity and reliability of the universal mental health literacy scale for adolescents (10-14 years): A methodological study.","authors":"Gülzade Uysal, Remziye Semerci, Rukiye Şengün, Duygu Sönmez Düzkaya","doi":"10.1111/jep.14171","DOIUrl":"https://doi.org/10.1111/jep.14171","url":null,"abstract":"<p><strong>Rationale: </strong>Mental health literacy enables adolescents to acquire information that will accompany them in their future lives and to define their attitudes and behaviors.</p><p><strong>Aims and objectives: </strong>This study evaluated the Turkish validity and reliability of the Universal Mental Health Literacy Scale for Adolescents (10-14 years).</p><p><strong>Methods: </strong>This is a methodological, correlational, cross-sectional, and descriptive study. The study was conducted with 223 adolescents. Data were collected by 'Information Form' and 'Universal Mental Health Literacy Scale for Adolescents.' Exploratory Factor Analysis, Confirmatory Factor Analysis, and Pearson Correlation analysis were used to assess the validity and reliability of the UMHL-A.</p><p><strong>Results: </strong>Item Content Validity Index (I-CVI) scores ranged from 0.94 to 0.96, while the Scale Content Validity Index (S-CVI) was 0.95. For 'Help-seeking and Stigma dimensions' χ²/df = 3.347, NFI = 0.804, IFI = 0.854, TLI = 0.778, CFI = 0.849, RMSEA = 0.103. For 'Knowledge of Mental Health and Knowledge of Mental Illnesses dimensions' χ²/df = 1.959, NFI = 0.731, IFI = 0.847, TLI = 0.774, CFI = 0.837, RMSEA = 0.066. The internal consistency and time stability were affirmed by a Hotelling T-square value of 15.241 and an F-test result of 27.793.</p><p><strong>Conclusions: </strong>This study reveals that the Turkish validity and reliability of the Universal Mental Health Literacy Scale for Adolescents is a valid and reliable tool for assessing mental health literacy among adolescents. The UMHL-A scale is a valid tool to evaluate critical aspects of mental health literacy in adolescent populations and can be used in both research and clinical practice in mental health education and intervention. It is recommended that the Turkish version of the Universal Mental Health Literacy Scale should be used to determine resilience in adolescents.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Effects of Kinesio-taping and rigid-taping on vertical jump in individuals with pes planus: A randomised crossover comparison.","authors":"Melissa Ünsalan, Mehmet Miçooğulları, Salih Angın","doi":"10.1111/jep.14228","DOIUrl":"https://doi.org/10.1111/jep.14228","url":null,"abstract":"<p><strong>Introduction: </strong>The effects of Kinesio-taping (KT) and rigid-taping (RT) on vertical jump performance have been investigated; however, remain unclear. The study was designed to compare the effects of KT and RT on vertical jump in individuals with pes planus.</p><p><strong>Methods: </strong>A total of 74 participants were diagnosed with pes planus. The foot posture index (FPI) was used to determine pes planus. Participants were randomly divided into two groups. Before taping, the vertical jump height and power were measured using a VertiMetric device as baseline data. Jump measurement was repeated after Kinesio-taping (KT) and rigid taping (RT) application to group 1 and group 2 respectively in the first period and after crossing in the second period following a 1-week washout. Crossover and equivalence analyses were used for data analysis.</p><p><strong>Results: </strong>KT and RT showed a statistically significant increase in jump height and power. However, the effect of the RT was higher compared to KT (p < 0.05).</p><p><strong>Conclusions: </strong>While both taping techniques increased jump height and power, RT was more effective than KT in improving jumping performance in individuals with pes planus, possibly because of its direct supporting function on the MLA. RT may also improve performance in various sports or clinical settings to accelerate recovery after injury or lower the risk of injury caused by poor foot posture.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Chest x-ray images: transfer learning model in COVID-19 detection","authors":"Siqi Mao PhD,&nbsp;Saltanat Kulbayeva PhD,&nbsp;Mikhail Osadchuk MD","doi":"10.1111/jep.14215","DOIUrl":"10.1111/jep.14215","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Rationale, Aims and Objectives</h3>\u0000 \u0000 <p>This research aims to develop an effective algorithm for diagnosing COVID-19 in chest X-rays using the transfer learning method and support vector machines.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Method</h3>\u0000 \u0000 <p>In total, data was collected from 10 clinics, including both large city hospitals and smaller medical institutions. This ensured a diverse range of geographical and demographic information in the sample. An extensive data set was collected, including 10,000 chest X-ray images. 5000 images represent normal cases, 3993 images represent pneumonia cases, and 1007 images represent COVID-19 cases. Machine learning methods were applied to develop a classification model, and the results were compared with seven state-of-the-art models and a lightweight CNN architecture.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The results showed that the proposed method achieves high accuracy values (Accuracy): 0.95 for COVID-19, 0.89 for pneumonia, and 0.92 for normal images (<i>p</i> &lt; 0.05). Comparison with other models demonstrates statistically significant superiority of our method in accuracy across all three classes. The EfficientNet-B0 model surpasses our method only in accuracy for normal images with <i>p</i> &lt; 0.01, confirming the advantages of our method. Our method demonstrates high sensitivity values (Sensitivity): 0.96 for COVID-19, 0.88 for pneumonia, and 0.93 for normal images (<i>p</i> &lt; 0.05), outperforming most of the compared models. Correlation analysis showed Pearson coefficients of 0.92, 0.89, and 0.94 for COVID-19, pneumonia, and normal images, respectively, confirming a high degree of consistency between predicted and true class labels. In addition, the model was validated on external datasets to assess its generalizability. This validation confirmed its high level of effectiveness in a variety of clinical settings.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>This study confirms the importance of applying machine learning methods in medical applications and opens new perspectives for early diagnosis of infectious diseases. The practical application of the obtained results can enhance the efficiency of diagnosis and control the spread of COVID-19, as well as contribute to the development of innovative methods in medical practice.</p>\u0000 </section>\u0000 </div>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":"31 1","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Use and impact of clinical pathways across various healthcare settings: A protocol for an umbrella review of global evidence.","authors":"Rishita Chandra, Maria Unwin, Viet Tran, Amanda Neil","doi":"10.1111/jep.14201","DOIUrl":"https://doi.org/10.1111/jep.14201","url":null,"abstract":"<p><strong>Aim: </strong>The proposed umbrella review aims to assess the use and impact of clinical pathways on professional practice, patient outcomes, length of hospital stay, hospital costs, patient satisfaction, and hospital staff satisfaction through a synthesis of existing systematic reviews and meta-analyses.</p><p><strong>Methods: </strong>Following PRIOR guidelines, a systematic search will be conducted in MEDLINE, Epistemonikos, and the Cochrane Library to identify relevant systematic reviews and meta-analyses, from inception till March 2024. Two reviewers will independently screen titles and abstracts, with a third resolving any disagreements. Full-text articles considered potentially relevant will be assessed for eligibility by the same process. The data extraction form will cover information about the review methods, characteristics of the included primary studies, the types of interventions evaluated, and the reported outcomes. This standardized data extraction form will be piloted by the review team on five to ten articles to ensure all relevant information is recorded. The quality of included systematic reviews and meta-analyses will be evaluated using AMSTAR 2. PROSPERO registration number is CRD42024529371.</p><p><strong>Results: </strong>The study will present a narrative synthesis of the findings, addressing the clinical and methodological heterogeneity and assessing the impact of clinical pathways on various healthcare outcomes.</p><p><strong>Conclusion and implications: </strong>This umbrella review will provide evidence-based insights into the effectiveness, challenges, and best practices of clinical pathways, guiding healthcare decision-making and identifying areas for future research. Results will be disseminated widely to inform policy and improve healthcare service delivery.</p><p><strong>Patient or public contribution: </strong>No patient or public contribution, as this paper is a protocol of an umbrella review.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The equivalence of a high-stakes objective structured clinical exam adapted to suit a virtual delivery format","authors":"Karen Coetzee MA,&nbsp;Luxshi Amirthalingam BSc,&nbsp;Tabasom Eftekari BComm,&nbsp;Sandra Monteiro PhD","doi":"10.1111/jep.14167","DOIUrl":"10.1111/jep.14167","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>The COVID-19 pandemic necessitated rapid adaptation of clinical competence assessments, including the transition of Objective Structured Clinical Examinations (OSCE) from in-person to virtual formats. This study investigates the construct equivalence of a high-stakes OSCE, originally designed for in-person delivery, when adapted for a virtual format.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A retrospective analysis was conducted using OSCE scores from the Internationally Educated Nurse Competency Assessment Program (IENCAP®). Data were collected from 15 exam administrations between January 2018 and June 2022, encompassing 2021 examinees (1936 in-person, 85 virtual). The Many-Facet Rasch Measurement (MFRM) model was employed to analyze the invariance of examinee ability, case difficulty, and criteria difficulty across in-person and virtual formats.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Results revealed overall examinee ability estimates remained invariant regardless of the OSCE format, while invariant violations were identified in only three of the 15 cases (<i>N</i> = 20%) adapted to suit the virtual format. The most significant adaptation, namely the use of a verbal physical examination to suit the virtual context achieved equivalence to its hands-on in-person counterpart given evidence of invariance across criteria estimates. Interestingly, criteria scores in invariant violated cases displayed a higher level of stability or consistency across the virtual OSCE formats versus their in-person counterpart highlighting a potential benefit of the virtual versus in-person format and potentially linked to the verbal physical examination.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The study found that while examinee ability and case difficulty estimates exhibited some invariance between in-person and virtual OSCE formats, criteria involving physical assessments faced challenges in maintaining construct equivalence. These findings highlight the need for careful consideration in adapting high-stakes clinical assessments to virtual formats to ensure fairness and reliability.</p>\u0000 </section>\u0000 </div>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":"31 1","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jep.14167","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Misconceptions about randomisation harm validity of randomised controlled trials.","authors":"Wolfgang Mastnak","doi":"10.1111/jep.14224","DOIUrl":"https://doi.org/10.1111/jep.14224","url":null,"abstract":"<p><strong>Rationale: </strong>The coherence theory of truth, the epistemology of evidence-based medicine, mathematical statistics, and axiomatic mathematics.</p><p><strong>Aims and objectives: </strong>To explore mathematical misconceptions inhering in randomised controlled trial designs, suggest improvements, encourage meta-methodological discussions and call for further interdisciplinary studies.</p><p><strong>Method: </strong>Mathematical-statistical analyses and science-philosophical considerations.</p><p><strong>Results: </strong>Randomisation does not (necessarily) generate equal samples, ergo, outcomes of usual RCTs are not as reliable as they claim. Moreover, ignoring initial sample discrepancies may cause inaccuracies similar to type I and type II errors. Insufficient awareness of these flaws harms final RCT statements about significance and evidence levels, hence their loss of trustworthiness. Statistical parameters such as the standard error of the mean may help to estimate the expected distinction between random samples.</p><p><strong>Conclusion: </strong>Researchers in EBM should be aware of systemic misconceptions in RCT standards. Pre-measurement can reduce shortcomings, e.g. through calculation how sample differences impact on usual RCT processing, or randomisation is given up in favour of mathematical minimisation of sample differences, i.e. optimising statistical sample equality. Moreover, the promising future of dynamic simulation models is highlighted.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}