{"title":"多面Rasch模型在国家医师资格考试分阶段临床基础技能考试第一阶段中的应用","authors":"Yan Lu, Ying Zhang, Junfeng He, Jiewen Zou","doi":"10.3760/CMA.J.CN115259-20190822-00679","DOIUrl":null,"url":null,"abstract":"Objective \nTo evaluate the mastery of scoring standards by raters in 2018 clinical fundamental skills test of National Medical Licensing Examination phased the first stage, to explore the consistency between standardized patients (SP) and examiners' scores, and to provide more information for relevant research. \n \n \nMethods \nIn 2018, based on the scores of communication capacity and humanistic care from 77 candidates in clinical fundamental skills test of the National Medical Licensing Examination phased the first stage in a randomly selected medical college, use the many facets Rasch model to calculate estimated ability of 77 candidates, analyze the internal consistency of raters and the leniency and strictness of evaluation. \n \n \nResults \nThe results showed that the average estimated capacity of 77 candidates was 2.75 logits, and the most examinees' infit was less than 1.5.The average severity of the raters was -0.55, the severity of the examiners was -0.45, of the SP was -0.70, The difference was not statistically significant. \n \n \nConclusions \nRaters have a good command of scoring standards, the overall standard is relatively loose.The scores of SP and examiners were consistent. \n \n \nKey words: \nNational medical licensing examination; Rater error; Rasch theory; Many facets Rasch model; Standardized patients","PeriodicalId":427675,"journal":{"name":"Chinese Journal of Medical Education","volume":"39 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The application of many facets Rasch model in the first stage clinical fundamental skills test of National Medical Licensing Examination phased examination\",\"authors\":\"Yan Lu, Ying Zhang, Junfeng He, Jiewen Zou\",\"doi\":\"10.3760/CMA.J.CN115259-20190822-00679\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Objective \\nTo evaluate the mastery of scoring standards by raters in 2018 clinical fundamental skills test of National Medical Licensing Examination phased the first stage, to explore the consistency between standardized patients (SP) and examiners' scores, and to provide more information for relevant research. \\n \\n \\nMethods \\nIn 2018, based on the scores of communication capacity and humanistic care from 77 candidates in clinical fundamental skills test of the National Medical Licensing Examination phased the first stage in a randomly selected medical college, use the many facets Rasch model to calculate estimated ability of 77 candidates, analyze the internal consistency of raters and the leniency and strictness of evaluation. \\n \\n \\nResults \\nThe results showed that the average estimated capacity of 77 candidates was 2.75 logits, and the most examinees' infit was less than 1.5.The average severity of the raters was -0.55, the severity of the examiners was -0.45, of the SP was -0.70, The difference was not statistically significant. \\n \\n \\nConclusions \\nRaters have a good command of scoring standards, the overall standard is relatively loose.The scores of SP and examiners were consistent. \\n \\n \\nKey words: \\nNational medical licensing examination; Rater error; Rasch theory; Many facets Rasch model; Standardized patients\",\"PeriodicalId\":427675,\"journal\":{\"name\":\"Chinese Journal of Medical Education\",\"volume\":\"39 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chinese Journal of Medical Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3760/CMA.J.CN115259-20190822-00679\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chinese Journal of Medical Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3760/CMA.J.CN115259-20190822-00679","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
The application of many facets Rasch model in the first stage clinical fundamental skills test of National Medical Licensing Examination phased examination
Objective
To evaluate the mastery of scoring standards by raters in 2018 clinical fundamental skills test of National Medical Licensing Examination phased the first stage, to explore the consistency between standardized patients (SP) and examiners' scores, and to provide more information for relevant research.
Methods
In 2018, based on the scores of communication capacity and humanistic care from 77 candidates in clinical fundamental skills test of the National Medical Licensing Examination phased the first stage in a randomly selected medical college, use the many facets Rasch model to calculate estimated ability of 77 candidates, analyze the internal consistency of raters and the leniency and strictness of evaluation.
Results
The results showed that the average estimated capacity of 77 candidates was 2.75 logits, and the most examinees' infit was less than 1.5.The average severity of the raters was -0.55, the severity of the examiners was -0.45, of the SP was -0.70, The difference was not statistically significant.
Conclusions
Raters have a good command of scoring standards, the overall standard is relatively loose.The scores of SP and examiners were consistent.
Key words:
National medical licensing examination; Rater error; Rasch theory; Many facets Rasch model; Standardized patients