Application of objective structured clinical examination in annual assessment of standardised training for residents
-
摘要:
目的 通过开展对客观结构化临床考试(objective structured clinical examination, OSCE)在住院医师规范化培训年度考核中应用的研究，指导今后OSCE的试题设置，使试题更规范、合理。 方法 选取参加2020年蚌埠医学院第一附属医院住院医师规范化培训年度考核的内科专业学员2018级62人、2019级64人的考核成绩为研究对象，分别分析OSCE设置的信度、效度、难度、区分度，并比较2个年级学员各站考试分数，讨论OSCE试题设置的合理程度及培训时间对成绩的影响。 结果 OSCE设置的信度选择评价者信度进行分析，结果良好；效度使用内容效度进行评价，效度较高；OSCE试题对于2018级学员的难度在0.55~0.78、总难度为0.72，对于2019级学员的难度在0.49~0.79、总难度为0.67，2个年级的单站难度、总体难度基本达到适宜标准；OSCE试题对于2018级学员的区分度为0.18，对于2019级学员的区分度为0.19，稍嫌不足；比较2个年级学员各站考试分数，2018级学员有5站(共6站)成绩高于2019级学员，差异有统计学意义(P < 0.001)。 结论 本次OSCE考站设置较为合理，可以客观反映学员的培训水平及临床实践能力，考核区分度有上升空间，培训时间与成绩呈正相关。 Abstract:Objective To guide the examination question setting of Objective Structured Clinical Examination (OSCE) in the future and make the examination questions more standardised and reasonable through research on the application of OSCE in the annual assessment of standardised training for residents. Methods The assessment results of 62 internal medicine students in 2018 and 64 in 2019 who participated in the annual assessment of standardized training for residents in the First Affiliated Hospital of Bengbu Medical College in 2020 were selected as the research object. The reliability, validity, difficulty, degree of differentiation of OSCE were respectively analysed. The test scores of students of two grades at each station were compared. The reasonable degree of OSCE test question setting and the impact of training time on their scores were discussed. Results The OSCE reliability selection evaluator was analysed, and the results were good. Validity was evaluated by content validity, which was relatively high. The OSCE tests ranged from 0.55 to 0.78 with a total difficulty of 0.72 for 2018 students, and from 0.49 to 0.79 with a total difficulty of 0.67 for 2019 students. The single-station difficulty and overall difficulty of the two grades basically reached the appropriate standard. The distinction of the OSCE question for the class of 2018 was 0.18, and the distinction for the class of 2019 was 0.19, which was insufficient. By comparing the test scores of students in each station of both grades, there were five stations (a total of six stations) of students in the class of 2018 whose scores were higher than those of students in the class of 2019, and the difference was statistically significant (P < 0.001). Conclusion The OSCE examination station is set reasonably, which can objectively reflect the training level and clinical practice ability of the students, and there is room for improvement in the assessment differentiation. The training time is positively correlated with the results. -
表 1 OSCE内科学专业单站及总体难度统计
站别 2018级 2019级 平均分 单站满分 难度 平均分 单站满分 难度 影像判读 15.0 20 0.75 13.5 20 0.67 体格检查 15.3 20 0.76 14.2 20 0.71 技能操作 15.7 20 0.78 13.9 20 0.69 心肺复苏 11.2 15 0.74 11.8 15 0.79 病史采集 15.2 20 0.76 13.2 20 0.66 病例分析 11.0 20 0.55 9.9 20 0.49 总体难度 0.72 0.67 
下载: 导出CSV
表 2 OCSE内科学专业试题区分度
年级 XH(27%高分组平均分) XL(27%低分组平均分) W(试卷总分) 区分度 2018级 88.19 77.76 115 0.18 2019级 81.24 71.56 115 0.17
下载: 导出CSV
表 3 2018、2019级住培学员考核分数情况(x ±s，分)
年级 人数 影像判读 体格检查 技能操作 心肺复苏 病史采集 病例分析 2018级 62 14.98±1.65 15.27±1.58 15.66±1.69 11.17±1.07 15.16±0.92 11.00±2.16 2019级 64 13.39±2.13 14.12±1.98 13.79±1.43 11.80±0.78 13.21±1.19 9.84±1.67 t值 5.812 4.123 8.651 -4.286 10.963 3.492 P值 ＜0.001 ＜0.001 ＜0.001 ＜0.001 ＜0.001 0.001
下载: 导出CSV
-
[1] CHAN T, SEBOK-SYER S, THOMA B, et al. Learning analytics in medical education assessment: The past, the present, and the future[J]. AEM Educ Train, 2018, 2(2): 178-187. doi: 10.1002/aet2.10087 [2] 贾忠武. 从《疡科心得集》分析高秉钧的学术思想[J]. 中华中医药杂志, 2018, 33(9): 3849-3851. https://www.cnki.com.cn/Article/CJFDTOTAL-BXYY201809033.htm [3] 袁雪姣, 任依. 客观结构化临床考试在评价脑血管病住院医师人文沟通能力中的应用[J]. 中国卒中杂志, 2020, 15(11): 1244-1247. doi: 10.3969/j.issn.1673-5765.2020.11.015 [4] 董克用, 朱勇. 人力资源管理专业知识与实务[M]. 北京: 中国人事出版社, 2019: 79-80. [5] 杨洁凤, 文秀, 杨敏, 等. 基于经典测量理论的《护理学导论》课程试卷质量评价、成绩分析及教学思考[J]. 中华医学教育探索杂志, 2020, 19(10): 1237-1240. [6] ROSHAL J A, CHEFITZ D, TERREGINO C A, et al. Comparison of self and simulated patient assessments of first-year medical students' Interpersonal and Communication Skills (ICS) during Objective Structured Clinical Examinations (OSCE)[J]. BMC Med Educ, 2021, 21(1): 107-109. doi: 10.1186/s12909-021-02540-y [7] 高思敬, 高憩云. 外科全书[M]. 北京: 人民卫生出版社, 2018: 473-558. [8] 梁世杰. OSCE在规范化培训护士临床护理实践能力评价中的应用[D]. 青岛: 青岛大学, 2019. [9] 王颖, 刘睿, 邓洁初, 等. 客观结构化临床考试在中医住院医师规范化培训技能大赛中的应用[J]. 中医药导报, 2021, 27(1): 214-217. https://www.cnki.com.cn/Article/CJFDTOTAL-HNZB202101053.htm [10] 王丹, 陈艾. 客观结构化临床考核对儿科医师里程碑式规范化培训后的实践胜任力评估[J]. 教育教学论坛, 2020(36): 146-147. https://www.cnki.com.cn/Article/CJFDTOTAL-JYJU202036064.htm [11] 宣玲, 唐碧, 张恒, 等. 角色扮演在全科医学专业心内科临床带教中的应用[J]. 中华全科医学, 2019, 17(7): 1198-1200. https://www.cnki.com.cn/Article/CJFDTOTAL-SYQY201907039.htm [12] 石跃岑, 毛心茹, 崔明慧, 等. OSCE智能化管理平台在医学本科生临床综合能力考核中的应用[J]. 医学教育研究与实践, 2021, 29(1): 86-90. https://www.cnki.com.cn/Article/CJFDTOTAL-XBYX202101025.htm [13] 秦福芳, 张思森, 王留义, 等. 多学科协作教学在全科医师规培学员临床教学中的应用[J]. 中华全科医学, 2019, 17(10): 1758-1761. https://www.cnki.com.cn/Article/CJFDTOTAL-SYQY201910041.htm [14] 王丹妮, 刘博. 客观结构化临床考试在耳鼻咽喉科住院医师规范化培训考核中的应用[J]. 中国耳鼻咽喉头颈外科, 2020, 27(12): 727-728. https://www.cnki.com.cn/Article/CJFDTOTAL-EBYT202012017.htm [15] 李小玲, 黄厚强, 郑思琳, 等. TSP/OSCE模式在康复护理本科学生临床实践教学指导与考核中的应用[J]. 全科护理, 2021, 19(7): 997-1000. https://www.cnki.com.cn/Article/CJFDTOTAL-JTHS202107042.htm -
点击查看大图
图(1) / 表(3)
计量
- 文章访问数: 515
- HTML全文浏览量: 143
- PDF下载量: 8
- 被引次数: 0
