A Comparative Study between the Conventional MCQ Scores and MCQ with the CBA Scores at the Standardized Clinical Knowledge Exam for Clinical Medical Students release_qfuxg5y2u5dctcutffjiwmwjje

by Mahmood Ghadermarzi, Shahram Yazdani, Arash Pooladi, Fakhrosadat Hosseini

Published in Journal of Medical Education by Shaheed Beheshti University of Medical Sciences and Health Services.

2015   Volume 14

Abstract

Background and purpose: Partial knowledge is one of the main factors to be considered when dealing with the improvement of the administration of Multiple Choice Questions (MCQ) in testing. Various strategies have been proposed for this factor in the traditional testing environment. Therefore, this study proposed a Confidence Based Assessment (CBA) as a pertinent solution and aims at comparing the effect of the CBA Scoring system with that of the conventional scoring systems (with and without negative score estimation as penalty) on the students' scores and estimating their partial knowledge on clinical studies.<br />Methods: This comparative study was conducted using a standardized clinical knowledge exam for 117 clinical students. After two-step training, both the conventional MCQ and CBA examination was given in a single session simultaneously. The exam included 100 questions and the volunteers were requested to complete a questionnaire regarding their attitude and satisfaction on their first experience of the CBA after exam. A new confidence based marking system was selected for the scoring, which was a hybrid of the UCL and MUK2010 systems. The MCQ-Assistant, SPSS and Microsoft office Excel software were used for scoring and data analysis.<br />Results: The mean age of the volunteers was 27.3±5.47, of whom 43.6% were men and 69.2% were senior medical students. Exam reliability was 0.977. The fit line of the MCQ scores without penalty estimation was R2=0.9816 and Intercept=18.125 or approximately.2 deviation in the low scores. The MCQ scoring with penalty had a fit line approximately parallel to the 45-degree line but on or above it and the CBA scoring fit line was nearer to the 45-degree line, parallel to it and a little below it. These two sets of scores had a significant p value0.037. The response percentage to the CBA is higher (p value=0.0001). The discrimination power of the MCQ and the CBA for the upper and lower 1/3 of the students was not significantly different (p value=0.34). The students' satisfact [...]
In text/plain format

Archived Files and Locations

application/pdf  937.9 kB
file_lfqc4hoc3bd3pntxmn4jlpfxbe
journals.sbmu.ac.ir:80 (publisher)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Year   2015
Language   en ?
Journal Metadata
Open Access Publication
In DOAJ
In Keepers Registry
ISSN-L:  1735-3998
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: b26307e5-d73e-496c-b34e-54e2b22d3195
API URL: JSON