Feasibility and reliability of an in-training assessment programme in an undergraduate clerkship

H. E.M. Daelmans, H. H. Van Der Hem-Stokroos, R. J.I. Hoogenboom, A. J.J.A. Scherpbier, C. D.A. Stehouwer, C. P.M. Van Der Vleuten

Research output: Contribution to JournalArticleAcademicpeer-review

10 Citations (Scopus)

Abstract

INTRODUCTION: Structured assessment, embedded in a training programme, with systematic observation, feedback and appropriate documentation may improve the reliability of clinical assessment. This type of assessment format is referred to as in-training assessment (ITA). The feasibility and reliability of an ITA programme in an internal medicine clerkship were evaluated. The programme comprised 4 ward-based test formats and 1 outpatient clinic-based test format. Of the 4 ward-based test formats, 3 were single-sample tests, consisting of 1 student-patient encounter, 1 critical appraisal session and 1 case presentation. The other ward-based test and the outpatient-based test were multiple sample tests, consisting of 12 ward-based case write-ups and 4 long cases in the outpatient clinic. In all the ITA programme consisted of 19 assessments. METHODS: During 41 months, data were collected from 119 clerks. Feasibility was defined as over two thirds of the students obtaining 19 assessments. Reliability was estimated by performing generalisability analyses with 19 assessments as items and 5 test formats as items. RESULTS: A total of 73 students (69%) completed 19 assessments. Reliability expressed by the generalisability coefficients was 0.81 for 19 assessments and 0.55 for 5 test formats. CONCLUSIONS: The ITA programme proved to be feasible. Feasibility may be improved by scheduling protected time for assessment for both students and staff. Reliability may be improved by more frequent use of some of the test formats.

Original languageEnglish
Pages (from-to)1270-1277
Number of pages8
JournalMedical education
Volume38
Issue number12
DOIs
Publication statusPublished - Dec 2004

Keywords

  • Clinical clerkship/standards
  • Education, medical, undergraduate/ *standards
  • Educational measurement/standards
  • Reproducibility of results

Cite this