Skip to main content
Erschienen in: Wiener Medizinische Wochenschrift 5-6/2015

01.03.2015 | main topic

Practical clinical skills assessment for a cohort of 680 2nd year human medicine students. Is it feasible?

verfasst von: Priv.Doz. Michaela Wagner-Menghin, Mag.Dr. Ingrid Preusche, Dr. Michael Schmidts

Erschienen in: Wiener Medizinische Wochenschrift | Ausgabe 5-6/2015

Einloggen, um Zugang zu erhalten

Summary

In clinical skills training objective structured clinical examinations (OSCEs) are the method of choice to foster learning. Hence, implementing them is challenging and expensive. Thus it is investigated how an alternative procedure that keeps OSCE’s essential elements, but assigns less stations to each student, works in terms of validity and justifiability.
Data of n = 694 students, each taking five tasks drawn semi-randomized out of a pool of 26 tasks, strictly aligned with learning objectives, are analyzed. Despite unsurprisingly low overall reliability, a justifiable pass/fail decision is possible for 480 students (69 %). The remaining group (n = 210, 30 %) is indeed larger than with longer OSCEs, and would need ongoing assessment. The tasks’ psychometric quality contributes to exams construct validity. Resource preserving short practical skills assessment is educationally valid and feasible with MedUniVienna’s human medicine cohorts of n = 680.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Biggs J. Teaching for quality learning at university. Maidenhead: Open University Press; 2003. Biggs J. Teaching for quality learning at university. Maidenhead: Open University Press; 2003.
2.
Zurück zum Zitat Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975;1(5955):447–51.CrossRefPubMedCentralPubMed Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975;1(5955):447–51.CrossRefPubMedCentralPubMed
3.
Zurück zum Zitat Petrusa ER. Clinical performance assessments. In: Norman GR, van der Vleuten CPM, Newble DI, Editors. International handbook of research in medical education. 2. Dordrecht: Kluwer; 2002. p. 673–709.CrossRef Petrusa ER. Clinical performance assessments. In: Norman GR, van der Vleuten CPM, Newble DI, Editors. International handbook of research in medical education. 2. Dordrecht: Kluwer; 2002. p. 673–709.CrossRef
4.
Zurück zum Zitat Schmidts M, Link T. Towards standardization and better comprehensibility of course content: use of a web-based text annotation tool to enhance the collaborative formative review of teaching and learning material. AMEE (Association for Medical Education in Europe)-Conference 2005, Amsterdam, 308–392005; Amsterdam, 30.8–3.9.2005. Schmidts M, Link T. Towards standardization and better comprehensibility of course content: use of a web-based text annotation tool to enhance the collaborative formative review of teaching and learning material. AMEE (Association for Medical Education in Europe)-Conference 2005, Amsterdam, 308–392005; Amsterdam, 30.8–3.9.2005.
5.
Zurück zum Zitat Pucher-Matzner IF O, Eisenwort B, Gleiss A, Schmidts M. Entwicklung eines Instruments zur Beurteilung kommunikativer Fertigkeiten im Medizinstudium [Developing an instrument to evaluate communication skills in medical trainig]. 9 Grazer Konferenz Qualität der Lehre [9th Graz-conference on quality on teaching], Innsbruck 23.9.–24.9.2005. Pucher-Matzner IF O, Eisenwort B, Gleiss A, Schmidts M. Entwicklung eines Instruments zur Beurteilung kommunikativer Fertigkeiten im Medizinstudium [Developing an instrument to evaluate communication skills in medical trainig]. 9 Grazer Konferenz Qualität der Lehre [9th Graz-conference on quality on teaching], Innsbruck 23.9.–24.9.2005.
6.
Zurück zum Zitat Assadian O, Blacky A, Koller W, Pucher I, Eisenwort B, Frischenschlager O, et al. Skills line—der Famulaturvorbereitende Unterricht an der Medizinischen Universität Wien [Skills-line: Preparing Students for their first Mandatory Clerkship at Medical University Vienna]. 9 Grazer Konferenz Qualität der Lehre [9th Graz-conference on quality on teaching], Innsbruck 23.9.–24.9.2005. Assadian O, Blacky A, Koller W, Pucher I, Eisenwort B, Frischenschlager O, et al. Skills line—der Famulaturvorbereitende Unterricht an der Medizinischen Universität Wien [Skills-line: Preparing Students for their first Mandatory Clerkship at Medical University Vienna]. 9 Grazer Konferenz Qualität der Lehre [9th Graz-conference on quality on teaching], Innsbruck 23.9.–24.9.2005.
7.
Zurück zum Zitat Schmidts M. OSCE-logistics-handheld computers replace checklists and provide automated feedback. Med Educ. 2000;34:957–8.CrossRefPubMed Schmidts M. OSCE-logistics-handheld computers replace checklists and provide automated feedback. Med Educ. 2000;34:957–8.CrossRefPubMed
8.
Zurück zum Zitat Treadwell I, Schmidts M. Thumbs up for electronic osce assessment. Educación Mèdica. 2004;7(3):19. Treadwell I, Schmidts M. Thumbs up for electronic osce assessment. Educación Mèdica. 2004;7(3):19.
9.
Zurück zum Zitat Wright BD, Masters GN. Rating scale analysis. Chicago: MESA Press; 1982. Wright BD, Masters GN. Rating scale analysis. Chicago: MESA Press; 1982.
10.
Zurück zum Zitat Van der Linden WJ, Glas CAW, Editors. Computerized Adaptive Testing: Theory and Practice. St. Paul (MN): Assessment Systems Corporation; 2000. Van der Linden WJ, Glas CAW, Editors. Computerized Adaptive Testing: Theory and Practice. St. Paul (MN): Assessment Systems Corporation; 2000.
11.
Zurück zum Zitat Bond TG, Fox CM. Applying the rasch-model. fundamental measurement in the human sciences. Mahwah: Lawrence Erlbaum; 2001. Bond TG, Fox CM. Applying the rasch-model. fundamental measurement in the human sciences. Mahwah: Lawrence Erlbaum; 2001.
13.
Zurück zum Zitat Linacre JM. Rasch-based generalizability theory. Rasch Measurement Transactions. 1993;7:283–4. Linacre JM. Rasch-based generalizability theory. Rasch Measurement Transactions. 1993;7:283–4.
14.
Zurück zum Zitat Shatzer JH, Darosa D, Colliver JA, Barkmeier L. station-length requirements for reliable performance-based examination scores. Acad Med. 1993;68(3):224–9.CrossRefPubMed Shatzer JH, Darosa D, Colliver JA, Barkmeier L. station-length requirements for reliable performance-based examination scores. Acad Med. 1993;68(3):224–9.CrossRefPubMed
15.
Zurück zum Zitat Verhoeven BH, Hamers J, Scherpbier A, Hoogenboom RJI, van der Vleuten CPM. The effect on reliability of adding a separate written assessment component to an objective structured clinical examination. Med Educ. 2000;34(7):525–9.CrossRefPubMed Verhoeven BH, Hamers J, Scherpbier A, Hoogenboom RJI, van der Vleuten CPM. The effect on reliability of adding a separate written assessment component to an objective structured clinical examination. Med Educ. 2000;34(7):525–9.CrossRefPubMed
16.
Zurück zum Zitat Andersen EB. A goodness of fit test for the Rasch model. Psychometrika. 1973;38:123–40.CrossRef Andersen EB. A goodness of fit test for the Rasch model. Psychometrika. 1973;38:123–40.CrossRef
Metadaten
Titel
Practical clinical skills assessment for a cohort of 680 2nd year human medicine students. Is it feasible?
verfasst von
Priv.Doz. Michaela Wagner-Menghin
Mag.Dr. Ingrid Preusche
Dr. Michael Schmidts
Publikationsdatum
01.03.2015
Verlag
Springer Vienna
Erschienen in
Wiener Medizinische Wochenschrift / Ausgabe 5-6/2015
Print ISSN: 0043-5341
Elektronische ISSN: 1563-258X
DOI
https://doi.org/10.1007/s10354-015-0348-7

Weitere Artikel der Ausgabe 5-6/2015

Wiener Medizinische Wochenschrift 5-6/2015 Zur Ausgabe