Skip to main content
Erschienen in: Wiener klinische Wochenschrift 9-10/2016

01.05.2016 | original article

Medical University admission test: a confirmatory factor analysis of the results

verfasst von: Marion Luschin-Ebengreuth, Hans P. Dimai, Daniel Ithaler, Heide M. Neges, Gilbert Reibnegger

Erschienen in: Wiener klinische Wochenschrift | Ausgabe 9-10/2016

Einloggen, um Zugang zu erhalten

Summary

Background

The Graz Admission Test has been applied since the academic year 2006/2007. The validity of the Test was demonstrated by a significant improvement of study success and a significant reduction of dropout rate. The purpose of this study was a detailed analysis of the internal correlation structure of the various components of the Graz Admission Test. In particular, the question investigated was whether or not the various test parts constitute a suitable construct which might be designated as “Basic Knowledge in Natural Science.”

Methods

This study is an observational investigation, analyzing the results of the Graz Admission Test for the study of human medicine and dentistry. A total of 4741 applicants were included in the analysis. Principal component factor analysis (PCFA) as well as techniques from structural equation modeling, specifically confirmatory factor analysis (CFA), were employed to detect potential underlying latent variables governing the behavior of the measured variables.

Results

PCFA showed good clustering of the science test parts, including also text comprehension. A putative latent variable “Basic Knowledge in Natural Science,” investigated by CFA, was indeed shown to govern the response behavior of the applicants in biology, chemistry, physics, and mathematics as well as text comprehension. The analysis of the correlation structure of the various test parts confirmed that the science test parts together with text comprehension constitute a satisfactory instrument for measuring a latent construct variable “Basic Knowledge in Natural Science.”

Conclusions

The present results suggest the fundamental importance of basic science knowledge for results obtained in the framework of the admission process for medical universities.
Literatur
1.
Zurück zum Zitat Shulruf B, Poole P, Wang GY, Rudland J, Wilkinson T. How well do selection tools predict performance later in a medical programme? Adv Health Sci Educ Theory Pract. 2012;17(5):615–26.CrossRefPubMed Shulruf B, Poole P, Wang GY, Rudland J, Wilkinson T. How well do selection tools predict performance later in a medical programme? Adv Health Sci Educ Theory Pract. 2012;17(5):615–26.CrossRefPubMed
2.
Zurück zum Zitat Lumsden MA, Bore M, Millar K, Jack R, Powis D. Assessment of personal qualities in relation to admission to medical school. Med Educ. 2005;39(3):258–65.CrossRefPubMed Lumsden MA, Bore M, Millar K, Jack R, Powis D. Assessment of personal qualities in relation to admission to medical school. Med Educ. 2005;39(3):258–65.CrossRefPubMed
3.
Zurück zum Zitat Hissbach JC, Klusmann D, Hampe W. Dimensionality and predictive validity of the HAM-Nat, a test of natural sciences for medical school admission. BMC Med Educ. 2011;11:83.CrossRefPubMedPubMedCentral Hissbach JC, Klusmann D, Hampe W. Dimensionality and predictive validity of the HAM-Nat, a test of natural sciences for medical school admission. BMC Med Educ. 2011;11:83.CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat Siu E, Reiter HI. Overview: what’s worked and what hasn’t as a guide towards predictive admissions tool development. Adv Health Sci Educ Theory Pract. 2009;14(5):759–75.CrossRefPubMed Siu E, Reiter HI. Overview: what’s worked and what hasn’t as a guide towards predictive admissions tool development. Adv Health Sci Educ Theory Pract. 2009;14(5):759–75.CrossRefPubMed
5.
Zurück zum Zitat Hurwitz S, Kelly B, Powis D, Smyth R, Lewin T. The desirable qualities of future doctors—a study of medical student perceptions. Med Teach. 2013;35(7):e1332–9.CrossRefPubMed Hurwitz S, Kelly B, Powis D, Smyth R, Lewin T. The desirable qualities of future doctors—a study of medical student perceptions. Med Teach. 2013;35(7):e1332–9.CrossRefPubMed
6.
Zurück zum Zitat Albanese MA, Snow MH, Skochelak SE, Huggett KN, Farrell PM. Assessing personal qualities in medical school admissions. Acad Med. 2003;78(3):313–21.CrossRefPubMed Albanese MA, Snow MH, Skochelak SE, Huggett KN, Farrell PM. Assessing personal qualities in medical school admissions. Acad Med. 2003;78(3):313–21.CrossRefPubMed
7.
Zurück zum Zitat Wilson IG, Roberts C, Flynn EM, Griffin B. Only the best: medical student selection in Australia. Med J Aust. 2012;196(5):357.CrossRefPubMed Wilson IG, Roberts C, Flynn EM, Griffin B. Only the best: medical student selection in Australia. Med J Aust. 2012;196(5):357.CrossRefPubMed
8.
Zurück zum Zitat Lievens F. Adjusting medical school admission: assessing interpersonal skills using situational judgement tests. Med Educ. 2013;47(2):182–9.CrossRefPubMed Lievens F. Adjusting medical school admission: assessing interpersonal skills using situational judgement tests. Med Educ. 2013;47(2):182–9.CrossRefPubMed
9.
Zurück zum Zitat Oates K, Goulston K. How to select the doctors of the future. Intern Med J. 2012;42(4):364–9.CrossRefPubMed Oates K, Goulston K. How to select the doctors of the future. Intern Med J. 2012;42(4):364–9.CrossRefPubMed
10.
Zurück zum Zitat Emery JL, Bell JF, Vidal Rodeiro CL. The BioMedical admissions test for medical student selection: issues of fairness and bias. Med Teach. 2011;33(1):62–71.CrossRefPubMed Emery JL, Bell JF, Vidal Rodeiro CL. The BioMedical admissions test for medical student selection: issues of fairness and bias. Med Teach. 2011;33(1):62–71.CrossRefPubMed
11.
Zurück zum Zitat Cuddy MM, Swanson DB, Clauser BE. A multilevel analysis of examinee gender and USMLE step 1 performance. Acad Med. 2008;83(10 Suppl):S58–62.CrossRefPubMed Cuddy MM, Swanson DB, Clauser BE. A multilevel analysis of examinee gender and USMLE step 1 performance. Acad Med. 2008;83(10 Suppl):S58–62.CrossRefPubMed
12.
Zurück zum Zitat Tiffin PA, Dowell JS, McLachlan JC. Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the UKCAT in the 2009 cohort. BMJ. 2012;344:e1805.CrossRefPubMedPubMedCentral Tiffin PA, Dowell JS, McLachlan JC. Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the UKCAT in the 2009 cohort. BMJ. 2012;344:e1805.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Case SM, Becker DF, Swanson DB. Performance of men and women on NBME Part I and Part II: the more things change…. Acad Med. 1993;68(10 suppl):S25–7.CrossRefPubMed Case SM, Becker DF, Swanson DB. Performance of men and women on NBME Part I and Part II: the more things change…. Acad Med. 1993;68(10 suppl):S25–7.CrossRefPubMed
14.
Zurück zum Zitat Reiter HI, Lockyer J, Ziola B, Courneya CA, Eva K. Should efforts in favor of medical student diversity be focused during admissions or farther upstream? Acad Med. 2012;87(4):443–8.CrossRefPubMed Reiter HI, Lockyer J, Ziola B, Courneya CA, Eva K. Should efforts in favor of medical student diversity be focused during admissions or farther upstream? Acad Med. 2012;87(4):443–8.CrossRefPubMed
15.
Zurück zum Zitat Reibnegger G, Caluba HC, Ithaler D, Manhal S, Neges HM, Smolle J. Progress of medical students after open admission or admission based on knowledge tests. Med Educ. 2010;44(2):205–14.CrossRefPubMed Reibnegger G, Caluba HC, Ithaler D, Manhal S, Neges HM, Smolle J. Progress of medical students after open admission or admission based on knowledge tests. Med Educ. 2010;44(2):205–14.CrossRefPubMed
16.
Zurück zum Zitat Luschin-Ebengreuth M, Dimai HP, Ithaler D, Neges HM, Reibnegger G. Situational judgment test as an additional tool in a medical admission test: an observational investigation. BMC Res Notes. 2015;8:81.CrossRefPubMedPubMedCentral Luschin-Ebengreuth M, Dimai HP, Ithaler D, Neges HM, Reibnegger G. Situational judgment test as an additional tool in a medical admission test: an observational investigation. BMC Res Notes. 2015;8:81.CrossRefPubMedPubMedCentral
17.
Zurück zum Zitat Reibnegger G, Manhal S. Study dropout in medical education. In: Walsh K, editor Oxford textbook of medical education. Oxford; 2013. p. 398–496. Reibnegger G, Manhal S. Study dropout in medical education. In: Walsh K, editor Oxford textbook of medical education. Oxford; 2013. p. 398–496.
18.
Zurück zum Zitat Reibnegger G, Caluba HC, Ithaler D, Manhal S, Neges HM, Smolle J. Dropout rates in medical students at one school before and after the installation of admission tests in Austria. Acad Med. 2011;86(8):1040–8.CrossRefPubMed Reibnegger G, Caluba HC, Ithaler D, Manhal S, Neges HM, Smolle J. Dropout rates in medical students at one school before and after the installation of admission tests in Austria. Acad Med. 2011;86(8):1040–8.CrossRefPubMed
19.
Zurück zum Zitat Acock AC. Discovering structural equation modeling using stata, revised edition. Texas: Stata Press; 2013. Acock AC. Discovering structural equation modeling using stata, revised edition. Texas: Stata Press; 2013.
20.
Zurück zum Zitat Habersack M, Dimai HP, Ithaler D, Reibnegger G. Time: an underestimated variable in minimizing the gender gap in medical college admission scores. Wien Klin Wochenschr. 2015;127(7–8):241–9.CrossRefPubMed Habersack M, Dimai HP, Ithaler D, Reibnegger G. Time: an underestimated variable in minimizing the gender gap in medical college admission scores. Wien Klin Wochenschr. 2015;127(7–8):241–9.CrossRefPubMed
21.
Zurück zum Zitat Collin VT, Violato C, Hecker K. Aptitude, achievement and competence in medicine: a latent variable path model. Adv Health Sci Educ Theory Pract. 2009;14(3):355–66.CrossRefPubMed Collin VT, Violato C, Hecker K. Aptitude, achievement and competence in medicine: a latent variable path model. Adv Health Sci Educ Theory Pract. 2009;14(3):355–66.CrossRefPubMed
22.
Zurück zum Zitat Oswald FL, Schmitt N, Kim BH, Ramsay LJ, Gillespie MA. Developing a biodata measure and situational judgment inventory as predictors of college student performance. J Appl Psychol. 2004;89(2):187–207.CrossRefPubMed Oswald FL, Schmitt N, Kim BH, Ramsay LJ, Gillespie MA. Developing a biodata measure and situational judgment inventory as predictors of college student performance. J Appl Psychol. 2004;89(2):187–207.CrossRefPubMed
23.
Zurück zum Zitat McDaniel MA, Morgeson FP, Finnegan EB, Campion MA, Braverman EP. Use of situational judgment tests to predict job performance: a clarification of the literature. J Appl Psychol. 2001;86(4):730–40.CrossRefPubMed McDaniel MA, Morgeson FP, Finnegan EB, Campion MA, Braverman EP. Use of situational judgment tests to predict job performance: a clarification of the literature. J Appl Psychol. 2001;86(4):730–40.CrossRefPubMed
24.
Zurück zum Zitat McDaniel MA, Hartman NS, Whetzel DL, Grubb WL. Situational judgment tests, response instructions, and validity: a meta-analysis. Pers Psychol. 2007;60(1):63–91.CrossRef McDaniel MA, Hartman NS, Whetzel DL, Grubb WL. Situational judgment tests, response instructions, and validity: a meta-analysis. Pers Psychol. 2007;60(1):63–91.CrossRef
25.
Zurück zum Zitat Whetzel DL, McDaniel MA, Nguyen NT. Subgroup differences in situational judgment test performance: a meta-analysis. Hum Perform. 2008;21(3):291–309.CrossRef Whetzel DL, McDaniel MA, Nguyen NT. Subgroup differences in situational judgment test performance: a meta-analysis. Hum Perform. 2008;21(3):291–309.CrossRef
Metadaten
Titel
Medical University admission test: a confirmatory factor analysis of the results
verfasst von
Marion Luschin-Ebengreuth
Hans P. Dimai
Daniel Ithaler
Heide M. Neges
Gilbert Reibnegger
Publikationsdatum
01.05.2016
Verlag
Springer Vienna
Erschienen in
Wiener klinische Wochenschrift / Ausgabe 9-10/2016
Print ISSN: 0043-5325
Elektronische ISSN: 1613-7671
DOI
https://doi.org/10.1007/s00508-015-0911-7

Weitere Artikel der Ausgabe 9-10/2016

Wiener klinische Wochenschrift 9-10/2016 Zur Ausgabe

mitteilungen der gesellschaft der ärzte in wien

Veranstaltungen