Progress testing
 | This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)
No issues specified. Please specify issues, or remove this template. |
 | It has been suggested that this article be merged into Test (assessment). (Discuss) Proposed since March 2012. |
Progress tests are longitudinal, feedback oriented educational assessment tools for the evaluation of development and sustainability of cognitive knowledge during a learning process. They represent a cross-section of the knowledge level expected of a graduate. The participants take the test regularly (e.g. 1 to 4 times/year) and, according to their individual learning progress, increasingly achieve better results. They are well established and increasingly used in medical education in both undergraduate and postgraduate medical education. They are used formatively and summatively. They allow feedback for students and faculty on a longitudinal measurement base.
History
Progress Testing was independently introduced at Maastricht University, the Netherlands,[1] and the University of Missouri-Kansas City [2] for different reasons.[3] In the Netherlands the use of problem-based learning (PBL) was the reason progress testing was developed as this assessment format was meant to encourage deeper learning styles. It was also used to compare students' performance from reformed schools to those from more traditional schools.
Advantages
Progress tests provide even more benefits.[1] Progress tests provide a rich source of information: the comprehensive nature in combination with the cross-sectional and longitudinal design offers a wealth of information both for individual learners as well as for curriculum evaluations.
Progress Testing fosters knowledge retention: the repeated testing of the same comprehensive domain of knowledge means that there is no point testing facts that could be remembered if studied the night before. Long term knowledge and knowledge retention is fostered because item content remains relevant long after the knowledge has been learned.
Progress Testing removes the need for resit examinations: every new test occasion is a renewed opportunity to demonstrate growth of knowledge.
Progress Testing allows early detection of high achievers: some learners perform (far) beyond the expected level of their phase in training (e.g. they might have had relevant previous other training) and, depending on their performance, individual and more speeded pathways through the curriculum could be offered.
Progress Testing brings stability in assessment procedures: curriculum changes, changes in content, have no consequence for the progress test provided the end outcomes are unchanged.
Progress Testing provides excellent benchmarking opportunities: progress tests are not limited to a single school nor to PBL curricula and evaluations can easily be done to compare graduates and the effectiveness of different curriculum approaches.
Disadvantages
Naturally, there are disadvantages. The required resources for test development and scoring and the need for a central organization are two very important ones.
Scoring,[4] psychometric procedures [5] for reducing test difficulty variation and standard setting procedures [6] are more complex in progress testing.
Finally progress tests do not work in heterogeneous programs with early specialization (like in many health sciences programs). In more homogenous programs, such as most medical programs, they work really well and pay off in relation to driving learning and use of resources.
International use of progress testing
Information from 2010 (this list may not be complete or up to date)
Netherlands Group - Five medical faculties in the Netherlands (Groningen, Leiden, Maastricht, Nijmegen and VU Amsterdam) and additionally, the Ghent University in Belgium use the test
McMaster, including undergraduate programme, physician assistant programme, Canada Limerick University
Charite, Germany (Germany – Berlin Regel, Berlin reform, Witten, Aachen, Bochum, LMU Munich, Koln, Munster, Hannover, Mannheim, Regensburg, Austria – Graz, Innsbruck)
NBME 1 (Barts, St. George’s London, Leeds and Queens University, Belfast UK)
NBME 2 (University of South Florida and Case Western Reserve University)
Southern Illinois University, Vanderbilt, University of New Mexico, Penn State, Texas Tech, Medical College of Georgia, University of Minnesota
University of Manchester School of Medicine, UK
Peninsula College of Medicine and Dentistry, UK
University of Tampere, Finland
Otago Medical School, New Zealand
Sao Paulo Medical School, Brazil
University of Indonesia, Medical School
Catholic University of Mozambique
Pretoria, South Africa
Source: Freeman A, van der Vleuten CPM, Nouns Z, Ricketts C. Progress testing internationally. Medical Teacher 2010; 32: 451-455 [7]
See also
References
- ^ a b van der Vleuten CPM, Verwijnen GM, Wijnen WHFW. 1996. Fifteen years of experience with progress testing in a problem-based learning curriculum. Medical Teacher 18(2):103–110.
- ^ Arnold L, Willoughby TL. 1990. The quarterly profile examination. Academic Medicine 65(8):515–516.
- ^ Swanson DB, Case SM, van der Vleuten CPM. 1991. Strategies for student assessment. In: Boud D, Feletti G, editors. The challenge of problem-based learning. London: Kogan Page. pp 260–273.
- ^ Muijtjens AM, Mameren HV, Hoogenboom RJ, Evers JL, van der Vleuten CP. 1999. The effect of a ‘don’t know’ option on test scores: Number-right and formula scoring compared. Medical Education 33(4):267–275.
- ^ Shen L. 2000. Progress testing for postgraduate medical education: A four year experiment of American College of Osteopathic Surgeons Resident Examinations. Advances in Health Sciences Education: Theory and Practice 5(2):117–129
- ^ Verhoeven BH, Snellen-Balendong HA, Hay IT, Boon JM, van der Linde MJ, Blitz-Lindeque JJ, Hoogenboom RJI, Verwijnen GM, Wijnen WHFW, Scherpbier AJJA, et al. 2005. The versatility of progress testing assessed in an international context: A start for benchmarking global standardization? Medical Teacher 27(6):514–520
- ^ Freeman A, van der Vleuten CPM, Nouns Z, Ricketts C. Progress testing internationally. Medical Teacher 2010; 32: 451-455
External links
- Progress test Medicine Universitätsmedizin Berlin
- Academic Medicine (Subscription)
- Advances in Health Sciences Education (Subscription)
- Medical Education (Subscription)
- Medical Teacher (Subscription)