African Journal of
Pharmacy and Pharmacology

  • Abbreviation: Afr. J. Pharm. Pharmacol.
  • Language: English
  • ISSN: 1996-0816
  • DOI: 10.5897/AJPP
  • Start Year: 2007
  • Published Articles: 2288

Full Length Research Paper

Progress test: A review to motivate their use in pharmacy schools in Brazil

Alberto Malta Junior
  • Alberto Malta Junior
  • Pharmacy School, Faculty of Juazeiro do Norte, Ceara, Brazil. Student of the Master Program in Management of Technology and Innovation in Health of the Hospital Sírio Libanês, São Paulo, São Paulo, Brazil.
  • Google Scholar
José Lucio Martins Machado
  • José Lucio Martins Machado
  • Botucatu Medical School, Universidade Estadual Paulista – UNESP, Brazil.
  • Google Scholar
Maria Jutta Shadeck
  • Maria Jutta Shadeck
  • Undergraduate Medical Student of Universidade Municipal de São Caetano do Sul, Brazil.
  • Google Scholar
Anabel Fonseca Ferrari
  • Anabel Fonseca Ferrari
  • Undergraduate Medical Student of Universidade Municipal de São Caetano do Sul, Brazil.
  • Google Scholar
Carlos Fernando Collares
  • Carlos Fernando Collares
  • Department of Educational Development and Research, Maastricht University, Maastricht, The Netherlands.
  • Google Scholar


  •  Received: 15 August 2016
  •  Accepted: 22 November 2016
  •  Published: 08 December 2016

 ABSTRACT

Progress Test (PrT) is a longitudinal assessment strategy in which tests composed of contents from all the curriculum are periodically applied to all students of a course. Such strategy allows measurement of deep, long-lasting meaningful learning as well as early detection and remediation of underperforming students. It was introduced more than forty years ago, and it has been used in several health schools in the world, especially medicine. Assessment of students’ knowledge gain and its application over the course is a challenge. PrT has become a relevant method to monitor the development of the student through graduation. There is no culture of using longitudinal assessments in Brazil's pharmacyschools. This scenario is an opportunity for use of PrT. The objective of this work is to make a literature review about how progress test has been used in context of education. The authors also discuss the possibilities of PrT’s application in Pharmacy undergraduate courses in Brazil. PrT has a long history of use by various institutions in the world. Most user experiences come from medical schools, but there are articles showing the application of PrT in dentistry and psychology schools. PrT has been shown to be an effective assessment tool in a problem-based (PBL) and traditional curricula. PrT is recommended as a tool to longitudinal assesses growth in knowledge. Phamacy schools may develop their own framework for PrT collaborations, which could optimize the educational utility of student’s assessment instruments as tools to enhance learning.

Key words: Progress test, assessment, knowledge.


 INTRODUCTION

The Progress Test (PrT) is a longitudinal assessment strategy in which tests composed of contents from all the curriculum are periodically applied to all students of a course, with the expectancy that a progressive proportion of answers will be right (Vantini and Benini, 2008). Such strategy allows measurement of deep, long-lasting meaningful learning as well as early detection of underperforming students. Information obtained from progress testing results also serve as a quality assurance tool for institutional stakeholders to help prioritize efforts on curricular governance and faculty development (Verhoeven et al., 2002). It has been introduced more than forty years ago, and it has been practiced in various health schools in the world, especially medicine (Vleuten et al., 1996; Verhoeven et al., 1999; Finucane et al., 2010; Freeman et al., 2010; Bennett et al., 2010). PrT was developed in the context of problem based learning (PBL), but its use was not restricted to PBL programmes (van der Vleuten et al., 2004; Verhoeven et al., 2005). The PrT values the knowledge acquired during the period of graduation, not individual curricula (Nouns et al., 2012).
 
It is expected that the curriculum of the faculty can produce a solid knowledge to the student.  A well-developed curriculum should ensure the development of cognitive, psychomotor and affective skills (Al Alwan et al., 2011). The Ministry of Education published in Brazil the pharmacy courses curriculum guidelines in 2002. This guide has been published to meet the training needed in the face of increased pharmacist insertion in health services, especially public health.  It is intended that the final objectives of a curriculum must relate to the reality of where the pharmacist works, after all, the quality of pharmaceutical services depend on the quality of learning to preparing individuals for the several changes and challenges (Ogaji et al., 2016). In addition to this, the amount of pharmacy courses has multiplied and this fact demands capable assessment tools to qualify learning and harmonize the knowledge taught in institutions. Currently most of the pharmacy courses in Brazil adopt assessment methodology focused on tests at the end of each module. This use promotes the short-term memorisation or unrelated facts rather than promotes deep learning. PrT has become a relevant method to monitor the development of the student through graduation (Langer and Swanson, 2010; Al Alwan et al., 2011; Gold et al., 2015).
 
The central question who guided this review was: What contribution can the progress test give for learning to the schools of pharmacy in Brazil?
 
The aim of this work is to make a literature review about how progress test has been used used in context of education. The authors also discuss the possibilities of PrT’s application in Pharmacy courses in Brazil. 


 MATERIALS AND METHODS

To accomplish this literature review, the authors used the SCOPUS® database. It is one of the largest abstracts and citation database of peer-reviewed literature in the world. The keywords used for research in Scopus® were progress test delimited by inverted commas.  This search was conducted in April of the year 2016.
 
In  Scopus®  database  we  select  as  inclusion  criteria   all   the the original articles and reviews on the progress test in higher education; articles or reviews written in english or portuguese, published between 1990 and 2015; subject area included was only medicine, dentistry, social sciences, psychology and nursing. There were exclusion criteria:  Notes, conference paper and book chapter. The search in database brought articles not relationed to progress test and was not considered to analysis.  Some articles with terms “progress” or “test” isolated, appeared on search results and it was excluded as well.  


 RESULTS

The search finds 128 documents. After applied exclusion criteria, 65 articles were elegible to analysis. The main results are presented in Table 1. To make it easier to understand, it were analyzed considering the following criteria:
 
1. PrT as assessment tool through graduation 
2. PrT as assessment tool through post-graduation 
3. Investigation about standards to PrT
4. Practices to application of PrT
5. PrT used in collaboration
6. PrT as instrument to comparison 
 


 DISCUSSION

The number of pharmacy schools in Brazil is growing. This scenario demands instruments to ensure that the pharmacist is being well formed. For any course of university education, it is important to monitor how it develops the cognition of students. It is argued that the assessment of this growth needs to mix formative assessment elements to improve performance, or summative, for accountability purposes and making decision (Schauber and Nouns, 2010). The relationship between an educational program and the method of evaluation is vital because the tests and examinations lead student learning (Verhoeven et al., 1999). The PrT is a real possibility to assess gain of knowledge by students. Besides that, for students who have submitted to a PrT there were more consistent and significant progress in academic’s results when compared to students without it. That is because students tested continuously tend to retain knowledge more effectively (Schaap et al., 2012). 
 
The set of articles present the evidence that PrT is a valuable method to assess and monitor the student’s advancement (Boshuizen et al., 1997; Verhoeven et al., 2002; Dijcks et al., 2003; Rodrigues and Catarina, 2007; Löwe et al., 2008; De Champlain et al., 2010; Nouns et al., 2012; Al Alwan et al., 2011). Most studies describe experiences of the use of PrT in medical schools, but it is also used in other courses such as psychology, dentistryor nursing (Finucane et al., 2010; Norman et al., 2010; Muijtjens et al., 2008; Schaap et al., 2012; Ravesloot et al., 2012; Sangestani  et  al.,  2013;  Postma  and  White,2015; Ali et al., 2015). Development of PrT in post-graduation training seems possible, but in this revision showed that there is a need for further studies (Kramer et al., 2003; Rodrigues and Catarina, 2007; Löwe et al., 2008; Dijksterhuis et al., 2009; Ravesloot et al., 2012).
 
The authors have discussed aspects of the  practice  of PrT as the type of questions, reference criteria, use of internet-based tools and costs (Vleuten et al., 1996; McHarg et al., 2005; Rademakers et al., 2005; Muijtjens et al., 2010; Ricketts et al., 2010; Rickets et al., 2010b; Kerfoot et al., 2011; Karay et al., 2012).
 
Several articles present procedures for the achievement of standards for the PrT. Statistical methods, bank of items, better judges for the questions and quality of test are discussed (Verhoeven et al., 1999b; Muijtjens et al., 1998; Muijtjens et al., 2008b; Ricketts and Moyeed, 2011; Anderson et al., 2011; De Champlain et al., 2010; Langer and Swanson, 2010). Despite this development of standards for the PrT represents a challenge (Rickets et al., 2009).
 
Collaborative studies about PrT show mainly the economic benefit (Vleuten et al., 2004; Verhoeven et al., 2005). The PrT can be used for comparison purposes, but there are existing error sources that need to be considered (Swanson et al., 2010; Muijtjens et al., 2007; Freeman et al., 2010; Schuwirth et al., 2010).
 
For comparison purposes, PrT has several features. The studies show that PrT can be used for comparing types of curricula such as problem based versus traditional learning (Verhoeven et al., 1998; Nouns et al., 2012), problem versus lecture based learning (Sangestani et al., 2013), to evaluate effectiveness of curriculum change (Peeraer et al., 2009);  to measure transition of a conventional to an integrated contextual medical curriculum (Van Der Veken et al., 2009), infer performance results among students from different schools (Muijtjens et al., 2007),  and comparison of curricula (Muijtjens et al., 2008; Muijtjens et al., 2008b).
 
Although most studies have been conducted in developed countries, PrT has been applied in countries with few resources (Aarts et al., 2010; Mardiastuti and Werdhani, 2011). Some experiences involving the PrT has been carried out in Brazil, that is a developing country.  Studies about application of PrT in Brazilian medicine schools (Tomic et al., 2005; Sakai et al., 2011) demonstrate the possibility of implementation and execution of it.
 
The use of continuous assessment has emerged as a proposal to improve student learning and develop educational programs in Pharmacy Schools (Plaza, 2007; Szilagyi, 2008; Begley et al., 2013). The Accreditation Council for Pharmacy Education recommends that pharmacy schools can use evaluations that can achieve desired educational objectives. In this context, progress test has been used as both formative assessment as summative (Duncan-Hewitt et al., 2007; Szilagyi, 2008; Anderson Jr and Nelson, 2011; UCL, 2014; Karimi et al., 2014). 
 
The Pharmacy courses in Brazil are guided by a national curriculum guideline (Brazil, 2002). This guideline establishes the profile for formation of the pharmacist. Several institutions have discussed the improvement of the teaching of pharmacy in Brazil (ABERFABIO, 2013). Despite these efforts, the pharmaceutical education still has been very influenced by memorization and repetition of content often disconnected from the reality. In addition, the absence of methodologies like problem based learning left a void for critical and reflexive constructions in the learning process (Almeida et al., 2014; Blouin et al., 2008).
 
The last Pan American Conference on Pharmaceutical Education in 2014 defended the adoption of a competency-based curriculum. Knowledge is an important cognitive component needed to develop competencies (OPAS, 2014). The PrT is a tool to assess knowledge and can fill this need. Pharmacy schools can adapt the PrT to provide assessment that measure the final objectives of their curricula and start an era of evaluation that guides learning and contributes to the quality of education.


 CONCLUSION

There is much evidence about the use of the PrT as an evaluation method to enhace learning in graduation and even pos-graduation. The literature also records studies which seek to qualify the design and implementation of the PrT, presenting proposals for standards, common practices, experiences in collaboration and showing features of the PrT used as comparison tool between types of curricula, learning methods etc. Although most studies describe experiences in medical schools, there are descriptions of the application of the test in other courses in the health area. It was not detected in this review study the use of this test in pharmacy schools. However, we advocate that the PrT can be used by the schools of pharmacy in the same way as is already the case in other courses.


 CONFLICTS OF INTERESTS

The authors have not declared any conflict of interests.



 REFERENCES

Aarts R, Steidel K, Manuel BAF, Driessen EW (2010). Progress testing in resource-poor countries: a case from Mozambique. Med. Teach. 32(6):461-463.
Crossref

 

Al-Alwan I, Al-Moamary M, Al-Attas N, Al-Kushi A, Al-Banyan E, Zamakhshary M, Al Kadri HMF, Tamim H, Magzoub M, Hajeer A, Schmidt H (2011). The progress test as a diagnostic tool for a new PBL curriculum. Educ. Health 24(3):493.

 
 

Albano MG, Cavallo F, Hoogenboom R, Magni F, Majoor G, Manenti F, Schuwirth L, Stiegler I, Vleuten ECVD (1996). An international comparison of knowledge levels of medical students: The Maastricht Progress Test. Med. Educ. 30(4):239-245.
Crossref

 
 

Ali K, Coombes L, Kay E, Tredwin C, Jones G, Ricketts C, Bennett J (2015). Progress testing in undergraduate dental education: The Peninsula experience and future opportunities. Eur. J. Dent. Educ. (4):1-6.

 
 

Anderson HG Jr, Nelson AA (2011). Reliability and Credibility of Progress Test Criteria Developed by Alumni, Faculty, and Mixed Alumni-Faculty Judge Panels. Am. J. Pharm. Educ. 75(10):1-9.
Crossref

 
 

Basu S, Roberts C, Newble DI, Snaith M. Competence in the musculoskeletal system: assessing the progression of knowledge through an undergraduate medical course (2004). Med. Educ. 38(12):1253-1260.
Crossref

 
 

Bennett J, Freeman A, Coombes L, Kay L, Ricketts C (2010). Adaptation of medical progress testing to a dental setting. Med. Teach. 32(6):500-502.
Crossref

 
 

Begley K, Monaghan Ms, Qi Y (2013). Repeated testing to improve skills in a pharmacy practice laboratory course. Am. J. Pharm. Educ.77(6):1-6.
Crossref

 
 

Berkel V, Henk JM, Herman JPN, Geerligs T (1994). The influence of progress tests and block tests on study behaviour. Instr. Sci. 22(4):317-333.
Crossref

 
 

Blake JM, Norman GR, Keane DR, Mueller CB, Cunnington J, Didyk N (1996). Introducing progress testing in McMaster University's problem-based medical curriculum: psychometric properties and effect on learning. Acad. Med. 9:1002-1007.
Crossref

 
 

Boshuizen HP, Van der Vleuten CP, Schmidt HG, Machiels-Bongaerts M (1997). Measuring knowledge and clinical reasoning skills in a problem-based curriculum. Med. Educ. 31(2):115-121.
Crossref

 
 

BRAZIL (2002). National Council of Education. Superior Education Chamber. Resolution CNE/CES number 19/02/2002. Avaliable in url: 

View

 
 

Chen Y, Henning M, Yielder J, Jones R, Wearn A, Weller J (2015). Progress testing in the medical curriculum : students ' approaches to learning and perceived stress. BMC Med. Educ. 15(1):147.
Crossref

 
 

Cohen-Schotanus J, Schönrock-Adema J, Bouwkamp-Timmer T, Van Scheltinga GRT, Kuks JBM (2008). One-year transitional programme increases knowledge to level sufficient for entry into the fourth year of the medical curriculum. Med. Teach. 30(1):62-66.
Crossref

 
 

Coombes L, Ricketts C, Freeman A, Stratford J (2010). Beyond assessment: feedback for individuals and institutions based on the progress test. Med. Teach. 32:486-490.
Crossref

 
 

De Champlain AF, Cuddy MM, Scoles PV, Brown M, Swanson DB, Holtzman K, Buttler G (2010). Progress testing in clinical science education: results of a pilot project between the National Board of Medical Examiners and a US Medical School. Med. Teach. 32(6):503-508.
Crossref

 
 

de Koning BB, Loyens SMM, Rikers RMJP, Smeets G, van der Molen HT (2012). Generation Psy: Student characteristics and academic achievement in a three-year problem-based learning bachelor program. Learn. Individ. Differ. 22(3):313-323.
Crossref

 
 

Dijcks R, Prince KJ, Vleuten CPMV, Scherpbier AJJA (2003). Validity of objective tests towards peer-rated competence by students. Med. Teach. 25(3):273-276.
Crossref

 
 

Dijksterhuis MGK, Scheele F, Schuwirth LWT, Essed GGM, Nijhuis JG, Braat DDM (2009). Progress testing in postgraduate medical education. Med. Teach. 31(10):464-468.
Crossref

 
 

Dornan T, Scherpbier A, Boshuizen H (2003). Towards valid measures of self-directed clinical learning. Med. Educ. 37:983-991.
Crossref

 
 

Duncan-Hewitt W, Jungnickel P, Evans RL (2007). Development of an Office of Teaching, Learning and Assessment in a Pharmacy School. Am. J. Pharm. Educ. 71(2):1-8.
Crossref

 
 

Finucane P, Flannery D, Keane D, Norman G (2010). Cross-institutional progress testing: Feasibility and value to a new medical school. Med. Educ. 44:184-186.
Crossref

 
 

Freeman A, Nicholls A, Ricketts C, Coombes L (2010). Can we share questions? Performance of questions from different question banks in a single medical school. Med. Teach. 32(6):464-466.
Crossref

 
 

Freeman A, Van Der Vleuten C, Nouns Z, Ricketts C (2010). Progress testing internationally. Med. Teach. 32(6):451-455.
Crossref

 
 

Freeman AC, Ricketts C (2010). Choosing and designing knowledge assessments: experience at a new medical school. Med. Teach. 32(7):578-81.
Crossref

 
 

Gold J, DeMuth R, Mavis B, Wagner D (2015). Progress testing 2.0: clinical skills meets necessary Science. Med. Educ. Online 20:1-4.
Crossref

 
 

Heijne-Penninga M, Kuks JBM, Hofman WHA, Muijtjens AMM, Cohen-Schotanus J (2013). Influence of PBL with open-book tests on knowledge retention measured with progress tests. Adv. Health Sci. Educ. 18(3):485-495.
Crossref

 
 

Hurk VD, Marianne M, Wolfhagen IH, Dolmans DH (1999). The impact of student-generated learning issues on individual study time and academic achievement. Med. Educ. 33(11):808-814.
Crossref

 
 

Johnson TR, Khalil MK, Peppler RD, Davey DD, Kibble JD (2014). Use of the NBME Comprehensive Basic Science Examination as a progress test in the preclerkship curriculum of a new medical school. Adv. Physiol. Educ. 38(4):315-320.
Crossref

 
 

Karay Y, Schauber SK, Stosch C, Schuettpelz-Brauns K (2012). Can computer-based assessment enhance the acceptance of formative multiple choice exams? A utility analysis. Med. Teach. 34(4):292-296.
Crossref

 
 

Karimi R, Meyer D, Fujisaki B, Stein S (2014). Implementation of an Integrated Longitudinal Curricular Activity for Graduating Pharmacy Students. Am. J. Pharm. Educ. 78(6):1-8.
Crossref

 
 

Kerdijk W, Snoek JW, Van HEA, Cohen-schotanus J (2013). The effect of implementing undergraduate competency-based medical education on students' knowledge acquisition, clinical performance and perceived preparedness for practice: a comparative study. BMC Med. Educ. 13:1-10.
Crossref

 
 

Kerfoot BP, Shaffer K, McMahon GT, Baker H, Kirdar J, Kanter S, Corbett EC, Berkow R, Krupat E, Armstrong EG (2011). Online "Spaced Education Progress-Testing" of Students to Confront Two Upcoming Challenges to Medical Schools. Acad. Med. 86(3):300-306.
Crossref

 
 

Kramer AWM, Düsman H, Tan LHC, Jansen KJM, Grol RPTM, van der Vleuten CP (2003). Effect of extension of postgraduate training in general practice on the acquisition of knowledge of trainees. Fam. Pract. 20(2):207-212.
Crossref

 
 

Langer MM, Swanson DB (2010). Practical considerations in equating progress tests. Med. Teach. 32:509-512.
Crossref

 
 

Löwe B, Hartmann M, Wild B, Nikendei C, Kroenke K, Niehoff D, Henningsen P, Zipfel S, Herzog W (2008). Effectiveness of a 1-year resident training program in clinical research: A controlled before-and-after study. J. Gen. Intern. Med. 23(2):122-128.
Crossref

 
 

Mardiastuti HW, Werdhani RA (2011). Grade point average, progress test, and try out's test as tools for curriculum evaluation and graduates' performance prediction at the national board examination. J. Med. Med. Sci. 2(12):1302-1305.

 
 

McHarg J, Bradley P, Chamberlain S, Ricketts C, Searle J, McLachlan JC (2005). Assessment of progress tests. Med. Educ. 39(2):221-227.
Crossref

 
 

Muijtjens AMM, Hoogenboom RJI, Verwijnen GM, Van Der Vleuten CPM (1998). Relative or Absolute Standards in Assessing Medical Knowledge Using Progress Tests. Adv. Health Sci. Educ. Theory Pract. 3(2):81-7.
Crossref

 
 

Muijtjens AMM, Schuwirth LWT, Cohen-Schotanus J, Thoben AJNM, Vleuten CPMVD (2008b). Benchmarking by cross-institutional comparison of student achievement in a progress test. Med. Educ. 42(1):82-88.
Crossref

 
 

Muijtjens AMM, Schuwirth LWT, Cohen-Schotanus J, Van Der Vleuten CPM (2007). Origin bias of test items compromises the validity and fairness of curriculum comparisons. Med. Educ. 41(12):1217-1223.
Crossref

 
 

Muijtjens AMM, Schuwirth LWT, Cohen-Schotanus J, Van Der Vleuten CPM (2008). Differences in knowledge development exposed by multi-curricular progress test data. Adv. Health Sci. Educ. 13(5):593-605. Muijtjens AMM, Timmermans I, Donkers J, Peperkamp R, Medema H, Cohen-Schotanus J, Thoben A, Wenink ACG, van der Vleuten CPM (2010). Flexible electronic feedback using the virtues of progress testing. Med. Teach. 32:491-495.
Crossref

 
 

Norman G, Neville A, Blake JM, Mueller B (2010). Assessment steers learning down the right road: impact of progress testing on licensing examination performance. Med. Teach. 32:496-499.
Crossref

 
 

Nouns Z, Schauber S, Witt C, Kingreen H, Schu¨ttpelz-Brauns K (2012). Development of knowledge in basic sciences: A comparison of two medical curricula. Med. Educ. 46(12):1206-1214.
Crossref

 
 

Nouns ZM, Georg W (2010). Progress testing in German speaking countries. Med. Teach. 32:467-470.
Crossref

 
 

O'Neill PA (2000). The role of basic sciences in a problem-based learning clinical curriculum. Med. Educ. 34(8):608-613.
Crossref

 
 

Ogaji IJ, Kahiga TM, Gachuno OW, Mwangi JW (2016). Development of Pharmacy Education in Kenya Universities to date. Afr. J. Pharm. Pharm. 10(18):385-392.
Crossref

 
 

OPAS. Organización Panamericana de la Salud. Pan American Conference on Pharmaceutical Education. (2014). Evaluable on: http://www.paho.org/hq/index.php?option=com_content&view=article&id=8374%3A2013-pharmaceutical-education&catid=4831%3Apharmaceutical-education&Itemid=39720&lang=pt. Acess in 08/28/2016.

 

Peeraer G, De Winter BY, Muijtjens AMM, Remmen R, Bossaert L, Scherpbier AJJA (2009). Evaluating the effectiveness of curriculum change. Is there a difference between graduating student outcomes from two different curricula? Med. Teach. 31(3):64-68.
Crossref

 

Plaza CM (2007). Progress Examinations in Pharmacy Education. Am. J. Pharm. Educ. 71(4):1-7.
Crossref

 
 

Postma TC, White JG (2015). Developing integrated clinical reasoning competencies in dental students using scaffolded case-based learning - empirical evidence. Eur. J. Dent. Educ. 27:1-9.

 
 

Rademakers J, Ten Cate TJ, Bär PR (2005). Progress testing with short answer questions. Med. Teach. 27(7):578-582.
Crossref

 
 

Ravesloot C, van der Schaaf M, Haaring C, Kruitwagen C, Beek E, Ten Cate O, Schaik JV (2012). Construct validation of progress testing to measure knowledge and visual skills in radiology. Med. Teach. 34(12):1047-1055.
Crossref

 
 

Ricketts C, Brice J, Coombes L. (2010b). Are multiple choice tests fair to medical students with specific learning disabilities? Adv. Health Sci. Educ. 15(2):265-275.
Crossref

 
 

Ricketts C, Freeman A, Pagliuca G, Coombes L, Archer J (2010). Difficult decisions for progress testing: how much and how often? Med. Teach. 32(6): 513-515.
Crossref

 
 

Ricketts C, Freeman AC, Coombes LR (2009). Standard setting for progress tests: Combining external and internal standards. Med. Educ. 43:589-593.
Crossref

 
 

Ricketts C, Moyeed R (2011). Improving progress test score estimation using Bayesian statistics. Med. Educ. 45(6):570-577.
Crossref

 
 

Rodrigues G, Catarina S (2007). The Relationship of Learning Environment, Quality of Life and Study Strategies Measures to Anesthesiology. Econ. Educ. Pol. 104(6):1467-1472.

 
 

Sakai MH, Ferreira Filho OF, Matsuo T (2011). Avaliação do crescimento cognitivo do estudante de medicina: aplicação do teste de equalização no teste de progresso. Rev. Bras. Educ. Med. 35(4):493-501.
Crossref

 
 

Sangestani G, Khatiban M (2013). Comparison of problem-based learning and lecture-based learning in midwifery. Nurse Educ. Tod. 33(8):791-795. Schaap L, Schmidt HG, Verkoeijen PPJL (2012). Assessing knowledge growth in a psychology curriculum: which students improve most? Assess. Eval. High. Educ. 37(7):875-887.

 
 

Schauber S, Nouns ZM (2010). Using the cumulative deviation method for cross-institutional benchmarking in the Berlin progress test. Med. Teach. 32(6):471-475.
Crossref

 
 

Schauber SK, Hecht M, Nouns ZM, Kuhlmey A, Dettmer S (2015). The role of environmental and individual characteristics in the development of student achievement : a comparison between a traditional and a problem-based-learning. Adv. Health Sci. Educ. 20(4):1033-1052.
Crossref

 
 

Schuwirth L, Bosman G, Henning RH, Rinkel R, Wenink ACG (2010). Collaboration on progress testing in medical schools in the Netherlands. Med. Teach. 32:476-479.
Crossref

 
 

Szilagyi JE (2008). Curricular Progress Assessments: The MileMarker. Am. J. Pharm. Educ. 72(5):1-4.
Crossref

 
 

Swanson DB, Holtzman KZ, Butler A, Langer MM, Nelson MV, Chow JWM, et al (2010). Collaboration across the pond: the multi-school progress testing project. Med. Teach. 32:480-485.
Crossref

 
 

Tomic ER, Martins MA, Lotufo PA, Bense-or IM (2005). Progress testing: evaluation of four years of application in the school of medicine, University of São Paulo. Clinics 60(5):389-396.
Crossref

 
 

UCL School of Pharmacy (2014). Joint Programs Board London. Postgraduate Diploma in General Pharmacy Practice. Programme Handbook. 33p.

 
 

Van Der Veken J, Valcke M, De Maeseneer J, Schuwirth L, Derese A (2009). Impact on knowledge acquisition of the transition from a conventional to an integrated contextual medical curriculum. Med. Educ. 43(7):704-713
Crossref

 
 

van der Vleuten CPM, Schuwirth LWT, Muijtjens AMM, Thoben AJNM, Cohen-Schotanus J, van Boven CP (2004). Cross institutional collaboration in assessment: a case on progress testing. Med. Teach. 26(8):719-725.
Crossref

 
 

van der Vleuten CPM, Verwijnen GM, Wijnen WHFW (1996). Fifteen years of experience with progress testing in a problem-based learning curriculum. Med. Teach. 18(2):103-109.
Crossref

 
 

van Diest R, van Dalen J, Bak M, Schruers K, van der Vleuten C, Muijtjens AMM, Scherpbier A (2004). Growth of knowledge in psychiatry and behavioural sciences in a problem-based learning curriculum. Med. Educ. 38(12):1295-1301.
Crossref

 
 

Vantini I, Benini L (2008). Models of learning, training and progress evaluation of medical students. Clin. Chim. Acta. 393(1):130-16.
Crossref

 
 

Verhoeven BH, Scherpbier AJJA, Ldrinet RSGHO, Oeseburg B, Bulte JA (1998). An analysis of progress test results of PBL and non-PBL students. Med. Teach. 20(4):310-316.
Crossref

 
 

Verhoeven BH, Snellen-Balendong HAM, Hay IT, Boon JM, van der Linde MJ, Blitz-Lindeque JJ, Hongenboom RJI, Verwijnen GM, Wijnen WHFW, Scherpbier AJJA, van der Vleuten CPM (2005). The versatility of progress testing assessed in an international context: a start for benchmarking global standardization? Med. Teach. 27(6):514-520.
Crossref

 
 

Verhoeven BH, van der Steeg AFW, Scherpbier AJJA, Muijtjens AMM, Verwijnen GM, van der Vleuten CPM (1999). Reliability and credibility of an Angoff standard setting procedure in progress testing using recent graduates as judges. Med. Educ. 33:832-837.
Crossref

 
 

Verhoeven BH, Verijnen GM, Scherpbier AJJA, Schuwirth LWT, Van der Vleuten CPM (1999). Quality assurance in test construction: the approach of a multidisciplinary central test committee. Educ. Health. 12(1):49-60.

 
 

Verhoeven BH, Verwijnen GM, Muijtjens AMM, Scherpbier AJJA, Van Der Vleuten CPM (2002). Panel expertise for an Angoff standard setting procedure in progress testing: Item writers compared to recently graduated students. Med. Educ. 36(9):860-867.
Crossref

 
 

Verhoeven BH, Verwijnen GM, Scherpbier AJJA, van der Vleuten CPM (2002). Growth of medical knowledge. Med. Educ. 36(8):711-717.
Crossref

 
 

Wade L, Harrison C, Hollands J, Mattick K, Ricketts C, Wass V (2012). Student perceptions of the progress test in two settings and the imlications for test deployment. Adv. Health Sci. Educ. 17:573-583.
Crossref

 

 




          */?>