Skip to main content
Download PDF

The use of a formative OSCE to prepare emergency medicine residents for summative OSCEs: a mixed-methods cohort study

International Journal of Emergency Medicine volume 14, Article number: 62 (2021) Cite this article

Abstract

Background

The objective structured clinical examination (OSCE) is a part of emergency medicine (EM) examinations such as the Masters of Medicine in Emergency Medicine (MMed) examination and the equivalent Member of the Royal College of Emergency Medicine (MRCEM) examination. The use of formative OSCEs to prepare EM residents for summative OSCEs has not been investigated. This study aimed to evaluate the role of formative OSCEs in preparing EM residents for the MMed and MRCEM OSCE.

Methods

This was an observational, retrospective, mixed-methods cohort study. We analysed data from formative OSCEs conducted by the National Healthcare Group EM residency programme from 2013 to 2019, and from a questionnaire distributed to all residents during the study period. Residents’ formative OSCE participation and scores were compared with first-attempt summative OSCE success. Qualitative analysis of residents’ opinions on the usefulness of the formative OSCE was performed.

Results

Forty-three of the 50 (86.0%) residents attended at least one formative OSCE. Of the 46 who responded to the questionnaire, 40 (87.0%) had attempted and succeeded in the MMed or MRCEM OSCE, of whom 35 (87.5%) had succeeded on the first attempt. Residents who succeeded in the summative OSCE on the first attempt tended to have higher proximate (mean = 70.6, SD = 8.9 vs mean = 64.3, SD = 10.8) and mean (mean = 67.4, SD = 7.1 vs mean = 62.8, SD = 7.3) formative OSCE scores. All 8/40 (20.0%) residents who attended more than three formative OSCEs succeeded in the summative OSCE on their first attempt. Residents’ formative OSCE scores tended to improve with successive formative OSCEs, demonstrating a positive training effect. All residents felt that the formative OSCE was useful in preparing them for the summative OSCE.

Conclusions

Participation in multiple formative OSCEs was beneficial in preparing residents for the summative OSCE. The formative OSCE was useful in familiarising residents with the examination, giving them an opportunity to perform in near-examination conditions, and providing feedback to residents and faculty about their progress. Our findings may support the implementation of formative OSCEs in other training programmes to prepare learners for high-stake summative OSCEs.

Introduction

Since the objective structured clinical examination (OSCE) was first described in 1975 [1], its use in medical education has increased. There is evidence that an appropriately designed OSCE is effective in assessing clinical competence [2,3,4], and OSCEs are a part of high-stakes medical examinations in many countries [5, 6].

OSCEs may be summative or formative. Summative OSCEs formally assess the outcome of learning, and are typically used in examinations to make a judgement about a candidate’s fitness to advance to the next stage of education or career. In contrast, formative OSCEs are primarily learning tools that use the format of an assessment to provide feedback to learners and guide future learning.

In emergency medicine (EM) training programmes, formative OSCEs have been used as an educational tool to train residents and assess their clinical skills [7, 8], and there are reports that OSCEs are able to predict future performance, both overall and in specific core competencies [9]. Summative OSCEs are also a component of many licencing examinations, including the Masters of Medicine in Emergency Medicine (MMed) examination, conducted by the National University of Singapore, and the equivalent Member of the Royal College of Emergency Medicine (MRCEM) examination, conducted by the Royal College of Emergency Medicine (RCEM) in the UK.

Formative OSCEs can be costly, time-consuming and labour-intensive to organise [10, 11]. It is therefore important for educators who are considering implementing formative OSCEs to understand their role in preparing learners for summative OSCEs. Previous studies done amongst internal medicine residents [12, 13], paediatrics residents [14] and medical students [15] have shown correlations between formative OSCE scores and national examination or in-training examination scores. However, studies on the effectiveness of formative OSCEs in improving medical students’ summative OSCE results have had mixed results. Due to the heterogeneity of the studies, the reasons for this are unclear. A study involving multiple formative OSCEs appeared to be more effective in improving summative OSCE pass rates [16] compared to studies involving a single formative OSCE [17, 18]. Formative OSCEs may also be more effective in improving summative OSCE scores for stations testing procedural skills rather than theoretical knowledge [19]. There have been no previous studies on the effectiveness of formative OSCEs in improving or predicting summative OSCE scores in EM, in which OSCEs typically place greater emphasis on resuscitation and procedural skills compared to OSCEs in other specialties.

We analysed 7 years of data from formative OSCEs conducted by an EM residency programme, comparing residents’ participation and performance in formative OSCEs with first-attempt success in the MMed or MRCEM OSCE, both of which will henceforth be referred to as the summative OSCE. We aimed to evaluate the role of formative OSCEs in preparing EM residents for the summative OSCE and to analyse if formative OSCE participation and performance was associated with first-attempt summative OSCE success.

Methods

Study design

This was an observational, retrospective, mixed-methods cohort study. Formative OSCEs have been conducted by the National Healthcare Group (NHG) EM residency programme in Singapore once or twice per year since 2013. Data were obtained from the results of formative OSCEs conducted from 2013 to 2019, and from a questionnaire distributed to NHG EM residents who had been in the programme during the study period.

Summative OSCE

Residents are required to sit for either the MMed or the MRCEM examination at any point during junior residency, which comprises the first 3 years of a 5-year residency programme, in order to progress to senior residency. Both the MMed and MRCEM examinations contain three parts. The first is a multiple-choice test, the second comprises short answer questions and the third is an OSCE. Applicants are required to pass the first two parts before sitting for the OSCE.

The MMed OSCE consists of 15 stations, with 12 min each for three resuscitation stations and 10 min each for the other stations. Each station is preceded by 2 min of reading time. The MRCEM OSCE consists of 18 stations (16 patient encounters and two rest stations), each 7 min long and preceded by 1 min of reading time. The MMed OSCE is mapped to the competencies of years 1-3 of the emergency medicine core curriculum, Singapore, whilst the MRCEM OSCE is mapped to the competencies of years 1-3 of the RCEM emergency medicine curriculum. Both curricula are similar, and expect competence in evaluating and managing adult and paediatric emergencies seen at a general emergency department. The content of both examinations is similar, and includes the following stations: history-taking (e.g. undifferentiated headache), physical examination (involving real patients with stable pathologies, e.g. valvular heart disease), communication (e.g. breaking bad news), procedures (e.g. performing toilet and suture on a manikin), resuscitation (e.g. cardiac arrest, major trauma) and others (e.g. mass disaster response and triage). The stations involve real patients, simulated patients, task trainers and manikins. Candidates are assessed by one assessor per station using station-specific checklists. Scores for various domains, as well as a global score, are given. If a simulated patient is present, scores are calibrated with input from the simulated patient.

The MMed OSCE is standard set via the modified Angoff method [20, 21]. Candidates are required to pass at least 11 out of 15 total stations, and two out of three resuscitation stations, to pass the examination. The MRCEM OSCE is standard set via the borderline regression method [22]. One standard error of measurement is added to the identified cut-off score to calculate the pass mark. Candidates are required to achieve the pass mark and pass at least one out of two resuscitation stations to pass the examination.

Formative OSCE

The formative OSCE is targeted at NHG EM junior residents who have yet to pass the summative OSCE. It is designed and blueprinted to be similar to the summative OSCE in format and core competencies tested. Each formative OSCE consists of 10-15 stations. The time allotted is the same as for the MMed OSCE, that is, 12 min for resuscitation stations and 10 min for the other stations, with 2 min of reading time prior to each station. The content of the stations, competencies expected and patient characteristics are designed to be similar to those of the summative OSCE. However, the formative OSCEs generally contain fewer stations than the summative OSCE, owing to logistical and manpower constraints.

The content of the stations changes in each OSCE. All cases are designed by the institution’s core faculty. The cases undergo two to three rounds of review and quality control by faculty, and standards are set via the modified Angoff method, with marking checklists and passing scores determined. Similar to the summative OSCE, residents are directly observed and scored by one assessor per station, using checklists that are designed to be similar to those of the summative OSCE, with input from the simulated patient if present. The assessors, who are members of the faculty, are trained on the assessment standards prior to the OSCE.

After the formative OSCE, a group feedback session for all participants is conducted, during which the assessors provide verbal feedback on each station. Residents are also shown their mark sheets, which contain their scores and written feedback from assessors for every station.

The number of participants in each formative OSCE varies depending on the number of residents who have yet to pass the summative OSCE. The number of formative OSCEs that a resident participates in prior to attempting the summative OSCE also varies as residents are given the freedom to decide at which stage of junior residency they attempt the summative OSCE. Residents can choose not to attend a formative OSCE if they are at work or on leave.

Selection of participants

All NHG EM residents during the study period were included. Residents who left the programme midway were excluded.

Data collection and processing

Data from scores for all formative OSCEs conducted during the study period were used. An online questionnaire using Google Forms was distributed via email to all current and past residents who were in the residency programme during the study period, and responses were collected over 1 month in November 2019. The data obtained from the questionnaire included whether and when residents had sat for and/or passed the summative OSCE. Residents’ perceptions of the usefulness of the formative OSCE were obtained on a 4-point Likert scale (1 = not useful, 4 = very useful), and through a mandatory free-text question on why they felt the formative OSCE was or was not useful.

An EM residency programme coordinator, who was not in the investigating team, distributed the questionnaires, collated the data, removed all identifiers and assigned identifying numbers to each participant before passing the data to the investigators. The programme coordinator checked the validity and accuracy of the data, and the investigators verified the internal consistency of the data.

Data analysis

We compared residents’ formative OSCE participation and scores with first-attempt summative OSCE success. We also compared other factors with first-attempt summative OSCE success, namely residency year, postgraduate year and residents’ perceptions of the usefulness of the formative OSCE. Categorical variables were analysed with Pearson’s chi-square and continuous and ordinal variables were analysed with Mann-Whitney U tests. Qualitative analysis of residents’ opinions on the usefulness of the formative OSCE was performed to triangulate the findings. All quantitative data were analysed using IBM SPSS Statistics version 23 (IBM Corp., Armonk, NY, USA).

Results

There were 57 EM residents from 2013 to 2019, of whom seven were excluded as they left the programme midway. Of the remaining 50, data on formative OSCE attendance and scores were available for all. Forty-six (92.0%) responded to the questionnaire.

Forty-three of the 50 (86.0%) residents had attended at least one, and up to five, formative OSCEs (Table 1). Of the 46 who responded to the questionnaire, 40 (87.0%) had attempted and succeeded in the summative OSCE, of whom 35/40 (87.5%) had succeeded on the first attempt. The number of participants and scores for each formative OSCE are shown in Fig. 1.

Table 1 Formative and summative OSCE performance
Full size table
Fig. 1
figure 1

Formative OSCE scores

Full size image

The comparison of variables with first-attempt summative OSCE success is shown in Table 2. Residents who succeeded in the summative OSCE on the first attempt tended to have higher proximate (mean = 70.6, SD = 8.9 vs mean = 64.3, SD = 10.8) and mean (mean = 67.4, SD = 7.1 vs mean = 62.8, SD = 7.3) formative OSCE scores. Attending at least one formative OSCE was not associated with first-attempt summative OSCE success (p = 0.426). All 8/40 (20%) residents who attended more than three formative OSCEs succeeded in the summative OSCE on their first attempt (Fig. 2). With successive formative OSCEs, residents’ formative OSCE scores tended to improve (Fig. 3).

Table 2 Comparison of variables with first-attempt summative OSCE success
Full size table
Fig. 2
figure 2

Comparison of number of formative OSCEs attended with first-attempt summative OSCE success

Full size image
Fig. 3
figure 3

Trend of scores in successive attempts at the formative OSCE

Full size image

All residents felt that the formative OSCE was useful in aiding their preparations for the summative OSCE, with 36 (78.3%) rating the usefulness of formative OSCEs as 4 on a 4-point Likert scale, and the rest rating 3 (Table 1). Table 3 presents the main themes in their free-text qualitative responses on the usefulness of the formative OSCE. The most common response (24 residents, 52.1%) was that the formative OSCE helped residents to familiarise themselves with the examination format, station scenarios, timing and expectations. The next most common response (18 residents, 39.1%) was that the formative OSCE provided a good opportunity for residents to practise their skills. Examples of such skills included clinical reasoning, time management, effective verbalisation of thought processes and coping with the high pressure of an examination. The only negative response as stated by 3 residents (6.5%) was that the formative OSCE was not useful for residents who had not prepared for the examination.

Table 3 Most common themes in residents’ opinions about the usefulness of formative OSCEs
Full size table

Discussion

This is the first study evaluating the impact of formative OSCEs on summative OSCE success in an EM training programme. All residents who participated in more than three formative OSCE succeeded in the summative OSCE on their first attempt, suggesting a positive training effect where the cumulative experience gained from participating in multiple formative OSCEs was beneficial to residents taking the summative OSCE. This is supported by the upward trend in residents’ scores over successive formative OSCEs.

The qualitative responses provide an explanation for this finding, with over half of residents surveyed stating that the formative OSCE was useful in helping them to familiarise themselves with the examination format. This corroborates with previous studies [19, 23]. It has been found that unfamiliarity with the format or tested clinical competencies of an OSCE is a major factor that limits performance in the OSCE, and that learners show more consistent performance levels after taking multiple formative OSCEs [16]. In our study, repeated practice and evaluation in multiple formative OSCEs reduced the surprise element of the examination and helped to improve residents’ confidence and performance. However, attending one formative OSCE was not associated with first-attempt OSCE success, suggesting that multiple formative OSCEs were required to provide adequate exposure.

A second benefit of taking multiple formative OSCEs was the opportunity for residents to practise their examination skills in a safe training examination, as expressed by two in five residents. Formative examinations are perhaps particularly valuable in preparing for OSCEs which, unlike written examinations, test not only learners’ factual knowledge but also their abilities to interact effectively with real and simulated patients, and to synthesise and communicate information succinctly to examiners [4]. Moreover, EM OSCEs tend to place a high importance on resuscitation and procedural skills, and there is evidence that these skills are more effectively learnt through simulation than traditional forms of education [24]. This may be because these stations assess leadership, prioritisation and time-sensitive skills, and require specialised resources. They are therefore more difficult for residents to practise on their own.

In the programme, junior residents are allowed to choose when to take the summative OSCE. It is therefore useful to have an indicator to guide residents on whether they are ready to attempt the summative OSCE. Several residents felt that the formative OSCE was useful for assessing their progress and gauging whether they were ready to take the summative OSCE. This was supported by the tendency of residents who succeeded in the summative OSCE to have higher mean and proximate formative OSCE scores. Although these trends were not statistically significant, this was likely due to the small proportion of residents (5/40 residents, 12.5%) who failed the summative OSCE. This low failure rate may be partially due to residents only attempting the summative OSCE when they felt adequately prepared for it, with one of the contributing factors being their formative OSCE performance. Hence, it is of practical significance, including the cost savings of the summative examination fees in the event of failure, that the formative OSCE could provide feedback to residents about whether they were ready to take the summative OSCE, and help faculty identify outstanding residents and weaker-performing residents who required more educational intervention.

Residents commented that the formative OSCE enabled them to identify their strengths and weaknesses. Though primarily a practice exam that acts as an ‘assessment of learning’, the formative OSCE was also an ‘assessment for learning’ [25]. Previous investigations have found that testing enhances long-term retention of knowledge more effectively than repeated studying [26, 27]. By requiring active engagement from residents [28], the formative OSCE stimulated self-reflection and encouraged further studying. In addition, the incorporation of a feedback component allowed faculty members to highlight areas for improvement and give constructive advice, with residents commenting that the feedback was helpful in identifying deficits in their knowledge and skills and allowing them to learn from their peers’ mistakes. Previous studies have found that even short periods of immediate feedback can improve learners’ competencies [29].

Whilst the formative OSCE was universally considered useful, a few residents raised that the formative OSCE was of limited benefit to those who did not prepare beforehand for them. The OSCE tests ‘demonstration of learning’ on Miller’s pyramid. Learners therefore require an adequate level of prior theoretical knowledge to reap maximal benefits from an OSCE. Hence, the formative OSCE may be of limited benefit to residents who are not contemplating taking the summative examination yet and have not begun to prepare.

There were some limitations. The study was performed in a single residency programme focusing on the MMed and MRCEM examinations, and further research is needed to evaluate if the results are applicable in other training programmes or other examinations. Only a small number of residents did not succeed in the summative OSCE on their first attempt, and whilst this may be an encouragement for the programme, it limited our ability to assess factors that contributed to summative OSCE success. A control arm did not exist as most residents participated in the formative OSCE prior to attempting the summative OSCE, limiting our ability to compare the results of residents who did and did not participate in formative OSCEs.

Conclusions

In an EM residency programme, participation in multiple formative OSCEs was beneficial to residents’ preparation for the MMed and MRCEM OSCE by familiarising them with the examination and enabling them to practise the skills required for the summative OSCE. The formative OSCE provided feedback to residents on their readiness to take the summative OSCE and helped faculty members identify residents who might require more educational intervention. Attempting more formative OSCEs had a positive training effect as evidenced by increasing scores. Our findings may support the implementation of formative OSCEs in other training programmes to prepare learners for high-stake summative OSCEs.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

EM:

Emergency medicine

MMed:

Masters of Medicine in Emergency Medicine

MRCEM:

Member of the Royal College of Emergency Medicine

NHG:

National Healthcare Group

OSCE:

Objective structured clinical examination

RCEM:

Royal College of Emergency Medicine

References

  1. Harden RM, Gleeson FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ. 1979;13(1):41–54.

    CAS  Article  Google Scholar 

  2. Patrício MF, Julião M, Fareleira F, Carneiro AV. Is the OSCE a feasible tool to assess competencies in undergraduate medical education? Med Teach. 2013;35(6):503–14. https://doi.org/10.3109/0142159X.2013.774330.

    Article  PubMed  Google Scholar 

  3. Barman A. Critiques on the objective structured clinical examination. Ann Acad Med Singapore. 2005;34:478–82.

    CAS  PubMed  Google Scholar 

  4. Casey PM, Goepfert AR, Espey EL, Hammoud MM, Kaczmarczyk JM, Katz NT, et al. To the point: reviews in medical education-the Objective Structured Clinical Examination. Am J Obstet Gynecol. 2009;200(1):25–34. https://doi.org/10.1016/j.ajog.2008.09.878.

    Article  PubMed  Google Scholar 

  5. Turner JL, Dankoski ME. Objective structured clinical exams: a critical review. Fam Med. 2008;40(8):574–8.

    PubMed  Google Scholar 

  6. Reznick R, Smee S, Rothman A, Chalmers A, Swanson D, Dufresne L, et al. An objective structured clinical examination for the licentiate: report of the pilot project of the Medical Council of Canada. Acad Med. 1992;67(8):487–94. https://doi.org/10.1097/00001888-199208000-00001.

    CAS  Article  PubMed  Google Scholar 

  7. Hall AK, Dagnone JD, Lacroix L, Pickett W, Klinger DA. Queen’s simulation assessment tool: development and validation of an assessment tool for resuscitation objective structured clinical examination stations in emergency medicine. Simul Healthc. 2015;10(2):98–105. https://doi.org/10.1097/SIH.0000000000000076.

    Article  PubMed  Google Scholar 

  8. Okuda Y, Bond W, Bonfante G, McLaughlin S, Spillane L, Wang E, et al. National growth in simulation training within emergency medicine residency programs, 2003-2008. Acad Emerg Med. 2008;15(11):1113–6. https://doi.org/10.1111/j.1553-2712.2008.00195.x.

    Article  PubMed  Google Scholar 

  9. Wallenstein J, Heron S, Santen S, Shayne P, Ander D. A core competency-based objective structured clinical examination (OSCE) can predict future resident performance. Acad Emerg Med. 2010;17(Suppl 2):S67–71.

    Article  Google Scholar 

  10. Cusimano MD, Cohen R, Tucker W, Murnaghan J, Kodama R, Reznick R. A comparative analysis of the costs of administration of an OSCE (objective structured clinical examination). Acad Med. 1994;69(7):571–6. https://doi.org/10.1097/00001888-199407000-00014.

    CAS  Article  PubMed  Google Scholar 

  11. Frye AW, Richards BF, Philp EB, Philp JR. Is it worth it? A look at the costs and benefits of an OSCE for second-year medical students. Med Teach. 1989;11(3-4):291–3. https://doi.org/10.3109/01421598909146415.

    CAS  Article  PubMed  Google Scholar 

  12. Dupras DM, Li JT. Use of an objective structured clinical examination to determine clinical competence. Acad Med. 1995;70(11):1029–34. https://doi.org/10.1097/00001888-199511000-00022.

    CAS  Article  PubMed  Google Scholar 

  13. Pugh D, Bhanji F, Cole G, Dupre J, Hatala R, Humphrey-Murto S, et al. Do OSCE progress test scores predict performance in a national high-stakes examination? Med Educ. 2016;50(3):351–8. https://doi.org/10.1111/medu.12942.

    Article  PubMed  Google Scholar 

  14. Hilliard RI, Tallett SE. The use of an objective structured clinical examination with postgraduate residents in pediatrics. Arch Pediatr Adolesc Med. 1998;152(1):74–8. https://doi.org/10.1001/archpedi.152.1.74.

    CAS  Article  PubMed  Google Scholar 

  15. Townsend AH, McLlvenny S, Miller CJ, Dunn EV. The use of an objective structured clinical examination (OSCE) for formative and summative assessment in a general practice clinical attachment and its relationship to final medical school examination performance. Med Educ. 2001;35(9):841–6. https://doi.org/10.1046/j.1365-2923.2001.00957.x.

    CAS  Article  PubMed  Google Scholar 

  16. Lien HH, Hsu SF, Chen SC, Yeh JH. Can teaching hospitals use serial formative OSCEs to improve student performance? BMC Res Notes. 2016;9(1):464. https://doi.org/10.1186/s13104-016-2266-1.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Madrazo L, Lee CB, McConnell M, Khamisa K, Pugh D. No observed effect of a student-led mock objective structured clinical examination on subsequent performance scores in medical students in Canada. J Educ Eval Health Prof. 2019;16. https://doi.org/10.3352/jeehp.2019.16.14.

  18. Alkhateeb NE, Al-Dabbagh A, Ibrahim M, Al-Tawil NG. Effect of a formative objective structured clinical examination on the clinical performance of undergraduate medical students in a summative examination: a randomised controlled trial. Indian Pediatr. 2019;56(9):745–8. https://doi.org/10.1007/s13312-019-1641-0.

    Article  PubMed  Google Scholar 

  19. Chisnall B, Vince T, Hall S, Tribe R. Evaluation of outcomes of a formative objective structured clinical examination for second-year UK medical students. Int J Med Educ. 2015;6:76–83. https://doi.org/10.5116/ijme.5572.a534.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Angoff W. Scales, norms and equivalent scores. In: Thorndike RL, editor. Educational measurement. Washington: American Council on Education; 1971. p. 508–600.

    Google Scholar 

  21. Morrison H, McNally H, Wylie C, McFaul P, Thompson W. The passing score in the objective structured clinical examination. Med Educ. 1996;30(5):345–8. https://doi.org/10.1111/j.1365-2923.1996.tb00845.x.

    CAS  Article  PubMed  Google Scholar 

  22. Wood TJ, Humphrey-Murto SM, Norman GR. Standard setting in a small scale OSCE: a comparison of the modified borderline-group method and the borderline regression method. Adv Health Sci Educ. 2006;11(2):115–22. https://doi.org/10.1007/s10459-005-7853-1.

    Article  Google Scholar 

  23. Bevan J, Russell B, Marshall B. A new approach to OSCE preparation - PrOSCEs. BMC Med Educ. 2019;19(1):126. https://doi.org/10.1186/s12909-019-1571-5.

    Article  PubMed  PubMed Central  Google Scholar 

  24. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med. 2011;86(6):706–11. https://doi.org/10.1097/ACM.0b013e318217e119.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Schuwirth LWT, der Vleuten CPMV. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 2011;33(6):478–85. https://doi.org/10.3109/0142159X.2011.565828.

    Article  PubMed  Google Scholar 

  26. Larsen DP, Butler AC, Roediger HL. Comparative effects of test-enhanced learning and self-explanation on long-term retention. Med Educ. 2013;47(7):674–82. https://doi.org/10.1111/medu.12141.

    Article  PubMed  Google Scholar 

  27. Binks S. Testing enhances learning: a review of the literature. J Prof Nurs Off J Am Assoc Coll Nurs. 2018;34(3):205–10. https://doi.org/10.1016/j.profnurs.2017.08.008.

    Article  Google Scholar 

  28. Wang EE, Beaumont J, Kharasch M, Vozenilek JA. Resident response to integration of simulation-based education into emergency medicine conference. Acad Emerg Med. 2008;15(11):1207–10. https://doi.org/10.1111/j.1553-2712.2008.00208.x.

    Article  PubMed  Google Scholar 

  29. Hodder RV, Rivington RN, Calcutt LE, Hart IR. The effectiveness of immediate feedback during the objective structured clinical examination. Med Educ. 1989;23(2):184–8. https://doi.org/10.1111/j.1365-2923.1989.tb00884.x.

    CAS  Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Ang Li Ying for her assistance with data collection.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Department of Emergency Medicine, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, Singapore, 308433, Singapore

    Magdalene Hui Min Lee, Dong Haur Phua & Kenneth Wei Jian Heng

Authors
  1. Magdalene Hui Min Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dong Haur Phua
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kenneth Wei Jian Heng
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KWJH conceived the study. KWJH and MHML designed the study and acquired the data. DHP and MHML analysed the data. MHML drafted the manuscript. All authors revised the manuscript and approved the final version of this manuscript.

Corresponding author

Correspondence to Magdalene Hui Min Lee.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the NHG Domain Specific Review Board (reference 2019/00589). The requirement for consent to participate was waived.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Lee, M.H.M., Phua, D.H. & Heng, K.W.J. The use of a formative OSCE to prepare emergency medicine residents for summative OSCEs: a mixed-methods cohort study. Int J Emerg Med 14, 62 (2021). https://doi.org/10.1186/s12245-021-00383-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12245-021-00383-4

Keywords

  • Formative
  • Summative
  • OSCE
  • Examination
  • Education
  • Residency

International Journal of Emergency Medicine

ISSN: 1865-1380

Contact us