- Original Research
- Open Access
- Published:
The role of emergency medicine clerkship e-Portfolio to monitor the learning experience of students in different settings: a prospective cohort study
International Journal of Emergency Medicine volume 11, Article number: 24 (2018)
Abstract
Background
Although emergency departments provide acute care learning opportunities for medical students, student exposure to recommended curriculum presentations and procedures are limited. In this perspective, clinical environments providing learning opportunities for students should be monitored as part of an ongoing quality improvement process. This study aims to analyze student exposures and their involvement levels in two different hospitals (Tawam and Al Ain) so as to improve the teaching and learning activities.
Methods
This is a prospective study on all 76 final year medical students’ electronic logbooks (e-Portfolio) of the academic year 2016/2017.
Results
Students recorded 5087 chief complaints and 3721 procedures. The average patient and procedure exposure in a shift per student in Al Ain Hospital compared with Tawam Hospital were 7.2 vs 6.4 and 5.8 vs 4.3, respectively. The highest full involvement with presentations was seen in the pediatric unit (67.1%, P < 0.0001). Urgent care shifts demonstrated the highest area of “full involvement” with procedures for our students (73.2%, P < 0.0001). Students’ highest involvement with presentations and procedures were found during the night shifts (P < 0.0001, 66.5 and 75.1%, respectively).
Conclusions
The electronic portfolio has proven to be a very useful tool in defining the learning activities of final year medical students during their emergency medicine clerkship and in comparing activities in two different clinical settings. Data collected and analyzed using this e-Portfolio has the potential to help medical educators and curriculum designers improve emergency medicine teaching and learning activities.
Background
Emergency departments (EDs) provide rich clinical learning opportunities to medical students [1]. They increase confidence in both acute care and procedural skills [2]. Nevertheless, their exposure to recommended curriculum presentations and procedures are limited [3,4,5,6]. In addition, their involvement level with clinical presentations and procedures varies [7]. Alignment of curriculum content, learning outcomes, teaching and learning activities, and assessments is critically important in reaching desired outcomes. Given this perspective, clinical environments providing learning opportunities for students should be monitored to determine if they meet expectations and are fit for purpose. Exposures including quantity and severity differ between various settings. Without understanding student exposure to presentations and procedures in the clinical environment, we cannot assure that they receive proper training in the clerkships [5], neither can we modify the curriculum to fit their needs.
Clinical logbooks document medical student clinical exposures and improve student performance of procedures [8, 9]. Timely student learning exposure is very important during short clerkships because it can provide feedback to students and guide them to achieve their required presentations and procedures. Hard copy logbooks may not be useful for this purpose. Our previous experience showed that collecting, evaluating, and analyzing logbook data at the end of the clerkship are difficult and not useful for timely feedback [7]. Electronic logbooks overcome many of these obstacles [10]. Proper monitoring and analysis of electronic logbooks can modify teaching and learning activities during the clerkship as well as provide guidance for future modifications of the curriculum.
In this study, we aimed to prospectively analyze student ED exposures and involvement levels in two hospitals during various shifts and units in order to improve curriculum teaching and learning opportunities in our clerkship.
Methods
Study design, setting, and participants
This is a prospective study analyzing student electronic logbooks (e-Portfolio). The study was conducted in the Emergency Medicine (EM) clerkship of the College of Medicine and Health Sciences of the UAEU during 2016/2017 academic year. The EM clerkship is a 4-week rotation for senior (sixth year) medical students. The content of the EM clerkship curriculum was adopted from the Society for Academic Emergency Medicine [11] and International Federation for Emergency Medicine [12] and consists of 11 chief complaints (abdominal pain, altered mental status, cardiac arrest and arrhythmias, chest pain, fever in a child, gastrointestinal bleeding, headache, poisoning, respiratory distress, shock, and major trauma) and five procedures (airway management, cardiopulmonary resuscitation and arrhythmia management [CPR-AM], suturing and wound care, focused assessment with sonography on trauma [EFAST], rapid ultrasonography for shock and hypotension [RUSH]).
Teaching, learning, and assessment activities are directed by a clerkship director and implemented collaboratively with core-faculty members and senior EM residents. Teaching sessions include up to date pedagogies such as flipped classroom, team-based learning, and case-based learning instead of didactic faculty lectures. Skill sessions are held in the College simulation and skills center. Simple medical skills manikins are used for airway and suturing practices as well as high-fidelity manikins for CPR-AM practices. Normal human models are used for ultrasound training. Assessments consist of weekly multiple-choice question exams in team-based learning activities, oral case presentations, clinical shift performance evaluations by supervisors, a final multiple-choice question exam, and an objective-structured clinical examination.
The students complete their clinical shifts in two teaching hospitals in our city, Tawam Hospital and Al Ain Hospital. Both hospitals treat more than 115,000 emergency patients every year. Tawam Hospital implements an ACGME-I accredited EM residency program. During the 2016/2017 academic year, there were five groups of 9 to 17 students each, with a total of 76 final year medical students (47 females, 19 males). Six out of ten clinical shifts for each medical student were completed in Tawam Hospital, and each clinical shift period was 9 h long. The shift hours were also similar in the Al Ain Hospital. Students complete three clinical shifts in the resuscitation unit, four in the urgent care area, two in the fast-track area, and one in the pediatric unit. Students work different shift times in the units; day time (08:00–17:00), three shifts; prime time (13:00–22:00), four shifts; evening time (15:00–24:00), two shifts; and night time (24:00–09:00), one shift.
Data collection and analysis
SharePoint was used as the e-Portfolio medium of EM clerkship. Students access this website securely from their computers or mobile devices by entering their specific credentials [13]. Students are asked to complete a minimum of 33 chief complaints and 33 procedures during the 4-week period. At the beginning of the clerkship, the clerkship director oriented the students on how to fill in the e-Portfolio. Students were informed to enter the main/chief complaint of the patients and most critical/life or organ-saving procedures first into the e-Portfolio. They were free to log all chief complaints and procedures they encounter on patients.
Data in the logbooks included descriptive information of patients such as matriculation number, age and gender, chief complaint seen, and procedure exposed by the student, hospital, unit, shift time, student involvement level, and some specific clinical areas related to their patients. Student involvement had three levels: (1) observation alone (observation with minimal activity), (2) partial involvement (first assistant with up to 50% activity), and (3) full involvement (start to finish care with more than 50% activity).
Students were supervised by an attending physician or a senior resident during the clinical shifts. Students were informed to seek help from the supervisors when deciding on data entry of any of the fields, especially the involvement level. Supervisors were the final authority to accept, modify, or cancel the logbook entries according to their own judgment. Supervisors also evaluated each student for their clinical performance at the end of clinical shifts.
This online platform provides continuous monitoring of student logbook entries by the clerkship director and offers feedback opportunities to students. The clerkship director used the log results in the individual feedback sessions which were held in the second week of the clerkship. Results of the e-Portfolio were evaluated at the end of the clerkship.
Comparison of continuous data of two groups was performed using the Mann–Whitney U test. Comparison of categorical data was performed using Pearson chi-squared test or Fisher’s exact test as appropriate. A P value of less than 0.05 was accepted as significant. Data were analyzed using Statistical Package for the Social Sciences (IBM-SPSS version 24.0, Chicago, IL, USA).
Results
Seventy-six students recorded 5087 chief complaints with more patients seen in Tawam Hospital, 2903 (57.1%). There were slightly more male patients logged by students (52.1%). Table 1 shows the comparison of patient demographics, chief complaints, and student involvement between the two hospitals. The total number of procedure encounters logged by students was 3721 with more procedures performed in Tawam Hospital 1971 (52.9%). Procedures were performed more often on male patients (55.8%). Table 2 shows the comparison of patient demographics, procedures, and student involvement between the two hospitals.
Students were exposed to younger patients in Tawam Hospital (Fig. 1). The distribution of chief complaints, procedures, and student involvement levels were significantly different between the two hospitals (P < 0.0001). There were 2216 (43.6%) encountered chief complaints in the “other” category which was not included in recommended curriculum topics (Appendix 1). Our students logged 2843 (76.4%) of procedures in the category of “other” (Appendix 2). Student involvement with chief complaints and procedures were significantly different between units (Table 3, P < 0.0001). The highest full involvement with presentations was seen in the pediatric unit (67.1%, P < 0.0001). Urgent care shifts demonstrated the highest area of “full involvement” with procedures for our students (73.2%, P < 0.0001). Student involvement with chief complaints and procedures were significantly different between shift times (Table 4, P < 0.0001). Students’ highest involvement with presentations and procedures were found during the night shifts (P < 0.0001, 66.5 and 75.1%, respectively).
Histogram of patients’ age who were encountered by the sixth year medical students in the emergency medicine clerkship in Al Ain (a) and Tawam Hospitals (b)
Discussion
Our study has shown that on average, the number of chief complaints and procedures exceeded the minimum required in our curriculum. However, e-Portfolio results showed that our students did not encounter all the recommended presentations and procedures of the curriculum in the clinical environment. The two hospitals showed differences in patient gender, age, chief complaint, procedure distribution, student involvement, and encounters related to shift time and location. Student involvement also varied depending on the location and clinical shift time.
We can enhance the learning experience of students in our curriculum in two ways. First, we can increase the feedback frequency to students regarding their logbook entries and guide them during the clerkship on recommended missing topics and procedures. In fact, this is what we did, individual feedback sessions included details of student logs at the midpoint of the course. Students were reminded about recommended presentations and procedures of the curriculum. In our recently published study, students who used hard copy logbooks encountered 57.8% of presentations in the “other” category [7]. This ratio decreased to 46.7% in the current study. It is possible that e-Portfolio record availability for students and individual feedback sessions using these records helped the students to focus on the recommended topics compared with students who used hard copies and did not have this feedback opportunity during the clerkship.
Second, we can modify teaching and learning activities by timely and focused feedback based on first-hand data and remediable issues will be beneficial for students [14]. Our results gave us a chance to modify our individual feedback sessions on a weekly basis. Students were exposed to a 1-hour case discussion session for each chief complaint and 90-min practical skills session for each procedure in the teaching program. However, they were exposed differently in the hospitals to these topics. As an example, our least encountered topics are cardiac arrest, gastrointestinal bleeding, shock, poisoning, and altered mental status in the chief complaint category and defibrillation/cardioversion, CPR, RUSH protocol, and airway management in the procedure category. It is obvious that the less exposed topics should be reviewed more in the classroom or trained on in the simulation/skills practices. In the classroom, interactive case discussions may connect knowledge with the clinical environment, encourage self-regulated learning, and identifies the gaps in knowledge or skills [15,16,17]. Simulation activities improve students’ knowledge, performance, confidence, and satisfaction [18,19,20]. Chakravarthy et al.’s systematic review concluded that simulation activities in clerkships are useful although future studies are needed to determine their efficacy [21].
Modifying shift times and locations can also be an option to improve teaching and learning. As an example, we reviewed the chest pain topic on the first day of the clerkship. This complaint was encountered more in Al Ain Hospital (12.0 vs 6.9%) although students have less shifts in this hospital. As a modification, students were given more shifts in this hospital in the first week of the clerkship. Al Ain Hospital has no EM residency program, and the ED is considered a community-based hospital ED. The average patients and procedure in a shift at Al Ain Hospital were more than those at Tawam Hospital. These results supported DeLahunta’s study in which they found that students assess more patients and perform procedures significantly more at a community-based hospital [22]. Furthermore, changing the distribution of shifts from one hospital to another will not affect the final exam results. Bernard reported that clerkship clinical site does not affect final exam score and using community hospitals for clinical teaching does not compromise education [23]. A similar approach can be applied to shift time. It is known that night shifts offer students extra educational opportunities [24]. Our students show significant full involvement during the night shifts. Therefore, increasing night shifts can improve student engagement with patients. However, modifying clinical schedules to improve performance requires higher and multi-level analysis and programming [25].
Limitations
We have to acknowledge that our study has several limitations. Although our clinical supervisors do their best to assure the validity of our data, the control of every entry in busy clinical shifts cannot be completely assured. In addition, underreporting of core problems by students as described by Denton is also one of our continuous concerns [7, 26]. The present study includes a single EM clerkship in a medical college and covers only a 1-year period. Thus, the results may not be generalizable to different settings.
As adult learners, students decide their own learning needs and choose presentations and procedures relevant to these needs. However, achieving sufficient exposure to the recommended curriculum topics is important to achieve the intended learning outcomes. Students may not reach educationally acceptable levels of presentations and procedures during their clerkship. Therefore, some modifications in clerkship curricula may turn out to be necessary.
Because there is no defined number of exposures and level of involvement to achieve student competency on a specific chief complaint or procedure in the literature [7], our changes in teaching and learning applications in the curriculum depend on our own assumptions. Using multi-level analyses and programming will provide a better understanding of the effects of modifying the ED student scheduling. We are aiming in the near future to make changes that achieve the best desired clinical experience for our students.
Conclusions
The electronic portfolio has proven to be a very useful tool in defining the learning activities of final year medical students during their emergency medicine clerkship and in comparing activities in two different clinical settings. Data collected and analyzed using this e-Portfolio has the potential to help medical educators and curriculum designers improve EM teaching and learning activities.
Abbreviations
- ACGME-I:
-
Accreditation Council of Graduate Medical Education-International
- CPR-AM:
-
Cardiopulmonary resuscitation–arrhythmia management
- ED:
-
Emergency department
- EFAST:
-
Extended focused assessment with ultrasound in trauma
- EM:
-
Emergency Medicine
- RUSH:
-
Rapid ultrasound in shock and hypotension
- UAEU:
-
United Arab Emirates University
References
- 1.
Johnson GA, Pipas L, Newman-Palmer NB, Brown LH. The emergency medicine rotation: a unique experience for medical students. J Emerg Med. 2002;22:307–11.
- 2.
Avegno JL, Murphy-Lavoie H, Lofaso DP, Moreno-Walton L. Medical students’ perceptions of an emergency medicine clerkship: an analysis of self-assessment surveys. Int J Emerg Med. 2012;5:25.
- 3.
Hem-Stokroos HV, Scherpbier AJ, Vleuten CV, et al. How effective is a clerkship as a learning environment? Med Teach. 2001;23:599–604.
- 4.
Avegno J, Leuthauser A, Martinez J, et al. Medical student education in emergency medicine: do students meet the national standards for clinical encounters of selected core conditions? J Emerg Med. 2014;47:328–32.
- 5.
McGraw R, Lord JA. Clinical activities during a clerkship rotation in emergency medicine. J Emerg Med. 1997;15:557–62.
- 6.
De Lorenzo RA, Mayer D, Geehr EC. Analyzing clinical case distributions to improve an emergency medicine clerkship. Ann Emerg Med. 1990;19:746–51.
- 7.
Shaban S, Cevik AA, Canakci ME, Kuas C, El Zubeir M, Abu-Zidan F. Do senior medical students meet recommended emergency medicine curricula requirements? BMC Med Educ. 2018;18(1):8.
- 8.
Soler NG, Mast TA, Anderson MB, Kienzler LM. A logbook system for monitoring student skills and experiences. J Med Educ. 1981;56:775–1.
- 9.
Hunskaar S, Seim SH. The effect of a checklist on medical students’ exposures to practical skills. Med Educ. 1984;18:439–42.
- 10.
Penciner R, Siddiqui S, Lee S. Emergency medicine clerkship encounter and procedure logging using handheld computers. Acad Emerg Med. 2007;14:727–31.
- 11.
Manthey DE, Ander DS, Gordon DC, et al. Emergency medicine clerkship curriculum: an update and revision. Acad Emerg Med. 2010;17:638–43.
- 12.
Hobgood C, Anantharaman V, Bandiera G, et al. International Federation for Emergency Medicine model curriculum for medical student education in emergency medicine. Emer Med Australas. 2009;21:367–72.
- 13.
Bernard AW, Kman NE, Khandelwal S. Feedback in the emergency medicine clerkship. West J Emerg Med. 2011;12(4):537.
- 14.
SharePoint (https://products.office.com/en-us/sharepoint/collaboration) Redmount (WA): Microsoft Corp.; revised 2016. Accessed 12 Jan 2018.
- 15.
Irby DM, Cooke M, O'brien BC. Calls for reform of medical education by the Carnegie Foundation for the Advancement of Teaching: 1910 and 2010. Acad Med. 2010;85(2):220–7.
- 16.
Rice S, McKendree J. E-learning. In: Swanwick T, editor. Understanding medical education: evidence, theory and practice, Kindle edition. Chichester: Wiley; 2014.
- 17.
Launer J. Supervision, mentoring and coaching. In: Swanwick T, editor. Understanding medical education: evidence, theory and practice, Kindle edition. Chichester: Wiley; 2014.
- 18.
Steadman RH, Coates WC, Huang YM, et al. Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Crit Care Med. 2006;34:151–7.
- 19.
McCoy CE, Menchine M, Anderson C, et al. Prospective randomized crossover study of simulation vs. didactics for teaching medical students the assessment and management of critically ill patients. J Emerg Med. 2010;40:448–55.
- 20.
Ten Eyck RP, Tews M, Ballester JM. Improved medical student satisfaction and test performance with a simulation-based emergency medicine curriculum: a randomized controlled trial. Annals EM. 2009;54:684–91.
- 21.
Chakravarthy B, ter Haar E, Bhat SS, McCoy CE, Denmark TK, Lotfipour S. Simulation in medical school education: review for emergency medicine. West J Emerg Med. 2011;12(4):461.
- 22.
DeLahunta EA, Bazarian J. University and community hospital medical student emergency medicine clerkship experiences. Acad Emerg Med. 1998;5(4):343–6.
- 23.
Bernard AW, Dubosh N, O’Connell M, Adkins J, Khandelwal S, Hiestand B. Clinical teaching site does not affect test performance in an emergency medicine clerkship. Acad Emerg Med. 2011;18(7):741–4.
- 24.
Goren EN, Leizman DS, La Rochelle J, Kogan JR. Overnight hospital experiences for medical students: results of the 2014 clerkship directors in internal medicine national survey. J Gen Intern Med. 2015;30(9):1245–50.
- 25.
Kiris S, Yuzugullu N, Ergun N, Cevik AA. A knowledge-based scheduling system for emergency departments. Knowl-Based Syst. 2010;23(8):890–900.
- 26.
Denton GD, Hoang T, Prince L, Moores L, Durning S. Accuracy of medical student electronic logbook problem list entry. Teach Learn Med. 2007;19(4):347–51.
Availability of data and materials
Data and materials are available.
Author information
Affiliations
Contributions
AAC, SS, MEZ, and FAZ conceived and designed the study. AAC collected the data and did the literature search. FAZ and AAC analyzed the data. AAC and FAZ drafted the manuscript. AAC, FAZ, SS, and MEZ critically reviewed the manuscript. All authors contributed substantially to its revision. AAC takes responsibility for the paper as a whole. All authors have read and approved the final version of this manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was reviewed and approved by The Research and Graduate Studies Ethics Committee of United Arab Emirates University (UAEU) (Reference No: ERS-2016-4387).
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1
Appendix 2
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Cevik, A.A., Shaban, S., El Zubeir, M. et al. The role of emergency medicine clerkship e-Portfolio to monitor the learning experience of students in different settings: a prospective cohort study. Int J Emerg Med 11, 24 (2018). https://doi.org/10.1186/s12245-018-0184-9
Received:
Accepted:
Published:
Keywords
- Emergency medicine
- Undergraduate medical education
- e-Portfolio
- Electronic logbook
