The objective of this study is to assess the impact of a multimodal intervention on emergency department (ED) crowding and patient flow in a Dutch level 1 trauma center.
In this cross-sectional study, we compare ED crowding and patient flow between a 9-month pre-intervention period and a 9-month intervention period, during peak hours and overall (24/7). The multimodal intervention included (1) adding an emergency nurse practitioner (ENP) and (2) five medical specialists during peak hours to the 24/7 available emergency physicians (EPs), (3) a Lean programme to improve radiology turnaround times, and (4) extending the admission offices’ openings hours.
Crowding is measured with the modified National ED OverCrowding Score (mNEDOCS). Furthermore, radiology turnaround times, patients’ length of stay (LOS), proportion of patients leaving without being seen (LWBS) by a medical provider, and unscheduled representations are assessed.
The number of ED visits were grossly similar in the two periods during peak hours (15,558 ED visits in the pre-intervention period and 15,550 in the intervention period) and overall (31,891 ED visits in the pre-intervention period vs. 32,121 in the intervention period). During peak hours, ED crowding fell from 18.6% (pre-intervention period) to 3.5% (intervention period), radiology turnaround times decreased from an average of 91 min (interquartile range 45–256 min) to 50 min (IQR 30–106 min., p < 0.001) and LOS reduced with 13 min per patient from 167 to 154 min (p < 0.001). For surgery, neurology and cardiology patients, LOS reduced significantly (with 17 min, 25 min, and 8 min. respectively), while not changing for internal medicine patients. Overall, crowding, radiology turnaround times and LOS also decreased. Less patients LWBS in the intervention period (270 patients vs. 348 patients, p < 0.001) and less patients represented unscheduled within 1 week after the initial ED visit: 864 (2.7%) in the pre-intervention period vs. 645 (2.0%) patients in the intervention period, p < 0.001.
In this hospital, a multimodal intervention successfully reduces crowding, radiology turnaround times, patients’ LOS, number of patients LWBS and the number of unscheduled return visits, suggesting improved ED processes. Further research is required on total costs of care and long-term effects.
Crowding in the emergency department (ED) is associated with lesser patient flow and adverse patient outcomes [1,2,3]. ED crowding is usually a consequence of insufficient inpatient hospital capacity or inadequate coordination of capacity within a hospital, and subsequently, the boarding of patients in the ED for extended periods of time [4, 5]. Experts widely agree that ED crowding is a system-wide problem, not one that solely results from problems in the ED or one that can be addressed using only ED-based interventions [6, 7]. Improving patient flow is essential to reduce ED crowding, but requires involvement of professionals outside the ED [8, 9] and support from hospital management. Therefore, a Taskforce Acute Care Team (TACT) was introduced in the study setting: a group of hospital managers and medical specialists dedicated to improve the quality of patient care and patient flow, addressing acute care as a strategic priority. The TACT introduced four process changes with the intention to improve patient flow at the ED: (1) adding an emergency nurse practitioner (ENP) and (2) adding five medical specialists during ED peak times (noon to 8 pm) to the 24/7 available emergency physicians (EPs), (3) a Lean programme to improve radiology report turnaround times and (4) extending the admission offices’ openings hours to help ED staff with finding an inpatient bed. This multimodal intervention was formally implemented in November 2017. The present study focuses on the impact of the multimodal intervention on ED crowding and patient flow.
In previous research, similar clinical redesign projects have been studied, including streaming patients directly from triage to dedicated minor injury units or super tracks  and ENP-led units [11,12,13], senior early assessment models of care [14,15,16,17], Lean methods [18,19,20,21], and improving access to inpatient admission . Improving ED processes has been shown to reduce the length of stay (LOS), although studies show varying results, and the effect on crowding is uncertain .
The purpose of this study is to test the impact of a multimodal intervention on ED crowding and patient flow in a Dutch level 1 trauma center. In this study, we assess crowding levels, radiology report turnaround times and patients’ ED LOS during peak hours and overall. To ensure that enhanced patient flow is not achieved at the expense of high quality of care, we assess the percentage of patients leaving without being seen (LWBS) by a medical provider, reflecting potential harmful outcomes . Furthermore, we describe the number of unscheduled representations to the ED within 1 week of the initial visit, a measure of patient safety .
In this observational, cross-sectional study, we compare crowding, radiology turnaround times, patients’ ED LOS, and the proportion of patients LWBS and unscheduled representations between a 9 months pre-intervention period (December 2016 to September 2017) and the 9 months intervention period (December 2017 to September 2018).
The study was performed at Haaglanden Medical Center (HMC) Westeinde, an inner-city, 380-bed acute neurovascular and level 1 trauma center in the Netherlands. The ED has an annual census of 54,000 adult and paediatric patient visits and a 24% admission rate. All patients are registered in the hospital database before they proceed to triage. After triage, patients who are eligible for treatment by a general practitioner (GP) are redirected to the GP cooperative (GPC), which is located next to the ED. The remaining patients are assessed at the ED. In this study, patients who are redirected to the GP are excluded from the analysis.
The nursing staff consists of 75% certified emergency nurses (CENs), 20% registered nurses in training for CEN, and 5% ENPs. Dutch ENPs are independent practitioners who are able to assess, diagnose, treat, prescribe, and refer to other health specialties. EPs are available 24/7. Per shift, one EP, one or two EPs in training, one surgical resident, one neurology resident, one internal medicine resident, one gynaecology resident, and one cardiology resident work at the ED. Attending specialists (non-EP) are available in the hospital (office hours) and on-call (out-of-hours) when needed. Imaging procedures are read by radiology residents who release a preliminary report through the Picture Archiving and Communication System (PACS) with a subsequent final attending report within 24 h.
In previous years, multiple process changes targeting ED crowding were successfully implemented in our ED including triage, a GPC, acute admission units , and 24/7 coverage of EPs. Nowadays, the ED has a relatively short LOS compared with nationally and internationally reported targets . To prepare for expected future developments impacting acute care in our country, such as the closure of EDs and the increase of elderly patients presenting to the ED, the TACT aims to further improve ED patient flow. Their multimodal intervention included four process changes, intended to decrease crowding and improve ED patient flow:
One ENP was added to the nursing team per day shift and evening shift to improve flow for patients with minor injuries and minor illnesses who were not eligible for redirection to the GPC, e.g. patients with fractures of extremities.
Seven days a week, during peak hours, the ED medical staff was expanded with five attending medical specialists (cardiologist, internist, neurologist, radiologist, and surgeon), working side by side with the EPs, residents, and ENPs. The five attending medical specialists are involved in patients’ assessment on arrival and they perform direct on-site supervision. This change was trialled for 10 weeks in 2016 and showed an overall decrease in LOS with large variability by specialty [28, 29]. The residents kept working as usual. One EP per shift undertook a more coordinating role during the intervention period. This EP could initiate a team-based approach when indicated, with patients assessed and managed simultaneously by several attending specialists at an early stage.
A 5-day Lean project within the radiology department was organised, including key stakeholders such as the radiographers, radiology residents, radiologists, and management. In Lean methodology, the use for any goal other than the creation of value is wasteful and should be eliminated. In radiology, this translates into strategies to reduce wait times . Our Lean team focused on improved radiography and report turnaround time, one of the largest bottlenecks in the ED process according to the attending specialists . The Lean team introduced, amongst other strategies, a diagnostic fast-track for CT, a strategy to reduce back and forth phone calls, and the installation of runners for the transport of patients to and from ED and radiology room.
The admission offices’ openings hours were extended from 8 am to 5 pm into from 8 am to 8 pm, to better match the ED peak hours and thus, improve the outflow of the ED. Furthermore, the nurses from the inpatient units were asked to collect the patients from the ED within 30 min after the decision to admit.
The outcome of interest was ED crowding, measured with the modified National ED OverCrowding Score (mNEDOCS), a multidimensional scale to measure patient volume and throughput in hospitals . The mNEDOCS alike the NEDOCS, is subdivided into 6 categories: 0–20, not busy; 21–60, busy; 61–100, extremely busy; 101–140, crowded; 141–180, severely crowded; > 180, disaster) . Variables needed to calculate the mNEDOCS include total ED beds, total hospital beds, total patients in the ED, total admits in the ED, longest admit time in hours, waiting room time in hours of the most recent patient placed in a bed in the ED, and the number of patients who are being resuscitated or assigned the highest acuity level (Table 1). The mNEDOCS has been shown to correlate well with perceived crowding in this ED .
Secondary outcomes were radiology report turnaround times, defined as the time from order entry to the time the radiology releases a report in the PACS system; patients’ ED LOS; the proportion of patients LWBS and the proportion of unscheduled representations within 1 week of the initial ED visit.
Outcome data were extracted from the clinical information system, as were demographic details (age, sex), and visit information (date and time of ED arrival, triage level, number and type of diagnostics requests, date and time of ED discharge, and discharge disposition).
Descriptive statistics were used to characterise the sample of the pre-intervention and intervention period. A computer programme queries the hospital information system for the data required to calculate the mNEDOCS at 15-min intervals and the scores during peak hours and overall were compared between the pre-intervention and intervention period. Radiology report turnaround times and LOS were calculated for patients arriving during peak times and for patients arriving 24/7 and compared between the pre-intervention and intervention period. We also calculated and compared total number, number of hospital admissions, and LOS of patients arriving during peak hours who were evaluated for (pre-intervention period) and by (intervention period) cardiology, surgery/traumatology, neurology, internal medicine, and other (patients who were assessed by one of the other medical specialties) and for patients who were having at least one radiology procedure.
Age, LOS, and mNEDOCS are reported as median (IQR). Differences between the periods were compared using the Mann-Whitney U test, given the non-normal distribution of the metrics. To compare categorical variables between the periods, we used χ2 tests. Significance threshold was set at a p value of 0.05. Statistical analysis was performed using SPSS (Statistical Package for the Social Sciences, IBM Corp., IBM SPSS Statistics for Windows, Version 22.0, Armonk, NY, USA).
The datasets did not contain individual identifiers to ensure the anonymity of the patients. The regional medical ethics committee and the institutional review board approved the study (Southwest Holland, nr. 17–122).
During the 18-month study period, 81,213 patient presentations were registered, 39,535 (48.7%) during the pre-intervention period, of which 7644 (19.3%) were diverted to the GPC, and 41,678 (51.3%) during the intervention period of which 9557 (22.9%) were diverted to the GPC. The remaining 64,012 patient presentations were included: 31,891 in the pre-intervention period and 32,121 in the intervention period (Fig. 1).
In the intervention period, there were more elderly patients and lesser children, lesser self-referred patients, lesser high-acuity but more urgent patients, lesser patients with limb problems and ear/nose/throat/eye problems, and more patients with shortness of breath and feeling unwell, compared to the pre-intervention period. There was no difference between the pre-intervention and intervention period in the number of patients arriving during peak hours (Table 2), and no differences in the number of patients needing hospital admission, patients who died at the ED and patients with one or more requests for imaging procedures during their ED visit (Table 3).
During the intervention period, significantly less plain radiographs but more CT-scans, ultrasounds, and other radiology orders were executed (Table 4). These findings were similar when focusing on the peak hours of the study periods (data not shown).
The mNEDOCS was calculated each 15 min of every hour. The computerised system broke down during 41 days from 19 January 2018 until 28 February 2018, resulting in the loss of 3936 scores. In the control period, 379 scores were omitted due to system problems. All missing measurements in one of the two periods were deleted in the other one, matched on date and time, resulting in a data file with the remaining 43,978 scores, 21,989 in the pre-intervention period and 21,989 in the intervention period.
During peak times, the measurements of mNEDOCS above 100 (indicating crowding) fell from 18.6% in the pre-intervention period to 3.5% in the intervention period. It was significantly more often “not busy” or “busy,” indicated by a mNDEDOCS of 60 and lower (30.8% of the measurements during the pre-intervention period and 60.9% of the measurements during the intervention period (Table 5)).
Overall, 7.7% of the measurements in the pre-intervention period were above 100, while this was only 1.3% during the intervention period (Table 6). The ED was significantly less often ‘extremely busy’ (25.5% during the pre-intervention period vs. 15.5% during the intervention period (p < 0.001)).
Radiology turnaround times
The median turnaround times for radiology reporting decreased significantly for plain imaging procedures, as well as for CT and ultrasonography during peak hours (Table 7) and overall (Table 8).
Patients’ length of stay at the ED
During the peak hours, the median LOS reduced with 13 min from 167 to 154 min (p < 0.001). For surgery patients, LOS reduced with 17 min from 141 min to 124 min (p < 0.001) and for neurology patients, with 25 min from 203 min to 178 min (p < 0.001). The LOS for cardiology patients decreased by 8 min from 166 min to 158 min during peak hours. The LOS for internal medicine patients did not change (Table 9).
Overall, the median LOS reduced with 8 min from 157 to 149 min (p < 0.001). While LOS for surgical patients and neurology patients decreased with 12 and 16 min, respectively, LOS for cardiology patients and internal medicine patients remained similar (Table 10).
Patients leaving without being seen and unscheduled representations within 1 week
Significantly less patients LWBS: 348 patients in the pre-intervention period vs. 270 patients in the intervention period, p < 0.001. There were also significantly less unscheduled representations at the ED within 1 week after the initial ED visit: 864 (2.7%) in the pre-intervention period vs. 645 (2.0%) patients in the intervention period, p < 0.001.
This study demonstrates improvement in ED flow after the introduction of the multimodal intervention. Hours of crowding decreased significantly, as did the patients’ ED LOS. During the peak hours in the intervention period, we found a 13-min reduction in ED LOS per patient, totaling 3369 h between noon and 8 pm during the 274 day-intervention period. This additional time is now available for direct patient care.
The process changes were based on previous research: implementing care by ENPs can reduce waiting times in the ED [11,12,13]. Involvement of medical specialists is associated with increased decisiveness resulting in decreased LOS . In a pilot study performed in the study setting, a decrease in LOS for admitted patients was found when medical specialists are involved at the ED. In that study, delays in radiology turnaround times were considered a main constraint for ED throughput . This finding led to the organisation of a 5-day Lean project within the radiology department, focusing on improved turnaround time for radiography. Alike shown in other studies [18, 20], the Lean methodology was effective in reducing turnaround times for radiology results. Unfortunately, this reduction in waiting time for radiology results is only partially translated into reduced overall LOS. This is not surprising, since LOS is affected by factors beyond the ED process .
Our findings are in line with other studies showing that hospital-wide interventions reduce ED crowding [7, 9, 12]. The support of our hospital leadership and the TACT towards improving patient care was a mitigating factor in the success of the process changes. Bringing together diverse disciplines including medical specialists and ED staff fostered a new focus on ED flow as being not only an ED issue but a system-wide issue. Our multimodal intervention alleviated ED crowding and reduced ED patients’ LOS. Crowded circumstances (mNEDOCS > 100) decreased significantly. It seems plausible that the additional medical specialists available at the ED during peak times were (at least in part) responsible for this. When attending specialists make immediate assessments in the ED, there is less replication of work and decisions about next steps are made more quickly . Additionally, the intervention enhanced focus on acute care throughout the hospital. This was an important driving factor in freeing hospital beds on behalf of acute admissions.
From the current research, it cannot be concluded whether additional attending specialists and ENPs were needed to obtain these results, or whether additional EPs or other human resources would have generated the same or even better effects. Adding attending specialists to the ED staff during peak hours is a costly intervention, while for some patient groups (e.g. internal medicine), there was no change in ED LOS. The total costs and cost-effectiveness of the current intervention and alternatives need to be compared. To study the cost-effectiveness of alternative staffing decisions, ED simulation modelling may be valuable.
A reason why ED LOS did not reduce for internal medicine patients might be that an internist had been available for the acute admission unit and the ED for many years already, focusing on ED outflow far before the current project started. Also, confounding factors may have played an important role. For example, the flu season lasted until the end of February during the intervention period, while it ended a month earlier during the pre-intervention period.
Our positive findings of decreased crowding and reduced patients’ LOS cannot be attributed to differences between the pre-intervention and intervention population. There was a small (0.7%) increase in the number of presentations and no difference in the number of hospital admissions. The differences between the populations suggest a sicker population in the intervention period: there were more elderly patients and patients with shortness of breath and feeling unwell, and lesser patients with limb problems and ear-nose-throat-eye problems. The first two groups are usually more labour-intensive for ED staff and patients have lengthier stays compared to patients with limb or ear/nose/throat or eye problems. Since the patient population in the intervention period was at least as high complex as the patient population in the pre-intervention period, the main reason for the significant decrease in crowding levels during the intervention period is probably the shortening of LOS. Shorter LOS is associated with improvements in patient experience  and a reduction of adverse events .
This study conveys the experience of a single institution and may have limited generalizability because of differences in patient population, level of crowding, and health care system. Some of the process changes and results may not be applicable to EDs working under different constraints. However, we feel that the process changes would be beneficial to many EDs.
One major factor which could have influenced crowding was a 3-year period of restructuring the ED which continued until mid-2018, halfway the intervention period. This was a six-phase construction project, each phase involving closing work areas and opening new spaces. Although the number of available treatment rooms remained similar throughout the study periods, ED staff may have experienced more frustration with patient care in a noisy environment during the pre-intervention period.
The intervention being studied was multimodal and ongoing during the intervention period, precluding separating the effects of each part of the intervention on the outcomes. We cannot attribute changes in ED crowding and LOS to the introduction of the intervention as it is impossible to control for other influences taking place simultaneously. Designing a randomised controlled trial to assess the effects of each part of the intervention was not ethical because process improvements should not be withheld from a part of the population. In a future study in another setting, it would be interesting to separate the effects of each change.
There may have been some variability in what patients and how many patients were evaluated and treated by the medical specialists and the ENPs, depending on the providers working and their level of training and experience with ED patients. Moreover, during the intervention period, ED staff and medical specialists knew that they were under observation, thereby potentially introducing a Hawthorne effect (change in behaviour induced by the study itself). However, it is expected that such an effect would not last 9 months.
We did not assess other staff models nor did we carry out an economic assessment of the interventions and their impact—a recommendation for future studies.
Regarding the number of patients with unscheduled return visits, it is possible that patients visited another ED which may have led to some cases not identified. However, it is unlikely that this would occur in only one of the periods.
A future study is needed to assess the effects of our multimodal intervention beyond the ED. For example, our findings show a decrease in presentations of unscheduled return visits within 1 week. It is possible that the number of scheduled revisits to the ED or to the policlinics also decreases when a medical specialist assesses the patient or when the radiologist already performs an ultrasound to exclude a certain diagnosis instead of rescheduling that patient the next day. It is also possible that medical specialists who experience difficulties in admitting a patient during their ED shift because of lack of beds are keener to discharge their inpatients before noon in the future, enhancing inpatient flow and decreasing access block.
In this hospital, a multimodal intervention successfully reduced crowding, radiology turnaround times, patients’ LOS, number of patients LWBS, and the number of unscheduled return visits, suggesting improved ED processes. Further research is required on total costs of care and long-term effects.
Availability of data and materials
The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
Certified emergency nurse
Emergency nurse practitioner
General Practitioner Cooperative
Haaglanden Medical Center
Length of stay
Left without being seen
Modified National Emergency Department OverCrowding Score
National Emergency Department OverCrowding Score
Picture Archiving and Communication System
Statistical Package of the Social Sciences
Taskforce Acute Care Team
Bernstein SL, Aronsky D, Duseja R, et al. The effect of emergency department crowding on clinically oriented outcomes. Acad Emerg Med. 2009;16:1–10.
Bonalumi NM, Bhattacharya A, Edwards C, et al. Impact of a planned workflow change: super track improves quality and service for low-acuity patients at an inner-city hospital. J Emerg Nurs. 2017;43:114–25.
Abdulwahid MA, Booth A, Kuczawski M, et al. The impact of senior doctor assessment at triage on emergency department performance measures: systematic review and meta-analysis of comparative studies. Emerg Med J. 2016;33:504–13.
Li CJ, Syue YJ, Tsai TC, et al. The impact of emergency physician seniority on clinical efficiency, emergency department resource use, patient outcomes, and disposition accuracy. Medicine (Baltimore). 2016;95:e2706.
El Sayed MJ, El-Eid GR, Saliba M, et al. Improving emergency department door to doctor time and process reliability: a successful implementation of lean methodology. Medicine (Baltimore). 2015;94:e1679.
van der Linden N, van der Linden MC, Richards JR, et al. Effects of emergency department crowding on the delivery of timely care in an inner-city hospital in the Netherlands. Eur J Emerg Med. 2015;23:337–43.
van der Linden MC, van den Brand CL, van den Wijngaard IR, et al. A dedicated neurologist at the emergency department during out-of-office hours decreases patients’ length of stay and admission percentages. J Neurol. 2018;265:535–41.
van der Linden MC, Van LM, Gaakeer MI, et al. A different crowd, a different crowding level? The predefined thresholds of crowding scales may not be optimal for all emergency departments. Int Emerg Nurs. 2018;41:25–30.
Weiss SJ, Derlet R, Arndahl J, et al. Estimating the degree of emergency department overcrowding in academic medical centers: results of the national ED overcrowding study (NEDOCS). Acad Emerg Med. 2004;11:38–50.
Ackroyd-Stolarz S, Read GJ, Mackinnon NJ, et al. The association between a prolonged stay in the emergency department and adverse events in older patients admitted to hospital: a retrospective cohort study. BMJ Qual Saf. 2011;20:564–9.
We gratefully thank the members of the Taskforce Acute Care for their hospital-wide involvement in improving acute care. Also, we thank the nursing and medical staff who participated in the projects. We acknowledge Veerle Vanneste and Christel van Zijp (former leaders Taskforce programme), Renee Barge and Paul Doop (hospital directors), Alexander de Vries (chair medical staff), Heleen van Nispen, and Yvonne van Geenhuizen (management acute care). A special thanks goes to Thomas Vissers, medical librarian, for his help with the literature, and Roger van Rietschote and Fabio Bruna (data warehouse) who provided the data for this study.
MCL and NL designed the study. MCL undertook and managed the data collection, including quality control. MCL analysed the data. MCL and NL drafted the manuscript, and all authors contributed substantially to its revision. All authors read and approved the final manuscript. MCL takes responsibility for the paper as a whole.
The ethical review committee of Southwest Holland, nr.17–122, granted approval and exemption. Patient consent was not required.
Consent for publication
Naomi van der Linden is also employed by AstraZeneca Netherlands, a pharmaceutical company. All authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
van der Linden, M.C.(., van Ufford, H.M.E.(., Project Group Medical Specialists. et al. The impact of a multimodal intervention on emergency department crowding and patient flow.
Int J Emerg Med12, 21 (2019). https://doi.org/10.1186/s12245-019-0238-7