Unscheduled return visits to a Dutch inner-city emergency department
International Journal of Emergency Medicine volume 7, Article number: 23 (2014)
Unscheduled return visits to the emergency department (ED) may reflect shortcomings in care. This study characterized ED return visits with respect to incidence, risk factors, reasons and post-ED disposition. We hypothesized that risk factors for unscheduled return and reasons for returning would differ from previous studies, due to differences in health care systems.
All unscheduled return visits occurring within 1 week and related to the initial ED visit were selected. Multivariable logistic regression was conducted to determine independent factors associated with unscheduled return, using patient information available at the initial visit. Reasons for returning unscheduled were categorized into illness-, patient- or physician-related. Post-ED disposition was compared between patients with unscheduled return visits and the patients who did not return.
Five percent (n = 2,492) of total ED visits (n = 49,341) were unscheduled return visits. Patients with an urgent triage level, patients presenting during the night shift, with a wound or local infection, abdominal pain or urinary problems were more likely to return unscheduled. Reasons to revisit unscheduled were mostly illness-related (49%) or patient-related (41%). Admission rates for returning patients (16%) were the same as for the patients who did not return (17%).
Apart from abdominal complaints, risk factors for unscheduled return differ from previous studies. Short-term follow-up at the outpatient clinic or general practitioner for patients with urgent triage levels and suffering from wounds or local infections, abdominal pain or urinary problem might prevent unscheduled return.
Unscheduled return visits to the emergency department (ED) are visits of patients who were seen in the ED and then return for an unscheduled visit for the same complaint. Unscheduled return visits may reflect a failure of the patients' treatment or discharge plan []. Different numbers of unscheduled return visits have been reported, ranging from 2% to 5% of the patients returning to the ED within 2 to 8 days after their initial visit [–]. The reasons for unscheduled return are frequently grouped into illness-related factors (such as disease progression), patient-related factors (such as patients who left against medical advice during their initial visit) and physician-related factors (such as medical errors) [,,]. Unscheduled return visits are more common in patients who lack access to primary care [] and in patients with no health insurance []. Unscheduled return is associated with frequent ED use [] and a greater risk of adverse events and mortality [].
In order to reduce unscheduled return visits, researchers have focused on risk factors that could help identify patients at risk for unscheduled return [,–]. Most of these studies have been performed in Canada and the USA and reported acute triage category [,], arrival in the evening [] and a respiratory diagnosis [] as risk factors for paediatric unscheduled return. A digestive diagnosis was reported as risk factor for unscheduled return in patients 65 years of age or older [,]. Having no insurance, a low triage category and suffering from dermatologic conditions [] were risk factors for unscheduled return in a mixed (adults and children) population.
In the Netherlands, the incidence of unscheduled ED return is unknown. We expect however that the incidence is lower than described in previous studies. Because all Dutch citizens have a general practitioner (GP) and GP services are available 24/7, patients should present at their GP instead of at the ED when they have ongoing complaints. We also hypothesize that the type of risk factors associated with unscheduled return differs from other studies, given the difference in health care systems. Health insurance is compulsory for all Dutch citizens, and health insurers are obliged to accept anyone who applies for standard health insurance.
The objectives of this study were to determine the incidence of unscheduled ED return visits, to identify the risk factors for these return visits, to assess the reasons for unscheduled return and to describe the post-ED disposition of patients at their return visit.
The study was conducted between 1 October 2009 and 30 September 2010 at the ED of Medical Centre Haaglanden, the Hague, the Netherlands, an urban, 380-bed trauma centre. The annual volume in the ED is approximately 52,000 visits, with a 17% admission rate.
The following are the methods of measurement used for each objective of the study:
To determine the incidence of ED return visits, we performed a database search of the patients' records. Emergency department return visits were included if they took place within 1 week of the initial visit and concerned the same complaint or its direct consequences. Scheduled return visits (visits of patients who were told to come back to the ED) were excluded.
To identify factors associated with unscheduled return, we manually reviewed all individual patient charts and compared patients with unscheduled return visits with patients who did not return. We examined factors (available at the initial visit) that were associated with unscheduled return in previous research, including age [,], sex [,], lacking health insurance [], lacking a GP [], triage level [,,,], arrival time [,], length of stay (LOS) [] and medical complaints [,,]. Medical complaints for which a patient visited the ED were retrieved by the triage flow charts recorded by the triage nurse.
Reasons for returning unscheduled were categorized into illness-related, patient-related or physician-related (Table 1), based on examples from previous studies [,,]. Categorization was independently done by two researchers (MCL and NL). In case of no agreement, the case was reviewed by a third researcher (ERJTD) and assigned to the category on which two of the three researchers agreed.
Post-ED dispositions were the discharge codes after the patients' treatment at the ED, comprising discharge, discharge against medical advice or left without being seen, hospital admission to a regular ward or admission to a special care unit (intensive care, coronary care or stroke unit).
All variables were obtained from the hospital electronic database and the medical records. The analyzed patient dataset contained no individual identifiers, maintaining anonymity of subjects. This study was approved by the institutional review board.
Patient and clinical characteristics were summarized using simple descriptive statistics. The χ2 test and unadjusted odds ratios (ORs) were used to assess the univariate association between age, sex, lacking health insurance, lacking a GP, triage level, arrival time, LOS and medical complaints on the one side and unscheduled return within 1 week on the other side. Additionally, all variables that were univariately associated with unscheduled return at ≤0.05 were entered into a multivariate logistic regression model. We also did the analysis with a <72-h unscheduled return. Effect sizes were expressed in adjusted ORs. The calibration and overall discriminative ability of the model was assessed with the Hosmer-Lemeshow test and the area under the receiver operating curve (AUC ROC) analysis, respectively []. In all analyses, statistical uncertainty was expressed in a 95% confidence interval (CI). Statistical analyses were performed in PASW (Predictive Analytics Software, version 18, Chicago, IL, USA).
During the study year, a total of 49,341 ED visits were recorded, of which 4,653 visits were related to unscheduled return (Figure 1). In total, 2,161 patients returned unscheduled to the ED within a week of their initial registration. Since some of them returned more than once, there were 2,492 associated unscheduled return visits, comprising 5.1% of the total ED visits (2,492/49,341).
During the first 72 h after the initial visit, 1,279 patients made 1,330 return visits out of 49,341 total ED visits for an overall 72-h return rate of 2.7%.
Factors associated with unscheduled return
Table 2 shows the univariate and multivariate associations between patient/clinical characteristics available at the initial visit and unscheduled ED return within 1 week. Logistic regression showed that the following factors had an independent impact on within-week unscheduled return: ‘urgent triage level’, ‘arrival during the night’, ‘LOS >1 h’ and the medical complaints ‘wound or local infections’, ‘abdominal pain’ and ‘urinary problems’ at the initial visit. Patients suffering from ‘chest pain’, ‘feeling unwell’ and children triaged with the category ‘sick baby’ were less likely to return unscheduled. The goodness of fit of the logistic model was moderate (P = 0.75), whereas the AUC demonstrated a weak discriminative ability (0.57; 95% CI 0.56 to 0.59).
Sub-analysis of 72-h return showed that associated factors were the same as for within-week return (data not shown).
Reasons for unscheduled return
The most common reasons for unscheduled return were illness-related (n = 1,229; 49%), followed by patient-related (n = 1,018; 41%) and physician-related reasons (n = 245; 10%) (Figure 2).
Within the 1,229 illness-related unscheduled return visits, ‘patients in whom ancillary diagnostics was performed while their diagnosis remained unchanged’ was the largest subgroup (n = 729; 59%). Within the 1,018 patient-related return visits, patients ‘worrying about health’ represented the most frequently occurring reason for return (523 visits, 51%). Within the physician-related return visits, 111 patients (45%) had ‘wrong or delayed diagnoses’ during their initial visit, which resulted in their return. In 73 physician-related return visits (30%), a ‘treatment error’ was made during the initial visit, such as patients returning with ongoing complaints because a foreign body in a wound was only removed partially. Sixty-one visits (25%) were caused by a ‘lack of a prescription of painkillers’ at the patients' initial visit.
No differences in post-ED disposition were found between patients with unscheduled return visits and patients who did not return (Table 3). Sixteen percent of the unscheduled return visits resulted in admission, versus 17% of the visits of patients who did not return.
Our results showed that unscheduled within-week return accounted for 5% (2,492/49,391) of our ED visits, implying an unscheduled return rate of over 200 visits a month.
Despite the Dutch health care system with universal access to primary care, our within-week unscheduled return rate (5%) was higher than in another study using a cut-off point of a week, in which 3.8% unscheduled return [] was observed. One plausible explanation of our high unscheduled return rate may be that patients not always realize that they have access to a GP 24 h a day. Furthermore, patients with chronic conditions may present to the ED despite the 24-h access to the GP.
Comparison of return visit rates among studies is complicated by the different time frames used. Some studies use 72-h return visits [,,–,,,] while others have used a 30-day delay between the two visits [,]. Applying the 72-h time frame in our results, our percentage of unscheduled return visits (2.7%) compares well with published 72-h return rates, ranging from 2.2% to 5.5% [,,–,,,]. However, our sub-analysis showed that a 72-h cut-off point would have excluded 47% of the unscheduled return visits, while risk factors were the same as those associated with unscheduled return visits within 1 week.
Some patients with an unscheduled return visit returned more than once during the week after their initial visit. They may have become ‘frequent flyers’: patients with high ED utilization, sometimes defined as patients visiting the ED seven or more times per year []. We did not follow up on our patients with unscheduled return visits, so we cannot present actual numbers on who became a frequent flyer in the 12 months after the initial visit. Frequent ED utilization, in particular by the homeless or substance abusers, seems less a problem in our ED [] than outlined in the international literature [].
When interpreting our medical complaint categorization as proxy measure for diagnosis, our results support the finding in a previous study [] that a digestive diagnosis is a risk factor for unscheduled return. Return visits related to ‘abdominal pain’ might be explained by the difficulty of diagnosing abdominal disorders, which has a wide range of possible causes []. Emergency physicians should be particularly cautious when a patient present with a ‘high risk for return’ diagnosis, such as abdominal pain, and consider a follow-up appointment.
When using the medical complaint ‘rashes’ as proxy for dermatologic condition, our study contradicts the results in the study of Pham et al. [] as ‘rashes’ was no risk factor for unscheduled return in our study. Our physicians often refer patients with rashes to the patients' GP. When these patients suffer persisting problems, they will probably return to their GP instead of to the ED.
Patients presenting with ‘chest pain’ or ‘feeling unwell’ were less likely to return unscheduled. These complaints often indicate cardiac problems. Probably these patients are either admitted at their initial visit or receive an appointment for the outpatient clinic. Parents with a ‘sick baby’ were also less likely to return. These parents are advised to go to the children's hospital in case of ongoing complaints.
In our study, over 4% of the patients lacked health insurance. Lacking health insurance was not a risk factor for unscheduled return, contradicting previous findings []. Our hospital is a regional centre for treatment of people living illegally in the Netherlands. Appointments at the outpatient clinics are arranged for anyone who needs further medical assessment after an ED visit, regardless of insurance status. Therefore, unscheduled return visits are prevented for insured and uninsured patients alike.
In previous research, conflicting findings regarding the association between triage level and unscheduled return are reported. Two studies concerning a paediatric population found that children with a high triage level were more likely to return unscheduled [,], while in a study concerning a mixed population, returning patients had low triage levels []. In our study, patients with urgent triage levels (at their initial visit) were more likely to incur an unscheduled return visit. Possibly, patients with low triage levels were advised to return to their GP in case of persisting complaints.
Urgent triage levels may reflect a sicker patient in need for continued medical care. The longer LOS of our returning patients as compared with the LOS of patients who did not return may also indicate a sicker patient. However, our post-ED disposition data showed no sign that returning patients were more seriously ill: returning patients had similar hospital admission rates as the patients who did not return. Future studies should examine outcomes of these patients in more detail.
The percentage of illness-related reasons for unscheduled return in our study (49%) compares well with the 48% to 81% in other studies [,,]. Ten percent of our unscheduled return visits were due to physician-related factors, as compared to 3% to 8% in other studies [,]. Patient-related reasons accounted for 41% of the unscheduled return visits in our study, as compared to 11% to 53% in other studies [,,]. Most patient-related returns involved patients ‘worrying about health’, indicating suitability for assessment and reassurance by the GP.
Limitations and strengths
This study conveys the experience of a single institution and may have limited generalizability because of the social and cultural characteristics of our population and differences in health care delivery in our country. Our findings should be validated in other EDs.
Second, we used routinely collected data. This had the advantage of examining data of large numbers of patients. The disadvantage was that we were not able to account for socio-economic factors that are known to influence the probability of ED return visits, such as marital status, socio-economic status (SES), alcohol consumption and homelessness [,,]. The weak discriminative capacity of our identified predictors for unscheduled return indicates that a future prospective study is needed to include these additional risk factors. However, such a study design should take into account the reliability issues associated with measuring SES and alcohol consumption in ED patients.
The categorization of the reasons of unscheduled return based on retrospective patient documentation was a limitation of our study, which we tried to limit by using explicit criteria for the categories based on previous research [,,].
Another limitation is that not only patients who ‘lack health insurance’ or ‘lack a GP’ are registered as such. When it is unclear whether the patient has a health insurance and/or when the patient does not know the name of his/her GP, the patients are also registered as ‘lacking health insurance’ and/or ‘lacking a GP’. Therefore, patients might have been wrongly classified to the ‘lack health insurance’ or ‘lack GP’ group, thereby diluting a possible association between health insurance/GP-status and unscheduled return.
The strengths of this study include its complete data collection. The 11 patient records that were unavailable concerned only one patient, so selection bias was negligible. However, patients may have visited other hospital EDs after their visit to the study setting which may have led to some cases not identified.
Unscheduled within-week return accounted for 5% of the ED visits. Most associated factors (an urgent triage level, arriving during the night, suffering from a wound or local infection, or a urinary problem) differ from previous studies, except for abdominal complaints, which was found to be a risk factor in many other studies. The reasons for ED return were comparable with studies from other countries: most often illness-related, then patient-related and least often physician-related reasons (e.g. ongoing complaints because a foreign body left behind in a wound or lack of a prescription of painkillers) prompted the patient back to the ED. Short-term follow-up at the outpatient clinic or GP for patients with urgent triage levels and suffering from wounds or local infections, abdominal pain or urinary problem might prevent unscheduled return.
- AUC ROC:
area under the receiver operating curve
length of stay
left the emergency department without being seen by a physician
Nunez S, Hexdall A, Aguirre-Jaime A: Unscheduled returns to the emergency department: an outcome of medical errors? Qual Saf Health Care 2006, 15: 102–108. 10.1136/qshc.2005.016618
Foran A, Wuerth-Sarvis B, Milne WK: Bounce-back visits in a rural emergency department. Can J Rural Med 2010, 15: 108–112.
Hu KW, Lu YH, Lin HJ, Guo HR, Foo NP: Unscheduled return visits with and without admission post emergency department discharge. J Emerg Med 2012, 43: 1110–1118. 10.1016/j.jemermed.2012.01.062
Khan NU, Razzak JA, Saleem AF, Khan UR, Mir MU, Aashiq B: Unplanned return visit to emergency department: a descriptive study from a tertiary care hospital in a low-income country. Eur J Emerg Med 2011, 18: 276–278. 10.1097/MEJ.0b013e3283449100
Pham JC, Trueger NS, Hilton J, Khare RK, Smith JP, Bernstein SL: Interventions to improve patient-centered care during times of emergency department crowding. Acad Emerg Med 2011, 18: 1289–1294. 10.1111/j.1553-2712.2011.01224.x
Pierce JM, Kellerman AL, Oster C: “Bounces”: an analysis of short-term return visits to a public hospital emergency department. Ann Emerg Med 1990, 19: 752–757. 10.1016/S0196-0644(05)81698-1
Robinson K, Lam B: Early emergency department representations. Emerg Med Australas 2013, 25: 140–146. 10.1111/1742-6723.12048
Sauvin G, Freund Y, Saidi K, Riou B, Hausfater P: Unscheduled return visits to the emergency department: consequences for triage. Acad Emerg Med 2013, 20: 33–39. 10.1111/acem.12052
Wu CL, Wang FT, Chiang YC, Chiu YF, Lin TG, Fu LF, Tsai TL: Unplanned emergency department revisits within 72 hours to a secondary teaching referral hospital in Taiwan. J Emerg Med 2010, 38: 512–517. 10.1016/j.jemermed.2008.03.039
White D, Kaplan L, Eddy L: Characteristics of patients who return to the emergency department within 72 hours in one community hospital. Adv Emerg Nurs J 2011, 33: 344–353. 10.1097/TME.0b013e31823438d6
Pham JC, Kirsch TD, Hill PM, DeRuggerio K, Hoffmann B: Seventy-two-hour returns may not be a good indicator of safety in the emergency department: a national study. Acad Emerg Med 2011, 18: 390–397. 10.1111/j.1553-2712.2011.01042.x
Riggs JE, Davis SM, Hobbs GR, Paulson DJ, Chinnis AS, Heilman PL: Association between early returns and frequent ED visits at a rural academic medical center. Am J Emerg Med 2003, 21: 30–31. 10.1053/ajem.2003.50017
Safwenberg U, Terent A, Lind L: Increased long-term mortality in patients with repeated visits to the emergency department. Eur J Emerg Med 2010, 17: 274–279. 10.1097/MEJ.0b013e3283104106
Goldman RD, Ong M, Macpherson A: Unscheduled return visits to the pediatric emergency department-one-year experience. Pediatr Emerg Care 2006, 22: 545–549. 10.1097/01.pec.0000230553.01917.05
Gordon JA, An LC, Hayward RA, Williams BC: Initial emergency department diagnosis and return visits: risk versus perception. Ann Emerg Med 1998, 32: 569–573. 10.1016/S0196-0644(98)70034-4
Jacobstein CR, Alessandrini EA, Lavelle JM, Shaw KN: Unscheduled revisits to a pediatric emergency department: risk factors for children with fever or infection-related complaints. Pediatr Emerg Care 2005, 21: 816–821. 10.1097/01.pec.0000190228.97362.30
LaMantia MA, Platts-Mills TF, Biese K, Khandelwal C, Forbach C, Cairns CB, Busby-Whitehead J, Kizer JS: Predicting hospital admission and returns to the emergency department for elderly patients. Acad Emerg Med 2010, 17: 252–259. 10.1111/j.1553-2712.2009.00675.x
McCusker J, Cardin S, Bellavance F, Belzile E: Return to the emergency department among elders: patterns and predictors. Acad Emerg Med 2000, 7: 249–259. 10.1111/j.1553-2712.2000.tb01070.x
Zimmerman DR, McCarten-Gibbs KA, DeNoble DH, Borger C, Fleming J, Hsieh M, Langer JC, Breckenridge MB: Repeat pediatric visits to a general emergency department. Ann Emerg Med 1996, 28: 467–473. 10.1016/S0196-0644(96)70107-5
Newton AS, Ali S, Johnson DW, Haines C, Rosychuk RJ, Keaschuk RA, Jacobs P, Cappelli M, Klassen TP: Who comes back? Characteristics and predictors of return to emergency department services for pediatric mental health care. Acad Emerg Med 2010, 17: 177–186. 10.1111/j.1553-2712.2009.00633.x
Kuan WS, Mahadevan M: Emergency unscheduled returns: can we do better? Singapore Med J 2009, 50: 1068–1071.
Baer RB, Pasternack JS, Zwemer FL Jr: Recently discharged inpatients as a source of emergency department overcrowding. Acad Emerg Med 2001, 8: 1091–1094. 10.1111/j.1553-2712.2001.tb01121.x
Keith KD, Bocka JJ, Kobernick MS, Krome RL, Ross MA: Emergency department revisits. Ann Emerg Med 1989, 18: 964–968. 10.1016/S0196-0644(89)80461-5
Hosmer D, Lemeshow S: Applied Logistic Regression. John Wiley & Sons, Hoboken, New Jersey; 2000.
Hu SC: Analysis of patient revisits to the emergency department. Am J Emerg Med 1992, 10: 366–370. 10.1016/0735-6757(92)90022-P
Geirsson OP, Gunnarsdottir OS, Baldursson J, Hrafnkelsson B, Rafnsson V: Risk of repeat visits, hospitalisation and death after uncompleted and completed visits to the emergency department: a prospective observation study. Emerg Med J 2013, 30: 662–668. 10.1136/emermed-2012-201129
Madsen TE, Bennett A, Groke S, Zink A, McCowan C, Hernandez A, Knapp S, Byreddy D, Mattsson S, Quick N: Emergency department patients with psychiatric complaints return at higher rates than controls. West J Emerg Med 2009, 10: 268–272.
Doupe MB, Palatnick W, Day S, Chateau D, Soodeen RA, Burchill C, Derksen S: Frequent users of emergency departments: developing standard definitions and defining prominent risk factors. Ann Emerg Med 2012, 60: 24–32. 10.1016/j.annemergmed.2011.11.036
van der Linden MC, van den Brand CL, van der Linden N, Rambach AH, Brumsen C: Rate, characteristics, and factors associated with high emergency department utilization. Int J Emerg Med 2014, 7: 9. 10.1186/1865-1380-7-9
LaCalle E, Rabin E: Frequent users of emergency departments: the myths, the data, and the policy implications. Ann Emerg Med 2010, 56: 42–48. 10.1016/j.annemergmed.2010.01.032
Moore G, Gerdtz M, Manias E, Hepworth G, Dent A: Socio-demographic and clinical characteristics of re-presentation to an Australian inner-city emergency department: implications for service delivery. BMC Public Health 2007, 7: 320. 10.1186/1471-2458-7-320
The authors declare that they have no competing interests.
MCL had full access to all of the data in the study and takes full responsibility for the integrity of the data and the accuracy of the data analysis. MCL, RL, NL and ERJTD conceived and designed the study. MCL, NL and ERJTD acquired the data. MCL, RL, NL and CL analysed and interpreted the data. MCL and RL drafted the manuscript. RL, RH, CL, SJR and JCG critically revised the manuscript for important intellectual content. All authors read and approved the final manuscript.
About this article
Cite this article
van der Linden, M.C., Lindeboom, R., de Haan, R. et al. Unscheduled return visits to a Dutch inner-city emergency department. Int J Emerg Med 7, 23 (2014). https://doi.org/10.1186/s12245-014-0023-6