The influence of excluding patients with bystander return of spontaneous circulation in the current OHCA database
International Journal of Emergency Medicine volume 11, Article number: 37 (2018)
The effect of bystander interventions has been extensively evaluated by cerebral function after 1 month post-resuscitation. However, patients who received bystander cardiopulmonary resuscitation (BCPR) and achieved the return of spontaneous circulation (ROSC) before the arrival of the emergency medical system (EMS) are routinely defined with an unknown electrocardiogram (ECG) and are usually excluded before analysis. The aim is to determine the influence of excluding patients with unknown first monitored rhythm, which includes cases of bystander ROSC, from the out-of-hospital cardiac arrest (OHCA) database.
This nationwide population-based observational study was conducted in Japan using Utstein data from 2011 to 2014. In total, 91,995 patients with bystander-witnessed cardiogenic OHCA received resuscitation attempts in the pre-hospital setting. These patients were divided into three groups by the first monitored rhythm upon EMS arrival. We analysed the differences of datasets that included and excluded the unknown group and determined the effect on outcomes by multivariate logistic regression and odds ratios (ORs) with 95% confidence intervals (95% CIs).
When the unknown group was excluded from the data, the adjusted odds ratio (AOR) of cardiopulmonary resuscitation (CPR) to favourable cerebral performance category (CPC) 1 or 2 was decreased (conventional CPR: AOR, 1.90 to 1.58; chest-compression-only CPR: AOR, 2.08 to 1.69) compared to the unknown group’s inclusion. Conversely, the AOR of public-access defibrillation (PAD) was increased (AOR, 4.51 to 6.13).
The exclusion of unknown ECGs from a dataset may lose ROSC patients by bystander CPR, causing selection bias to affect outcomes.
The increasing number of out-of-hospital cardiac arrest (OHCA) patients has become a global public health concern [1,2,3,4]. Several previous studies have shown that the two most important factors for patients with favourable neurological outcomes after OHCA were bystander cardiopulmonary resuscitation (BCPR) and public-access defibrillation (PAD) [2,3,4,5,6].
The effect of bystander interventions has been evaluated by cerebral function, such as cerebral performance category (CPC). However, the results of this evaluation depend on first monitored rhythms  categorised as follows: a shockable group that includes ventricular fibrillation (VF) and pulseless ventricular tachycardia (pVT); a non-shockable group that includes pulseless electrical activity (PEA) and asystole; and an unknown group that includes other conditions. The unknown group includes patients who received BCPR and achieved the return of spontaneous circulation (ROSC) before the arrival of emergency medical system (EMS) and are usually excluded before analysis.
Although Perkins et al. reported on new concepts of the first monitored rhythm and status of bystander interventions in greater detail in 2015. These have not been reflected internationally thus far . Because a method for the handling of the unknown group has yet to be established, recent studies have included unknowns, excluded them or did not specify how they were managed [3,4,5,6,7, 9]. Furthermore, the potential bias of the unknown group has not been discussed. Therefore, we hypothesised that the exclusion of patients with unknown waveforms at EMS arrival resulted in a smaller effect of BCPR and PAD on favourable cerebral function than the inclusion of this group. This smaller effect would underestimate the effect of bystander resuscitation on patient outcomes.
The purpose of this study was to evaluate influence of excluding patients with bystander ROSC in the current OHCA Database according to Utstein-style guideline using multivariate logistic regression and estimating odds ratios (ORs) with 95% confidence intervals (CIs).
This population-based observational study was conducted using nationwide OHCA data collected in Japan from 2011 to 2014. The Utstein database was provided by Japan’s Fire and Disaster Management Agency (FDMA). The Institutional Review Board at Kokushikan University approved this study.
Japan encompasses approximately 378,000 km2 of land, and populated areas comprise 121,000 km2. According to the Statistics Bureau of the Ministry of Internal Affairs and Communications, the population of Japan in 2014 was approximately 127 million.
The primary EMS system in Japan is provided by fire departments (FDs), and there were 752 FDs in 2014. All FDs are overseen by the FDMA. Almost every FD ambulance includes at least one emergency life-saving technician (ELST) who is qualified to provide advanced airway management, endotracheal intubation, intravenous lines, adrenaline administration, and defibrillation with a semi-automated defibrillator. EMS responders follow protocols provided by medical control councils for each region. These protocols are based on guidelines issued by the Japan Resuscitation Council.
We sampled patients with presumed cardiogenic OHCA data registered from 2011 to 2014 according to Utstein-style guidelines in Japan. The exclusion criteria for this study were as follows: unwitnessed by laypeople, witnessed by EMS or fire department personnel, no CPR attempted. (1) Patients who are not ROSC on-scene without performing EMS resuscitation regardless of performing bystander CPR or not in the unknown ECG group. (2) Patients who are ROSC on-scene without received resuscitation attempt by both bystander and EMS in the unknown ECG group. (3) Although cardiac arrest waveform [VF, VT, PEA, asystole] is indicated at EMS arrival, resuscitation attempt is not performed by EMS on-scene, unknown status of bystander CPR or no description of the time of bystander CPR initiation, only rescue breathing CPR, only PAD implementation, response interval negative value, response interval > 23 min (99 percentile) and EMS contact to hospital arrival time > 53 min (99 percentile). A detailed inclusion/exclusion criterion is shown in Fig. 1.
All eligible patients were divided into three groups based on first monitored rhythm. The shockable group included patients with VF or pulseless VT. The non-shockable group included patients with PEA/asystole. Patients that were not applicable for either group were allocated into the unknown group.
Data collection and quality control
In Japan, all OHCA data are prospectively collected by ELSTs or EMS personnel. All records are managed by the FDMA, and the results are published each year. The data are available as a part of the national OHCA registry; however, one must apply to the FDMA in advance to obtain the information. Kokushikan University applied and was granted these data. The records included the following data according to Utstein-style guidelines: prefectures, years, sex, age, bystander-witnessed status, types of bystander(s), bystander CPR, rescue breathing, use of an automated external defibrillator, first monitored rhythm, dispatcher assist, time course of resuscitation (e.g. time of patient collapse, receipt of Japanese emergency call for dispatch a fire engine or an ambulance (call 119), EMS contact with patients, EMS arrival on the scene, and hospital arrival), cause of cardiac arrest, return of spontaneous circulation in the pre-hospital setting, 1-month survival and neurological outcome 1 month after the event. The CPC was diagnosed by physicians. After 1 month, the outcome was followed up and described in all records by EMS personnel.
The act of performing chest compressions with rescue breathing by laypeople was called conventional CPR, and the use of only chest compressions was called chest-compression-only CPR. The response interval was defined as the time from the call to emergency services (119) to patient contact by EMS personnel. When laypeople delivered shocks using AED, the patient and their first recorded rhythms were regarded as the shockable group.
The Glasgow-Pittsburgh CPC scoring was defined as follows: category 1, good cerebral performance; category 2, moderate cerebral disability; category 3, severe cerebral disability; category 4, a coma or vegetative state; and category 5, death. Survival at 1 month post-resuscitation with a favourable neurologic outcome was defined as a CPC score of 1 or 2 [8, 10].
The primary outcome of our study was CPC 1–2 at 1 month post-resuscitation. Field ROSC was considered the secondary outcome of this study.
To compare the background factors, we divided the patients into three groups based on the first monitored rhythm. The proportions of qualitative variables were described as the number (%). Non-parametric continuous variables were calculated with the medians and interquartile ranges (IQR).
The differences of datasets that included and excluded the unknown group
We created two datasets that included and excluded the unknown group to assess differences in the effects of BCPR and PAD. To analyse the data objectively, we used multivariable logistic regression and adjusted for age, sex, types of bystander(s) (family, or others), types of CPR (none, conventional CPR, and chest-compression-only CPR), PAD, dispatcher assistance and response interval. Before calculating the adjusted ORs (AOR) with 95% CIs, crude ORs (COR) with 95% CIs were also estimated. In the logistic regression analysis, we confirmed that the continuous variable maintained the linearity for the outcomes.
All statistical analyses were performed using EZR version 2.3–1 (Saitama Medical Centre, Jichi Medical University, Saitama, Japan), a graphical user interface for R (R Foundation for Statistical Computing, Vienna, Austria) .
Figure 1 shows the patient selection process of the study. From 2011 to 2014, we sampled 296,879 patients with presumed cardiogenic OHCA in the database. A total of 91,995 patients were eligible for this study. The patients were divided into three groups based on first monitored rhythm: the shockable group (n = 20,673), the non-shockable group (n = 68,696), and the unknown group (n = 2626).
Table 1 shows the patient characteristics by group, as classified using first monitored rhythm. The median age of study patients was 79 years (IQR, 67–86), and the AED usage rate was 3.5% (3210 patients). Chest-compression-only CPR was the most common bystander intervention. More patients in the unknown group had favourable outcomes (39.2%, 1030 patients) than those in the shockable group (24.2%, 5003) and non-shockable group (1.3%, 899).
The difference between datasets that included and excluded the unknown group
Table 2 compares the outcomes of a dataset that included the unknown group with one that excluded this group. The outcomes of patients with non-attempted BCPR are not included in this table. When the unknown group was excluded from the dataset, the proportion of patients with conventional CPR to CPC 1–2 is almost the same (inclusion 16.3%, 1127 patients; exclusion 16.2%, 958 patients). However, exclusion of this group resulted in 2.5% less patients with chest-compression-only CPR (inclusion 54.0%, 3742 patients; exclusion 51.5%, 3038 patients) and 3.2% more patients with PAD to CPC (inclusion 18.6%, 1286 patients; exclusion 21.8%, 1286 patients).
Table 3 shows the presumed effects of bystander interventions on ROSC and CPC 1–2 using multivariable analysis. In the dataset that included the unknown group, the AORs for CPC 1–2 were 1.90 for conventional CPR (95% CI, 1.73–2.08), 2.08 for chest-compression-only CPR (95% CI, 1.95–2.22) and 4.51 for PAD (95% CI, 4.12–4.94). In the dataset that excluded the unknown group, the AORs for CPC 1–2 were 1.58 for conventional CPR (95% CI, 1.43–1.75), 1.69 for chest-compression-only CPR (95% CI, 1.58–1.82) and 6.13 for PAD (95% CI, 5.57–6.74).
In the group that included the unknown group, the AORs for ROSC were 1.49 for conventional CPR (95% CI, 1.40–1.58), 1.42 for chest-compression-only CPR (95% CI, 1.36–1.48) and 4.06 for PAD (95% CI, 3.75–4.39). In the group that excluded the unknown group, the AORs for ROSC were 1.21 for conventional CPR (95% CI, 1.13–1.30), 1.19 for chest-compression-only CPR (95% CI, 1.14–1.25) and 5.24 for PAD (95% CI, 4.83–5.68).
Using the Utstein database, this nationwide population-based observational study found that unknown first monitored rhythms are biased to outcomes. When the unknown group was excluded from the dataset, the effect of CPR(s) on favourable CPC decreased because of missing bystander ROSC. By excluding unknown rhythms, the effect of resuscitation by bystanders was underestimated. In addition, when this group was excluded, the effect of PAD on favourable CPC increased.
Since the American Heart Association (AHA)  released Guidelines 2000 for Cardiopulmonary Resuscitation, the dissemination of BCPR and PAD has rapidly increased internationally, and many studies related to bystander interventions have been published. In Japan, the effect of PAD has been evaluated since the use of AED by laypeople was permitted in 2004. Nakahara et al. reported that bystander interventions increased patients with favourable neurological outcomes and demonstrated that the implementation of BCPR and the use of AED increased . In addition, Kitamura et al. reported that AED use for VF patients by laypeople was associated with an increased number of survivors with favourable neurological outcomes in Japan [3, 4].
In these studies, and several others, the method of handling patients with unknown first monitored rhythm was separated into two patterns. Several studies excluded or obscured how these unknown data were managed because of undocumented details [3,4,5, 7, 13,14,15]. Other studies included this data [2, 6, 9].
Cummins et al. posited that waveforms other than VF, pulseless VT, PEA, and asystole included the following characteristics: (1) some electrical activity was observed in a cardiac arrest patient; (2) ventricular escape complexes represented the last electrical activity; and (3) electro-mechanical dissociation, which is currently considered PEA [10, 16]. However, unknown ECG was not completely defined.
In 2015, Perkins et al. reported on new concepts of first monitored rhythms, which included VF/pVT, PEA/asystole, bradycardia, AED non-shockable, AED shockable and not-recorded/unknown . Globally, these categories are not presently in widespread use. Therefore, the unknown group still has extensive variation, which makes international comparisons difficult. Even in recent studies, the first monitored unknown rhythm remains ambiguous.
In this study, we found 6932 patients who had favourable outcomes, of which 14.9% had unknown first monitored rhythm in the dataset that included the unknown group. Furthermore, we confirmed that 11.4% of the unknown group achieved ROSC in the pre-hospital setting. Thus, the unknown group had a relatively greater number of patients with favourable outcomes. In addition, when we excluded the unknown group, the effect of CPR (both conventional and chest-compression-only) to favourable outcome decreased. Because the CPR implementation rate in the unknown group was the highest of the three groups and many of these patients had favourable outcomes, this result suggests that excluding the unknown group decreases the total number of CPR cases. As a result, the odds ratio of CPR for favourable CPC decreased (conventional CPR: AOR, 1.90 to 1.58; chest-compression-only CPR: AOR, 2.08 to 1.69). This result indicates that studies that exclude the unknown group miss patients who received BCPR and achieved ROSC before EMS arrival, leading to underestimated effects of resuscitation by bystander.
In the dataset that included the unknown group, 18.6% of the patients with attempted BCPR had favourable outcomes by PAD shocks. However, in the dataset that excluded the unknown group, 21.8% of patients had favourable outcomes by PAD shocks. Although this change was seemingly benign at first glance, the odds ratio of PAD for favourable CPC significantly increased after excluding the unknown group (AOR, 4.51 to 6.13). This result also suggests that the unknown group had a selection bias to the outcome.
We also carried out the subgroup study of differences of datasets that included and excluded the unknown group in order to assess the influence of the group who received BCPR without PAD and no EMS resuscitation (Table 4). We excluded these 1037 patients from unknown group. The ORs of CPR and PAD in this group became close to the ORs of excluding data set (subgroup study of conventional CPR: AOR, 1.53 to 1.58; chest-compression-only CPR: AOR, 1.67 to 1.69, PAD: 5.80 to 6.13). Therefore, we concluded that these patients had bias to the outcomes. However, since these patients may have been in cardiac arrest or no cardiac arrest and it has great influence on the outcomes, how to assess these bystander efforts should be sought and discussed. In addition, this result also addressed that other 1589 patients of unknown group could be available for OHCA analysis because they are cardiac arrest.
To accurately assess the efforts of bystander resuscitation and decrease potential bias, it is essential that future studies evaluate the quality of BCPR, verify if patients are cardiac arrest and adhere to the new guidelines. The interpretation of the unknown group may be different depending on country or region. Therefore, we recommend that studies evaluating the bystander effect clearly report the method of handling the unknown group to provide the transparency until official guidelines of each countries define the unknown first monitored rhythm. We suggest four exclusion criteria of unknown ECGs from OHCA data: (1) no ROSC without performing EMS resuscitation, or (2) ROSC without any resuscitation attempt by both bystander and EMS, or (3) rhythm available and no EMS resuscitation, or (4) ROSC by BCPR without PAD and no EMS resuscitation. These criteria must be used until the new guidelines are applied to each country.
Because of the observational study, unknown bias could have affected its results, such as patient backgrounds and in-hospital care, both of which are not included in the Japanese Utstein database. These factors may have influenced the survival outcomes. Furthermore, we were unable to obtain the actual unknown ECG data, as they were not described in the Japanese Utstein database. Therefore, it requires a further nationwide investigation for acquiring them, and we consider that it will be the next examination of this study. Defibrillation time from collapse was not considered due to the lack of data. In addition, the location of cardiac arrest was available [17,18,19], but we could not include the location where PAD was delivered. Moreover, we included the BCPR group, which may have affected outcomes because the quality of CPR was not considered. Assessing the quality of BCPR prior to EMS personnel arrival was not realisable under the present system. Finally, our results cannot be generalised to children nor non-cardiogenic or unwitnessed OHCA patients.
Studies that exclude unknown ECGs may lose patients who received BCPR that achieved field ROSC and favourable CPC, leading to selection bias in outcomes. To minimise the underestimation of the bystander effect and potential bias of unknown ECGs, future studies analysing OHCA should carefully manage and report the method of handling these missing data.
Berdowski J, Berg RA, Tijssen JG, Koster RW. Global incidences of out-of-hospital cardiac arrest and survival rates: systematic review of 67 prospective studies. Resuscitation. 2010;81(11):1479–87.
Nakahara S, Tomio J, Ichikawa M, Nakamura F, Nishida M, Takahashi H, Morimura N, et al. Association of bystander interventions with neurologically intact survival among patients with bystander-witnessed out-of-hospital cardiac arrest in Japan. JAMA. 2015;314(3):247–54.
Kitamura T, Iwami T, Kawamura T, Nagao K, Tanaka H, Hiraide A. Nationwide public-access defibrillation in Japan. N Engl J Med. 2010;362:994–1004.
Kitamura T, Kiyohara K, Sakai T, Matsuyama T, Hatakeyama T, Shimamoto T, et al. Public-access defibrillation and out-of-hospital cardiac arrest in Japan. N Engl J Med. 2016;375:1649–59.
Wissenberg M, Lippert FK, Folke F, Weeke P, Hansen CM, Christensen EF, et al. Association of national initiatives to improve cardiac arrest management with rates of bystander intervention and patient survival after out-of-hospital cardiac arrest. JAMA. 2013;310(13):1377–84.
McNally B, Robb R, Mehta M, Vellano K, Valderrama AL, Yoon PW, et al. Out-of-hospital cardiac arrest surveillance --- cardiac arrest registry to enhance survival (CARES), United States, October 1, 2005--December 31, 2010. MMWR Surveill Summ. 2011;60(8):1–19.
Hara M, Hayashi K, Hikoso S, Sakata Y, Kitamura T. Different impacts of time from collapse to first cardiopulmonary resuscitation on outcomes after witnessed out-of-hospital cardiac arrest in adults. Circ Cardiovasc Qual Outcomes. 2015;8(3):277–84.
Perkins GD, Jacobs IG, Nadkarni VM, Berg RA, Bhanji F, Biarent D, et al. Cardiac arrest and cardiopulmonary resuscitation outcome reports: update of the Utstein Resuscitation Registry Templates for Out-of-Hospital Cardiac Arrest: a statement for healthcare professionals from a task force of the International Liaison Committee on Resuscitation (American Heart Association, European Resuscitation Council, Australian and New Zealand Council on Resuscitation, Heart and Stroke Foundation of Canada, InterAmerican Heart Foundation, Resuscitation Council of Southern Africa, Resuscitation Council of Asia); and the American Heart Association Emergency Cardiovascular Care Committee and the Council on Cardiopulmonary, Critical Care, Perioperative and Resuscitation. Circulation. 2015;132(13):1286–300. https://doi.org/10.1161/CIR.0000000000000144.
Weisfeldt ML, Sitlani CM, Ornato JP, Rea T, Aufderheide TP, Davis D, et al. Survival after application of automatic external defibrillators before arrival of the emergency medical system; evaluation in the resuscitation outcomes consortium population of 21 million. J Am Coll Cardiol. 2010;55(16):1713–20.
Cummins RO, Chamberlain DA, Abramson NS, Allen M, Baskett PJ, Becker L, et al. Recommended guidelines for uniform reporting of data from out-of-hospital cardiac arrest: the Utstein style. A statement for health professionals from a task force of the American Heart Association, the European Resuscitation Council, the Heart and Stroke Foundation of Canada, and the Australian Resuscitation Council. Circulation. 1991;84(2):960–75.
Kanda Y. Investigation of the freely-available easy-to-use software “EZR” (Easy R) for medical statistics. Bone Marrow Transplant 2013:48,452–458. Advance online publication 3 December 2012; doi: https://doi.org/10.1038/bmt.2012.244.
Guidelines 2000 for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Part 4: the automated external defibrillator: key link in the chain of survival. The American Heart Association in collaboration with the International Liaison Committee on Resuscitation. Circulation. 2000;102:I60–76.
Iwami T, Kitamura T, Kawamura T, Mitamura H, Nagao K, Takayama M, et al. Chest compression-only cardiopulmonary resuscitation for out-of-hospital cardiac arrest with public-access defibrillation: a nationwide cohort study. Circulation. 2012;126(24):2844–51.
Iwami T, Kitamura T, Kiyohara K, Kawamura T. Dissemination of chest compression-only cardiopulmonary resuscitation and survival after out-of-hospital cardiac arrest. Circulation. 2015;132(5):415–22.
Kitamura T, Iwami T, Kawamura T, Nitta M, Nagao K, Nonogi H, et al. Japanese Circulation Society resuscitation science study group. Nationwide improvements in survival from out-of-hospital cardiac arrest in Japan. Circulation. 2012;126:2834–43.
Ewy GA. Defining electromechanical dissociation. Ann Emerg Med. 1984;13(9 Pt 2):830–2.
Sasaki M, Iwami T, Kitamura T, Nomoto S, Nishiyama C, Sakai T, et al. Incidence and outcome of out-of-hospital cardiac arrest with public-access defibrillation. – a descriptive epidemiological study in a large urban community. Circ J. 2011;75(12):2821–6.
Folke F, Lippert FK, Nielsen SL, Gislason GH, Hansen ML, Schramm TK, et al. Location of cardiac arrest in a city center: strategic placement of automated external defibrillators in public locations. Circulation. 2009;120:510–7.
Murakami Y, Iwami T, Kitamura T, Nishiyama C, Nishiuchi T, Hayashi Y, et al. Outcomes of out-of-hospital cardiac arrest by public location in the public-access defibrillation era. J Am Heart Assoc. 2014;3(2):e000533.
We sincerely thank the members of the Graduate School of Emergency Medical System at Kokushikan University. We also thank all fire department personnel for their consistent efforts.
Availability of data and materials
Please contact author for data requests.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Otani, H., Sagisaka, R., Tanaka, H. et al. The influence of excluding patients with bystander return of spontaneous circulation in the current OHCA database. Int J Emerg Med 11, 37 (2018). https://doi.org/10.1186/s12245-018-0197-4