Screening Tool Risk Score Assessment in the Emergency Department for Geriatric (S-TRIAGE) in 28-day mortality

Abstract

Background

The number of older adults with a high risk of frailty and severe illness continues to increase. Moreover, physiological change and multiple comorbidities are challenging to triage in geriatrics. Therefore, we aimed to evaluate variables to predict 28-day mortality and develop a screening tool to predict mortality and lifesaving intervention among geriatric patients in the emergency department (ED).

Methods

This study was a retrospective, single-center, observational study at the ED of Ramathibodi Hospital, Bangkok. Patients aged ≥ 65 years who visited the ED between January 2018 and December 2019 were enrolled. In the development cohort, univariable logistic regression was used to identify predictors of 28-day mortality in older patients. A predictive model for mortality and the need for lifesaving intervention was developed by multivariable logistic regression. In addition, the score was validated with internal validation and compared between development and validation set by chi-square.

Results

We enrolled 1393 patients. In the development cohort, among these 1002 patients, 103 (10.3%) of whom died within 28 days. Malignancy, shock index (SI), systolic blood pressure (SBP) < 100 mmHg, and altered mentation were independent risk factors of 28-day mortality. We developed new screening tools named the S-TRIAGE score, which has the respiratory rate (< 11, > 22 breaths/min), the ratio of pulse oximetric saturation to the fraction of inspired oxygen (< 420, 420–450), SI (> 1, 0.6–0.99), SBP < 100 mmHg, body temperature (< 36, > 37.5 °C), and mental change. The area under a receiver operating characteristic (ROC) curve of the S-TRIAGE score in the validation cohort was 0.826 [95% confidence interval (95%CI) 0.773–0.879] in predicting mortality and lifesaving intervention, and the clinical score classified patients into five groups.

Conclusion

This study showed malignancy, hypotension, increased SI, and mental status change were predictive factors for 28-day mortality in older adults in the ED. The screening tool risk score for geriatrics used in this study is potentially a good predictor of mortality and lifesaving intervention in high-risk older patients in the ED.

Introduction

As the world’s older population continues to grow, the number of emergency visits to hospitals by older adults is also increasing, with consequent more frequent use of emergency services and a greater level of urgency compared with younger counterparts [1]. Furthermore, with multiple comorbidities, use of polypharmacy, and potentially severe illness, older patients are at higher risk of adverse outcomes, extended hospitalization, readmission to the emergency department (ED), and mortality [2]. These situations significantly affect ED capacity and capability, leading to an urgent demand for appropriate screening tools for geriatrics-related emergency services [3].

Older patients may delay proper assessment and special care needs because they have unspecified clinical presentation. In previous studies, many triage systems demonstrated mixed performance in predicting adverse outcomes in older patients [4,5,6,7]. For example, the Emergency Severity Index (ESI), widely used in the ED, divides patients into five classification levels [8]. However, recent studies reported that ESI had poor accuracy in predicting patients who need immediate lifesaving intervention, with most older patients in the ED running the risk of under-triage [5, 6]. Several research groups developed geriatric-specific triage tools such as the Identification of Seniors at Risk and the Triage Risk Screening Tool to identify at-risk patients [9, 10]. However, the history taking of older patients might be complicated by several conditions [3]. Most studies showed these instruments to be unreliable as a single predictor of adverse outcomes [11, 12].

The National Early Warning Score (NEWS) is a simple tool calculated from vital sign parameters. The score was developed to predict clinical deterioration in the ward and has recently been used in the ED to predict admission and mortality [13]. Owing to physiological changes in older people, studies reported only low to moderate effectiveness of NEWS in predicting mortality in older patients [14, 15].

This study aimed to evaluate the predictors of 28-day mortality in older patients and developed a new risk-scoring system for geriatric triage in the ED that is practical and straightforward to use.

Methods

Study setting and population

A single-center, retrospective observational study was conducted at Ramathibodi Hospital, a tertiary care and university hospital in Bangkok. This study was approved by the ethics committee of Ramathibodi Hospital, Mahidol University (COA. MURA2020/1791). In addition, the Ethics Committee waived each patient’s need for informed consent.

Patients aged 65 years and older who visited the ED at Ramathibodi Hospital between January 1, 2018, and December 31, 2019, were included in this study. Patients who were in cardiac arrest at the time of arrival, trauma patients, patients who denied resuscitation, patients who transferred from the ED, and patients with missing data were excluded from the analysis. Data between January 2018 and June 2019 were used to find factors associated with 28-day mortality and construct the prediction model for mortality or receiving lifesaving interventions. Data from July 2019 was used for validating the predictive model.

Measurement

We collected the data from the Ramathibodi Hospital database via electronic medical records. The study variables were recorded for all eligible patients, including the baseline characteristics and potential clinical risk factors for mortality. Clinical factors included age, sex, comorbidities, ESI triage, vital signs at triage (heart rate [HR], systolic blood pressure [SBP], respiratory rate [RR], oxygen saturation [SpO₂], and body temperature [BT]), the initial fraction of inspired oxygen (FiO₂) at triage, NEWS at ED arrival, mental change, and diagnosis.

The primary outcome aimed to find variables related to 28-day mortality. The secondary outcome was to develop a screening risk assessment score for 28-day mortality and lifesaving intervention in the ED for geriatric patients.

Definitions

The lifesaving intervention was defined as using an invasive mechanical ventilator, noninvasive positive pressure ventilation, and the use of vasopressors in the ED. The NEWS consists of seven physiological variables: SBP, HR, RR, BT, SpO₂, use of supplemental oxygen, and level of consciousness. Furthermore, NEWS has been categorized into four levels, and high risk is a key threshold to emergency response (Additional file 1). The ESI is a five-level ED triage algorithm based on the acuity of patients’ problems and the number of resources used. ESI level-1 indicates a patient who needs immediate lifesaving intervention. ESI level-2 is defined by a patient who has high-risk conditions of deterioration. ESI level-3 indicates a patient with an urgent condition who must use more than one resource in the ED. ESI level-4 indicates who has non-urgent conditions and needs to use only one resource in ED. Finally, ESI level-5 indicates who has non-urgent conditions and does not require using the resource in ED (Additional file 2).

Sample size calculation

We calculated the sample size required to analyze predictor risks for 28-day mortality. Our previous hospital data on 28-day mortality in older patients who visited the ED showed 28-day mortality in 15 (4.03%) of 372 patients. Our calculation revealed that 1000 patients were required to provide an adequate sample size for the primary outcome in this study (95% confidence level, 5% alpha error).

For secondary outcome, the prevalence of lifesaving intervention in geriatrics was 5.2% [16]. We assume that the new model has eight candidate factors and approximately 25% of the variability of the Cox-Snell R squared statistic (R2cs). The sample size for the new predictive model was calculated by PMSAMPSIZE command [17] and needed 860 and 46 events for the development cohort.

Data analyses

Building the prediction model

All statistical analyses were performed using Stata version 16.1 (StataCorp, College Station, TX, USA). Frequencies or percentages described the categorical variables and mean, and standard deviation (SD) or median and interquartile ranges (IQR) were used to describe continuous variables, as appropriate. Exploratory analysis was done for all potential predictors of 28-day mortality using univariable logistic regression. Odds ratio (OR) with a P value was reported separately for each predictor variable. Then, multivariable logistic regression with stepwise model analysis was performed to identify independent predictors of 28-day mortality. Predictor variables with a P value of > 0.1 were sequentially eliminated from a logistic regression model.

The measure of each variable’s performance of 28-day mortality and lifesaving intervention was reported as the area under the receiver operating characteristic curve (AUROC) with a 95% confidence interval (CI). Predictors in the new model were selected by the highest AUROC, and multicollinearity was checked by the variance inflation threshold in the new model. Each final predictor was assigned scores based on each item’s logistic regression coefficient. Finally, the scores were calculated to generate the lifesaving intervention and mortality prediction score, referred to as the “Screening Tool Risk Score Assessment in the Emergency Department for Geriatric (S-TRIAGE)” in this article.

Validation of the prediction score

The predictive model was evaluated for its prognostic performance in terms of discrimination and calibration. A measure of discrimination was reported as AUROC. A measure of calibration was reported as Hosmer–Lemeshow goodness of fit statistics. The cutoff prediction scores for 28-day mortality and requiring lifesaving intervention were determined using sensitivity, specificity, and predictive probability. A calibration plot comparing score predicted risk versus observed risk was presented with 1000 replication bootstrapping. The predictive score was validated with internal validation and compared with the development set by chi-square. A P value of < 0.05 was considered to indicate statistical significance.

Results

During the study period, 1580 patients were eligible for the inclusion criteria, 187 of whom were excluded by meeting the exclusion criteria (2 patients with cardiac arrest, 59 trauma patients, 70 patients were transferred to other hospitals, 54 patients did not resuscitate, 2 patients with incomplete data), leaving 1393 patients for analysis. In the development cohort, among these 1002 patients, 103 (10.3%) died within 28 days after visiting the ED. Univariable analysis showed male, malignancy, sepsis, SBP, RR, HR, SpO₂, SI, the ratio of pulse oximetric saturation to the fraction of inspired oxygen (SF ratio), and mental change were significant independent factors in patients who died within 28 days (Table 1). Under a multivariable analysis, the remaining potential factors that significantly increased mortality were: malignancy (adjusted odds ratio [aOR] = 2.50, 95% CI = 1.55–4.03, P =  < 0.001), SBP < 100 mmHg (aOR = 2.27, 95% CI = 1.02–5.05, P = 0.045), SI (aOR = 2.26, 95% CI = 1.04–1.26, P = 0.007), and mental change (aOR = 8.07, 95% CI = 4.25–15.33, P =  < 0.001) (Table 2).

Table 1 Baseline characteristics and univariable logistic regression of factors associated with 28-day mortality in older patients

Table 2 Multivariable logistic regression by stepwise model of factors associated with 28-day mortality in older patients

The general characteristics of the study population between the development and validation cohort were summarized in Table 3. Furthermore, the performance of each variable to predict mortality and lifesaving intervention in the development cohort was shown in Table 4, and the six highest AUROC predictors were selected to develop the new model.

Table 3 Baseline characteristics between the development cohort and validation cohort

Table 4 Performance of variables for predicting mortality and intervention in older patients in development cohort (N = 1002)

The item score was developed by significant vital signs with the RR (< 11, > 22 breaths/min), SF ratio (≤ 420, 420–450), SI (0.6–0.99, ≥ 1), SBP (< 100 mmHg), BT (< 36 or > 37.5 °C), altered mentation and the score of each predictive factor was shown in Table 5. The prediction score was named “Screening Tool Risk Score Assessment in the Emergency Department for Geriatric (S-TRIAGE)” score.

Table 5 Development of scoring to predict mortality and receiving intervention in older patients in the development cohort (N = 1002)

In the development cohort, the predictive model was divided into five-level to predict mortality and receiving lifesaving intervention: very high risk (score > 10; sensitivity 40.3% and specificity 95.2%), high risk (score > 7 or ≤ 10; sensitivity 56.9% and specificity 87.3%), moderate risk (score > 3 or ≤ 7; sensitivity 79.0% and specificity 74.2%), low risk (score > 1 or ≤ 3; sensitivity 91.2% and specificity 42.3%), and very low risk (score 0–1). The mortality and lifesaving intervention probability in both cohorts are shown in Table 6.

Table 6 Performance of S-TRIAGE score to predict mortality and receiving intervention in older patients in the development cohort and validation cohort

Our study realized an AUROC 0.824 (95% CI = 0.789–0.859) in the development cohort and 0.826 (95% CI = 0.773–0.879) in the validation cohort (AUROC different − 0.002, P = 0.955, Table 7) for the ability of the S-TRIAGE score to predict 28-day mortality and receiving the lifesaving intervention. In addition, the calibration of the risk score showed the predicted risk and observed risk of outcomes in elderly patients, presented in Additional files 3–4. Moreover, the S-TRIAGE score had a better performance than NEWS and ESI in the development cohort, as shown by the AUROC difference (P = 0.105 and < 0.001, respectively, Additional file 5).

Table 7 Comparison of AUROC of the scoring system between development cohort and validation cohort

We suggested that a score > 7 and ≤ 10 points represented a danger zone, whereby emergency care should trigger tools for closely monitoring this patient group. Additionally, patients in this very high-risk group (score > 10) would need lifesaving intervention or a high level of care, such as admission to the intensive care unit (ICU).

Discussion

This study assessed variables associated with mortality and developed a screening tool risk score to predict mortality and requiring lifesaving intervention for geriatric patients in the ED. The result showed malignancy, SBP < 100 mmHg, increased shock index, and mental status change as potential predictors of mortality in older patients. We developed the S-TRIAGE score from RR, SF ratio, SI, SBP < 100mmHg, BT, and altered mentation, which is suitable in the triage area—whereby the cutoff of each parameter was not the same as that of the general population. The S-TRIAGE score performed well in predicting 28-day mortality and the need for lifesaving intervention in the ED. In applying the clinical score that classified patients into five groups, we suggest consideration of close monitoring of high-risk patients while patients at very high risk require resuscitation and a high level of care. In addition, we propose that S-TRIAGE combined with ESI triage may increase the precision of predicting triage level 1, i.e., the immediate requirement of lifesaving intervention or triage level 2 for decision patients with high-risk conditions of deterioration.

Vital physiological signs are commonly used to assess a patient’s condition for a medical emergency, such as ESI triage and Early Warning Score for an activated rapid response team. However, physiological variables may be significantly affected by age. Therefore, our study indicated for each parameter a new cutoff suitable for predicting geriatric patients at risk.

Older patients had rapid RR to compensate for low tidal volume attributable to a decline in lung elastic recoil [18], so a low RR represented respiratory failure. Moreover, Smith et al. reported that a breathing rate > 24 breaths/min in older patients was associated with mortality [19].

The SF ratio was used as a non-invasive and alternative marker of the PaO₂/FiO₂ratio in acute respiratory failure and was significantly associated with mortality in ICU [20]. Similarly, Kwack et al. reported that the SF ratio was a significant factor in predicting transfer to the ICU and mortality [21].

Age-related molecular change in cardiovascular systems results in sensitivity, reliability, and normal blood pressure and HR range [18, 22]. SI is a ratio of HR over SBP that is easily calculated in the ED. Previous studies revealed that SI was related to high mortality and the need for life-saving intervention in geriatric patients [23,24,25]. Also, our study showed SBP was a significant factor in predicting mortality, with the trigger cutoff SBP indicating low blood pressure of < 100 mmHg. Compared with the results reported by Smith et al., older patients with SBP in the 90–94 mmHg range had ten times the mortality of younger counterparts [19].

This study confirms that low BT and fever were related to mortality in older patients. Fever was considered an indicator of immune response for sepsis and inflammation [26], while hypothermia represented severe conditions and multiorgan failure [27]. However, the cutoff BT in the elderly was lower than in the younger because of the reduced production of pyrogenic cytokines and changed thermoregulation by aging [18].

Acute changes in mental status are usually precipitated by an underlying medical illness that is potentially life-threatening [28]. Our data showed that altered mentation was a potential factor for predicting mortality in older patients. Moreover, Boonmee et al. found that Glasgow Coma Scale scores were associated with mortality in sepsis in older adults [29].

The S-TRIAGE score achieves excellent performance in terms of mortality and requiring lifesaving intervention prediction, while ESI triage performed low accuracy on both the development and validation cohort. Nevertheless, the ability of NEWS to predict mortality and lifesaving intervention in this validation cohort was also favorable but performed less well in the development cohort. Comparing this result with previous studies, the predictive value of NEWS in older patients in the ED regarding mortality remains to be determined [14, 15].

This study had several limitations. First, it was a retrospective single-center study, which reduces its generalizability to broader populations. Second, as ESI triage was a decision of triage nursing staff whose degree of experience affected the accuracy of triage, some patients may have been under-triage, thus limiting the usefulness of ESI in this study. Third, because the cutoff point of each parameter was selected from data for this cohort, the results achieved a good performance level. Further studies are needed for external validation and to remove selection bias.

Conclusions

This study showed malignancy, SBP < 100 mmHg, increased shock index, and mental status change were predictive factors for 28-day mortality in elderly patients in the ED. In addition, our newly developed screening tool, the S-TRIAGE score, was simple and performed well in stratifying patients at risk who need close monitoring and resuscitation.