- Original Research
- Open Access
Prognostic utility of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI)
International Journal of Emergency Medicine volume 4, Article number: 49 (2011)
We sought to evaluate the test characteristics of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) in relation to 30-day major adverse cardiac events (MACE) among patients who presented to the Emergency Department with symptoms suggestive of an acute coronary syndrome. We then examined the test characteristics of various dichotomous ACI-TIPI cut points.
We prospectively recruited a cohort of Emergency Department (ED) patients with acute chest pain at two urban university hospitals between June and September 2006. Upon enrollment, baseline demographics and cardiac risk factors were collected. An electrocardiogram (ECG) was performed and analyzed with the built-in ACI-TIPI multiple regression model software. An ACI-TIPI probability score was recorded for each patient. Diagnostic test characteristics of ACI-TIPI for MACE (non-ST elevation myocardial infarction (NSTEMI), percutaneous coronary intervention, coronary artery bypass grafting, and all-cause mortality) within 30 days were determined.
Of 144 patients enrolled (mean age 59.1 ± 14.1 years, 59% men), 19 (13%) patients suffered MACE within 30 days. Receiver-operating characteristics (ROC) for ACI-TIPI yielded a c-statistic of 0.69 (95% CI 0.59-0.80, p < 0.01). An ACI-TIPI score of ≥ 20 had 100% sensitivity (95% CI 82-100), 100% negative predictive value (95% CI 86-100), and 21% specificity (14-31%).
These preliminary results suggest that, while ACI-TIPI has limited discriminatory value for MACE overall, a score of < 20 may have 30-day prognostic utility to allow for safe outpatient management in patients with acute chest pain.
Over 6 million patients undergo evaluation for chest pain in the United States each year [1, 2]. A large subset of these patients will have a diagnosis other than an acute coronary syndrome (ACS), while 1-5% of these patients will be inappropriately discharged with true myocardial infarctions [3, 4]. Misinterpretation of electrocardiogram findings has been cited as a major contributor to missed myocardial infarctions in the emergency department (ED) . Patients who are inappropriately discharged have a mortality rate that is nearly twice that of patients who are admitted . Unfortunately, efforts to identify these high-risk patients by historical data and available risk scores have proven unreliable [5–7]. To maintain both safety and efficiency, recent work had addressed patients at very low risk for ACS who may not require further testing , highly sensitive cardiac biomarkers [9–15], rapid imaging modalities for cardiac risk stratification [16–20], and post-risk stratification scores that incorporate demographic and clinical data . In this context, a highly sensitive, rapid, and non-invasive risk assessment tool would improve the triage of patients with chest pain, especially in low-risk ED populations. Furthermore, such a tool could prove to be useful in settings where biomarkers and advanced technology are not readily accessible.
The acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) was developed as a means to risk-stratify patients in real time [22, 23]. Subsequent studies have demonstrated that this tool accurately estimates the risk of acute cardiac ischemia in an undifferentiated patient population, and substantially speeds decision making and triage by novice clinicians [22, 24–26]. When used in a low-risk population of patients with chest pain admitted to an observation unit, a dichotomous ACI-TIPI cut point of 20% or greater was shown to be predictive of nonnegative exercise treadmill tests . Two systematic reviews of available cardiac risk stratification technologies by the National Heart Attack Alert Program have graded the evidence supporting ACI-TIPI as Class A, one of only three tools to receive this rating .
The ability of an ACI-TIPI cut point to identify patients at very low risk of myocardial infarction (less than 2% at 45 days) has been studied in patients admitted to the hospital or chest pain observation units [8, 22, 25, 29], but not as a prognostic indicator in an undifferentiated cohort presenting with symptoms concerning for myocardial infarction. Identification of patients with chest pain who are at low-risk for cardiovascular events at 30 days may improve decision-making regarding initial triage and disposition. The primary objective in this prospective multicenter study is to define an optimal ACI-TIPI cut point that can predict 30-day major adverse cardiac events (MACE) in patients with acute chest pain.
Study setting and design
A prospective cohort study of patients with acute chest pain was conducted at two urban university emergency departments, each with over 55,000 visits per year. Both institutions are staffed 24 hours a day with board-certified emergency doctors. The study protocol was approved by each hospital's institutional review board, and all patients provided written informed consent.
We enrolled consecutive ED patients with symptoms consistent with myocardial ischemia during periods of research assistant availability, on weekdays during business hours (9 a.m. to 5 p.m.), between June and September 2006. All patients were evaluated by a board-certified emergency physician and received standard treatment irrespective of their participation in the study. We included all patients with chest pain or symptoms consistent with myocardial ischemia (e.g., shortness of breath). All patients had a single troponin measurement as part of their workup. Because this was an observational study, there was variability among treating physicians regarding the decision to measure serial biomarkers and obtain functional cardiac studies. We excluded patients with obvious alternative diagnoses who did not receive any workup for myocardial ischemia, as well as patients with ST elevations on their initial electrocardiogram, as we did not want the research protocol to interrupt expeditious transfer to the catheterization suite. Assuming a baseline 20% prevalence of the predictor (ACI-TIPI cut point) and a 5% MACE rate, we calculated the need to include 156 patients to have 80% power and 5% alpha to show a two-fold risk difference.
Patients meeting the enrollment criteria above were approached by trained research assistants. After providing written informed consent, a standardized data collection instrument was completed by the research assistant. This instrument assessed baseline demographics, traditional cardiac risk factors (diabetes, hypertension, hyperlipidemia, smoking history, and history of coronary artery disease in a first-degree relative), and current medication use. These data were recorded and entered into the study database.
Upon enrollment, patients had an ECG performed, which was analyzed with the built-in ACI-TIPI multiple regression model software. To do this, a research assistant acquired and entered the following data required for the ACI-TIPI program: the patient's age and sex, the presence of chest or left arm pain, and whether these symptoms were their primary complaint. Based on ECG evidence of pathologic Q waves and ST- and T-wave changes, the software calculated a probability score for myocardial infarction, reported as a percentage, which represents the probability of acute ischemia. Exact numerical values for these log-odds ratios are reported elsewhere .
The diagnosis of myocardial infarction was based upon European Society of Cardiology/American College of Cardiology (ESC/ACC) guidelines as a typical rise and fall of troponin T (Elecsys 2010, Roche Diagnostics, Indianapolis, IN) or troponin I (Advia Centaur, Bayer Healthcare, Tarrytown, NY) in the setting of ischemic symptoms or characteristic ECG changes such as pathologic Q waves or ST depression .
The primary outcome was any MACE within 30 days of evaluation, including these events during the index visit. MACE was defined as any one of the following: non-ST elevation myocardial infarction (NSTEMI) as defined by ESC/ACC criteria , percutaneous coronary intervention, coronary artery bypass grafting, and all-cause mortality. Non-ST elevation myocardial infarction was defined as the ''detection of rise and/or fall of cardiac troponin with at least one value above the 99th percentile of the upper reference limit together with evidence of myocardial ischemia with at least one of the following: (1) symptoms of ischemia, (2) ECG changes indicative of new ischemia (new ST T changes or new left bundle-branch block), (3) development of pathological Q waves in the ECG, and (4) imaging evidence of new loss of viable myocardium or new regional wall motion abnormality" . These events were recorded by review of subsequent hospital records, scripted follow-up phone calls, and searches of the Social Security Death Index. The secondary outcome of in-hospital non-ST elevation myocardial infarction was agreed upon by consensus of two study investigators to better ensure the validity of this measurement.
We calculated sensitivities, odds ratios (ORs), and 95% confidence intervals. Descriptive statistics were used for baseline characteristics. χ2 and Student's t tests were used to compare categorical and continuous variables, respectively. All p-values were two-tailed with a value less than 0.05 considered significant. Area under the receiver-operating characteristics curves (AUCs) of ACI-TIPI to predict MACE were plotted, to assess overall discrimination and to define sensitivity and specificity for various cut points of the ACI-TIPI score (e.g., 10, 20, 30, and 40). A dichotomous cut point was chosen as the ACI-TIPI score that achieved a sensitivity and negative predictive value (NPV) of 100%. Data were analyzed using SPSS version 14.0 (SPSS, Inc., Chicago, IL).
We enrolled 144 patients who met the inclusion criteria. Eight patients (5.5%) were lost to follow-up at 30 days, yielding 136 patients with complete data. The clinical characteristics of patients with and without MACE are summarized in Table 1. Overall, there was a 30-day MACE rate of 13.8% (19 patients), with 2 deaths (1.4%). Seventeen of the patients with MACE underwent coronary angiography with subsequent stent placement or coronary artery bypass grafts. Of the two remaining patients, one received medical management, and one expired from indeterminate causes.
An ACI-TIPI score above 20% was associated with a 20% increase in the odds of having a MACE within 30 days, while an ACI-TIPI score above 30% was associated with a 13 times greater odds of having a MACE (Table 2). The discriminatory power of the ACI-TIPI yielded an AUC of 0.69, as shown in Figure 1. The test characteristics for ACI-TIPI at various cut points are shown in Table 3. A cut point of 20 percent achieved a sensitivity and negative predictive value of 100 percent for MACE with a specificity of 21%. In contrast, with a cut point of 30 percent, the specificity increased two-fold to 40%, while maintaining a sensitivity of 94% and a negative predictive value of 98%.
In this preliminary study of ED patients with chest pain, ACI-TIPI from the presentation ECG had prognostic utility for prediction of 30-day MACE. ACI-TIPI scores greater than 20 percent were highly predictive of MACE at 30 days, with sensitivity and negative predictive values of 100 percent. If validated in larger studies, use of an ACI-TIPI cut point may define a low-risk subset of patients with acute chest pain amenable for outpatient management.
These data add to the current literature. In their 1998 multicenter study, Selker et al. evaluated the triage decisions made by physicians in the setting of electrocardiograms printed either with or without headings that denoted the calculated probability of ischemia . Use of this technology decreased triage to higher acuity inpatient settings and increased the percentage of patients discharged home. Thirty-day mortality rates between intervention and control groups were similar. Our study differs from this work in two important ways. First, rather than supplementing physician judgment with calculated probabilities between 0 and 100 percent, a dichotomous cut point simplifies decision-making for the clinician. Second, this cut point aims to identify a cohort of patients with a lower 30-day adverse event rate--as opposed to prior studies that looked at mortality--in real time. Measuring major adverse cardiac events is more useful to emergency physicians, since overall mortality from ACS is so low.
Our results also differ from the initial prospective validation of ACI-TIPI by Selker et al. , which demonstrated a 5.3% rate of acute myocardial infarction within 48 hours among patients with ACI-TIPI scores between 0 and 25%. When measuring 48-h outcomes in low- to moderate-risk cohorts defined by ACI-TIPI scores between 0 and 25%, 5.3% of patients had an acute myocardial infarction. Though this study enrolled both admitted and discharged patients with chest pain, this differs from our study in that both cohorts had follow-up ECG and cardiac enzyme testing (CK-MB) at 48 hours, potentially explaining the difference in event rates when compared to our data. Similarly, Seyal et al. examined the probability of acute myocardial infarction across a range of ACI-TIPI scores, and found that values greater than 20% had a 97% sensitivity for this outcome, while a sensitivity of 98% could be achieved if ACI-TIPI values greater than 10% were used . This study, however, only enrolled patients who were admitted to the hospital. This likely explains the higher event rate and lower sensitivity of ACI-TIPI seen in the data presented here. Thirty-day MACE was not assessed in either of these studies.
The aim of identifying a low-risk cohort of patients a priori is similar to the work of Mitchell et al. , though our patients were drawn from the general ED population rather than a preselected group that was enrolled upon transfer to a chest pain observation unit. Furthermore, our results are consistent with past data demonstrating that ACI-TIPI scores less than 20 are predictive of negative exercise stress tests, further suggesting that these patients are at lower risk for adverse outcomes .
The ACI-TIPI instrument was designed as a screening tool. As such, the low specificities demonstrated for each of the ACI-TIPI cut points in this study are acceptable. Additional data from the history and physical examination, cardiac biomarkers, and provocative testing can be used to better refine the specificity of these patients' workup. Table 3 also illustrates that both the PPV and LR+ for ACI-TIPI scores greater than 40 were lower than those with scores greater than 30. This is likely due to an inaccurate point estimate due to a smaller number of subjects with scores greater than this value, though these results would suggest that a cut point greater than 40 is less useful for the purpose of screening for 30-day MACE.
Interpretation of these results should incorporate several limitations. First, while an ACI-TIPI cut point of 20% achieved a sensitivity and negative predictive value of 100% for MACE, our study sample was relatively small, and the wide confidence intervals for each of these values preclude widespread application of this tool for safe triage decision-making. To obtain a 95% CI width of 10% around our point estimates (OR), given our MACE rate of 13%, we would have needed 43 MACEs. To accomplish these this number of events would require approximately twice the number of patients enrolled in this study. A larger study is needed to validate these findings. Second, enrollment of patients only during the hours of research assistant availability may have introduced an inclusion bias into our sample. Due to the broad constellation of complaints that could be interpreted as possible ACS, we were unable to retrospectively identify the overall number of patients who met our enrollment criteria and were not enrolled. However, the baseline characteristics of our study population reveal a quite heterogeneous sample with respect to cardiac risk factors. Our MACE rate was 13.8%, which is similar to prior studies of undifferentiated chest pain cohorts [9–11]. Third, because we have derived this optimal cut point from our data, we may have overestimated the diagnostic performance. Lastly, because this study was conducted at two large tertiary hospitals, caution must be taken before generalizing these results to other non-urban populations or community hospitals.
These preliminary results suggest that ACI-TIPI is useful for 30-day prediction of MACE. When used in the setting of ED patients with acute chest pain, a dichotomous cut point of less than 20% may aid identification of patients amenable for outpatient management. A prospective cohort study with a larger sample size is warranted to confirm these findings.
Goldman L, Kirtane AJ: Triage of patients with acute chest pain and possible cardiac ischemia: the elusive search for diagnostic perfection. Ann Intern Med 2003, 139(12):987–995.
Nawar EW, Niska RW, Xu J: National Hospital Ambulatory Medical Care Survey: 2005 emergency department summary. Adv Data 2007, 386: 1–32.
McCarthy BD, Beshansky JR, D'Agostino RB, Selker HP: Missed diagnoses of acute myocardial infarction in the emergency department: results from a multicenter study. Ann Emerg Med 1993, 22(3):579–582. 10.1016/S0196-0644(05)81945-6
Pope JH, Aufderheide TP, Ruthazer R, Woolard RH, Feldman JA, Beshansky JR, Griffith JL, Selker HP: Missed diagnoses of acute cardiac ischemia in the emergency department. N Engl J Med 2000, 342(16):1163–1170. 10.1056/NEJM200004203421603
Manini AF, Dannemann N, Brown DF, Butler J, Bamberg F, Nagurney JT, Nichols JH, Hoffmann U: Limitations of risk score models in patients with acute chest pain. Am J Emerg Med 2009, 27(1):43–48. 10.1016/j.ajem.2008.01.022
Swap CJ, Nagurney JT: Value and limitations of chest pain history in the evaluation of patients with suspected acute coronary syndromes. JAMA 2005, 294(20):2623–2629. 10.1001/jama.294.20.2623
Amsterdam EA, Kirk JD, Bluemke DA, Diercks D, Farkouh ME, Garvey JL, Kontos MC, McCord J, Miller TD, Morise A, Newby LK, Ruberg FL, Scordo K, Thompson PD: Testing of Low-Risk Patients Presenting to the Emergency Department With Chest Pain. A Scientific Statement From the American Heart Association. Circulation 2010, 122: 756–776.
Mitchell AM, Garvey JL, Chandra A, Diercks D, Pollack CV, Kline JA: Prospective multicenter study of quantitative pretest probability assessment to exclude acute coronary syndrome for patients evaluated in emergency department chest pain units. Ann Emerg Med 2006, 47(5):447.
Reichlin T, Hochholzer W, Bassetti S, Steuer S, Stelzig C, Hartwiger S, Biedert S, Schaub N, Buerge C, Potocki M, Noveanu M, Breidthardt T, Twerenbold R, Winkler K, Bingisser R, Mueller C: Early diagnosis of myocardial infarction with sensitive cardiac troponin assays. N Engl J Med 2009, 361(9):858–867. 10.1056/NEJMoa0900428
Keller T, Zeller T, Peetz D, Tzikas S, Roth A, Czyz E, Bickel C, Baldus S, Warnholtz A, Frohlich M, Sinning CR, Eleftheriadis MS, Wild PS, Schnabel RB, Lubos E, Jachmann N, Genth-Zotz S, Post F, Nicaud V, Tiret L, Lackner KJ, Munzel TF, Blankenberg S: Sensitive troponin I assay in early diagnosis of acute myocardial infarction. N Engl J Med 2009, 361(9):868–877. 10.1056/NEJMoa0903515
Kelly AM: Performance of a sensitive troponin assay in the early diagnosis of acute myocardial infarction in the emergency department. Emerg Med Australas 2011, 23(2):181–5. 10.1111/j.1742-6723.2011.01388.x
Giannitsis E, Becker M, Kurz K, Hess G, Zdunek D, Katus HA: High-sensitivity cardiac troponin T for early prediction of evolving non-ST-segment elevation myocardial infarction in patients with suspected acute coronary syndrome and negative troponin results on admission. Clin Chem 2010, 56(4):642–650. 10.1373/clinchem.2009.134460
Paoloni R, Kumar P, Janu M: Pilot study of high-sensitivity troponin T testing to facilitate safe early disposition decisions in patients presenting to the emergency department with chest pain. Intern Med J 2010, 40(3):188–192. 10.1111/j.1445-5994.2009.01962.x
Hjortshoj S, Kristensen SR, Ravkilde J: Diagnostic value of ischemia-modified albumin in patients with suspected acute coronary syndrome. Am J Emerg Med 2010, 28(2):170–176. 10.1016/j.ajem.2008.10.038
Haltern G, Peiniger S, Bufe A, Reiss G, Gulker H, Scheffold T: Comparison of usefulness of heart-type fatty acid binding protein versus cardiac troponin T for diagnosis of acute myocardial infarction. Am J Cardiol 2010, 105(1):1–9. 10.1016/j.amjcard.2009.08.645
Hoffmann U, Nagurney JT, Moselewski F, Pena A, Ferencik M, Chae CU, Cury RC, Butler J, Abbara S, Brown DF, Udelson JE, Achenbach S, Brady TJ, Nagurney JT: Coronary multidetector computed tomography in the assessment of patients with acute chest pain. Circulation 2006, 114(21):2251–2260. 10.1161/CIRCULATIONAHA.106.634808
Hollander JE, Litt HI, Chase M, Brown AM, Kim W, Baxt WG: Computed tomography coronary angiography for rapid disposition of low-risk emergency department patients with chest pain syndromes. Acad Emerg Med 2007, 14(2):112–116. 10.1111/j.1553-2712.2007.tb01753.x
Miller JM, Rochitte CE, Dewey M, Arbab-Zadeh A, Niinuma H, Gottlieb I, Paul N, Clouse ME, Shapiro EP, Hoe J, Lardo AC, Bush DE, de Roos A, Cox C, Brinker J, Lima JA: Diagnostic performance of coronary angiography by 64-row CT. N Engl J Med 2008, 359(22):2324–2336. 10.1056/NEJMoa0806576
Hoffmann UBF, Chae CU, Nichols JH, Rogers IS, Seneviratne SK, Truong QA, Cury RC, Abbara S, Shapiro MD, Moloo J, Butler J, Ferencik M, Lee H, Jang IK, Parry BA, Brown DF, Udelson JE, Achenbach S, Brady TJ, Nagurney JT: Coronary Computed Tomography Angiography for Early Triage of Patients With Acute Chest Pain, The ROMICAT (Rule Out Myocardial Infarction using Computer Assisted Tomography) Trial. J Am Coll Cardiol 2009, 53: 1642–1650. 10.1016/j.jacc.2009.01.052
Hollander JE, Chang AM, Shofer FS, McCusker CM, Baxt WG, Litt HI: Coronary computed tomographic angiography for rapid discharge of low-risk patients with potential acute coronary syndromes. Ann Emerg Med 2009, 53(3):295–304. 10.1016/j.annemergmed.2008.09.025
Lauer MS, Pothier CE, Magid DJ, Smith SS, Kattan MW: An externally validated model for predicting long-term survival after exercise treadmill testing in patients with suspected coronary artery disease and a normal electrocardiogram. Ann Intern Med 2007, 147(12):821–828.
Selker HP, Beshansky JR, Griffith JL, Aufderheide TP, Ballin DS, Bernard SA, Crespo SG, Feldman JA, Fish SS, Gibler WB, Kiez DA, McNutt RA, Moulton AW, Ornato JP, Podrid PJ, Pope JH, Salem DN, Sayre MR, Woolard RH: Use of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) to assist with triage of patients with chest pain or other symptoms suggestive of acute cardiac ischemia. A multicenter, controlled clinical trial. Ann Intern Med 1998, 129(11):845–855.
Selker HP, Griffith JL, D'Agostino RB: A tool for judging coronary care unit admission appropriateness, valid for both real-time and retrospective use. A time-insensitive predictive instrument (TIPI) for acute cardiac ischemia: a multicenter study. Medical care 1991, 29(7):610–627. 10.1097/00005650-199107000-00002
Aufderheide TP, Rowlandson I, Lawrence SW, Kuhn EM, Selker HP: Test of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) for prehospital use. Ann Emerg Med 1996, 27(2):193–198. 10.1016/S0196-0644(96)70322-0
Sarasin FP, Reymond JM, Griffith JL, Beshansky JR, Schifferli JA, Unger PF, Scherrer JR, Selker HP: Impact of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) on the speed of triage decision making for emergency department patients presenting with chest pain: a controlled clinical trial. J Gen Intern Med 1994, 9(4):187–194. 10.1007/BF02600122
Westfall JM, Van Vorst RF, McGloin J, Selker HP: Triage and diagnosis of chest pain in rural hospitals: implementation of the ACI-TIPI in the High Plains Research Network. Ann Fam Med 2006, 4(2):153–158. 10.1370/afm.403
Manini AF, McAfee AT, Noble VE, Bohan JS: Acute cardiac ischemia time-insensitive predictive instrument predicts exercise treadmill test results in the chest pain unit. Am J Emerg Med 2006, 24(3):375–378. 10.1016/j.ajem.2005.11.006
Selker HP, Zalenski RJ, Antman EM, Aufderheide TP, Bernard SA, Bonow RO, Gibler WB, Hagen MD, Johnson P, Lau J, McNutt RA, Ornato J, Schwartz JS, Scott JD, Tunick PA, Weaver WD: An evaluation of technologies for identifying acute cardiac ischemia in the emergency department: a report from a National Heart Attack Alert Program Working Group. Ann Emerg Med 1997, 29(1):13–87. 10.1016/S0196-0644(97)70298-1
Seyal JM, Clark EN, Macfarlane PW: Diagnosis of acute myocardial ischaemia using probabilistic methods. J Cardiovasc Risk 2002, 9(2):115–121. 10.1097/00043798-200204000-00007
Miller CD, Lindsell CJ, Anantharaman V, Lim SH, Greenway J, Pollack CV, Tiffany BR, Hollander JE, Gibler WB, Hoekstra JW: Performance of a population-based cardiac risk stratification tool in Asian patients with chest pain. Acad Emerg Med 2005, 12(5):423–430. 10.1197/j.aem.2004.11.016
Alpert JS, Thygesen K, Antman E, Bassand JP: Myocardial infarction redefined--a consensus document of The Joint European Society of Cardiology/American College of Cardiology Committee for the redefinition of myocardial infarction. Eur Heart J 2000, 21(18):1502–1513.
The authors declare that they have no competing interests.
JI participated in the design of the study, provided oversight for the data collection, performed the 30-day follow-up data collection, and drafted the manuscript. AM participated in the design of the study, provided oversight of the 30-day follow-up data, performed the statistical analyses, and edited the manuscript. UH participated in the study design and edited the manuscript. VN participated in the design of the study, provided oversight of the primary data collection, and edited the manuscript. EG and SN performed the primary data collection. JSB conceived the original study design and edited the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.