Archives of Academic Emergency Medicine. 2019; 7 (1): e56 OR I G I N A L RE S E A RC H Validation of SUSPEKT Score in Predicting One-month Mortality of Patients with Hemorrhagic Stroke; a Diagnos- tic Accuracy Study Hamid Kariman1, Hamidreza Hatamabadi1, Majid Shojaee1, Farhad Asarzadegan2, Simin Saljughi1∗ 1. Emergency Department, Imam Hossein Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran. 2. Neurology Department, Imam Hossein Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran. Received: July 2019; Accepted: August 2019; Published online: 29 September 2019 Abstract: Introduction: Predicting the outcome of patients with intracranial hemorrhage (ICH) is the area of interest for in charge physicians as well as patients and their associates. This study aimed to evaluate the accuracy of SUSPEKT score in predicting one-month outcome of patients with hemorrhagic stroke. Methods: This prospective cross sectional study was conducted on > 18 years old patients with non-traumatic supra-tentorial ICH admitted to emergency department, from February 2017 to January 2018. SUSPEKT score was measured for each patient and its screening performance characteristics in prediction of one-month mortality were calculated. Results: 169 cases with the mean age of 63.09 ± 15.45 (21 – 96) years were studied (56.8% male). After one month follow up 47 (27.8%) cases had died, 30 (17.7%) cases were bed ridden, and 72 (42.6%) could walk without help or with a cane. Non-survived patients had significantly larger intra-ventricular hemorrhage (IVH) (p < 0.001) and hematoma (p < 0.001) volume, higher serum glucose (p < 0.001) and blood pressure (p = 0.028), higher frequency of IVH (p < 0.001), and higher WBC count (p = 0.037). Sensitivity, specificity, positive predictive value (PPV ), and negative predictive value (NPV ) of SUSPEKT score at the 65 cut point were 82.97% (95% CI: 68.65% – 91.86%), 74.59% (95% CI: 65.76% – 81.84%), 55.71% (95% CI: 43.38% – 67.40%), and 91.91% (95% CI: 84.23% – 96.16%), respectively. Conclusion: Total accuracy of SUSPEKT score in predicting one-month mortality of non- traumatic ICH patients is in good range and it has 82% sensitivity and 92% NPV in this regard. It seems that we need further studies before applying the score in routine practice. Keywords: Intracranial hemorrhages; stroke; decision support techniques; prognosis; patient outcome assessment; mor- tality Cite this article as: Kariman H, Hatamabadi H, Shojaee M, Asarzadegan F, Saljughi S. Validation of SUSPEKT Score in Predicting One-month Mortality of Patients with Hemorrhagic Stroke; a Diagnostic Accuracy Study. Arch Acad Emerg Med. 2019; 7(1): e56. 1. Introduction Intracranial hemorrhage (ICH) is accountable for 15% of all strokes but it is one of the most disabling forms of stroke (1). Spontaneous non-traumatic ICH is associated with high mortality rate worldwide (2). More than thirty percent of patients with ICH will not survive and only 20% of them will go on to be functional and live independently (3). The Global Burden of Disease 2010 Study showed a 47% increase in the absolute number of hemorrhagic strokes throughout the world during 1990-2010. The largest proportion of ICH ∗Corresponding Author: Simin Saljughi; Imam Hossein Hospital, Shahid Madani Avenue, Imam Hossein Square, Tehran, Iran. Email: simin- saljughi@gmail.com, Tel: 00989125705371 incident cases (80%) and deaths (63%) occurred in low- and middle-income countries such as Sub-Saharan Africa, Cen- tral Asia and Southeast Asia (4). Mortality of ICH is estimated as forty percent in one month and 54% in one year (5). Therefore, outcome prediction of these patients is the area of interest for in charge physicians as well as patients and their associates. Predicting stroke outcomes is widely studied, and a lot of factors such as age, Glasgow coma scale, hematoma volume and location, and presence of intra-ventricular hem- orrhage (IVH) are introduced and discussed as the risk fac- tors of mortality in these patients (6-8). Despite previous in- vestigations, there is no validated clinical scoring system for wide use in predicting the prognosis of ICH patients. In a re- cent study, SUSPEKT score was proposed as a simple, cheap and reproducible scoring system for 30-day clinical outcome This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem H. Kariman et al. 2 prognosis in ICH patients. This score consists of six parame- ters: serum glucose, total hematoma volume, systolic blood pressure, existence of intra-ventricular hemorrhage, serum potassium level, and age (9). This study aimed to evaluate the accuracy of the mentioned clinical rule in predicting one-month mortality of ICH pa- tients referred to emergency department. 2. Methods 2.1. Study design and setting This prospective cross sectional study was conducted on pa- tients with primary non-traumatic ICH admitted to Imam Hossein Hospital, Tehran, Iran, from February 2017 to Jan- uary 2018. SUSPEKT score was measured for each pa- tient and its accuracy in prediction of one-month mortal- ity was calculated. The study protocol was approved by ethics committee of Shahid Beheshti University of Medical Sciences (ethics code: IR.SMBU.RETECH.REC.1395.295). An informed consent form was completed by participants or their legal guardian. Patients had the right to decline to con- tinue in every stage the study. 2.2. Participants Hemorrhagic stroke patients over 18 years old who were admitted to emergency department within 24 hours after the stroke were included. Patients with unstable hemody- namic status, pregnancy/ breastfeeding, previous neurologic deficit, sub-arachnoid hemorrhage (SAH), infra-tentorial hemorrhage, arteriovenous malformations, and history of brain tumor, as well as those who underwent neurosurgical evacuation or drainage, and had incomplete data were ex- cluded. All patients were transported to our emergency de- partment within 24 hours of stroke onset. If this point of time could not be ascertained, we used the last time when the pa- tient was known to be well. 2.3. Data gathering A researcher-made checklist was completed for each patient, which consisted of age, gender, history of smoking and al- cohol usage, as well as systolic and diastolic blood pressure at the time of admission to emergency department. We also recorded laboratory data of patients including serum potas- sium, hemoglobin, serum glucose, white blood cell (WBC) and platelet counts. A senior emergency medicine resident was responsible for data gathering under the direct supervi- sion of an emergency medicine specialist. 2.4. Outcome The main outcome was one-month mortality. We also cate- gorized patients in five outcome categories as dead, walking without help, walking with help, bedridden and wheel-chair dependent. 2.5. Procedure After providing critical care and monitoring, all patients underwent brain computed tomography (CT) scan without contrast within 30 minutes of arrival, and if ICH was con- firmed via CT scan the patient was evaluated for eligibility. Two consultant radiologists, who were blinded to the out- come, performed image analysis, independently. Brain CT scans were performed on 16-slice multi-detector CT scan- ners. Slice thickness was 5 to 10 mms for supra-tentorial and 2.5 to 4 mms for infra-tentorial regions. Images were transferred to an offline image processing workstation as DI- COM (Digital Imaging and Communications in Medicine) files. Radiologists separated intracranial space from the skull and non-brain structures for analysis. The following variables were evaluated: total intracranial volume; total hematoma volume; intra-parenchymal hematoma volume; and intra-ventricular hematoma volume, each expressed as cm3. Additionally, relative volumes were defined as the ratio of total, intra-parenchymal, and intra-ventricular hematoma volumes to intra-cranial volume yielding variables (without unit). 2.6. SUSPEKT score We calculated SUSPEKT score according to the previously published article by Rita Szepesi and colleagues in 2014 (9). This score is developed to predict the 30-day mortality of ICH patients using 6 factors including serum glucose, total hematoma volume, systolic blood pressure, presence of IVH, serum potassium level, and age. 2.7. Statistical Analysis The sample size, considering α = 0.05, standard deviation = 3.5, d = 7.4, and power = 80%, was calculated to be 170 cases. The data were analyzed using SPSS version 21 sta- tistical software. Mean ± standard deviation or frequency and percent were used for descriptive statistics. For compar- ison of the findings between groups, we used T-Test and Chi square test. The screening performance characteristics (sen- sitivity, specificity, positive predictive value (PPV ), negative predictive value (NPV ), positive likelihood ratio (PLR), and negative likelihood ratio (NLR)) of SUSPEKT score in predic- tion of one-month mortality was calculated using VassarStats medical calculator with 95% confidence intervals (CI). Total accuracy and the best cut point of SUSPEKT in this regard were calculated using the area under the receiver operating characteristic (ROC) curve. Accuracy of 0.90-0.100 was con- sidered as excellent, 0.80-0.90 as good, 0.70-0.80 as fair, 0.60- 0.70 as poor, and 0.50-.60 as fail. P value less than 0.05 was considered significant. This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem 3 Archives of Academic Emergency Medicine. 2019; 7 (1): e56 Table 1: Baseline characteristics of participants Variable Value Age (year) 20-39 13 (7.7) 40-59 49 (29.0) >60 107 (63.3) Gender Male 96 (56.8) Female 73 (43.2) History Smoking 19 (11.2) Alcohol abuse 75 (44.4) Blood pressure (mmHg) Systolic 159.10 ± 34.95 Diastolic 80.22 ± 16.98 Blood glucose level (mmol/L) Mean ± SD 8.80± 4.29 Laboratory parameters Serum Potassium (meq/L) 3.99 ± 0.53 Hemoglobin (mg/dL) 13.24 ± 1.90 Platelet count (109 cells /liter) 234.18 ± 74.95 WBC count (109 cells/liter) 9.60 ± 3.21 IVH size (cm3 ) Mean ± SD 0.010 ± 0.026 Total hematoma size (cm3 ) Mean ± SD 0.039 ± 0.048 Data are presented as mean ± standard deviation (SD) or frequency (%). WBC: white blood cell; IVH: intraventricular hematoma. 3. Results 3.1. Baseline characteristics of participants 169 cases with the mean age of 63.09 ± 15.45 (21 – 96) years were studied (56.8% male). The baseline characteristics of patients are listed in table1. More than 90% of cases were in > 40 years range. The mean IVH and total hematoma size in this series were 0.010 ± 0.026 cm3 and 0.039 ± 0.048 cm3, re- spectively. After one month follow up 47 (27.8%) cases had died, 30 (17.7%) cases were bed ridden, and 72 (42.6%) could walk without help or with a cane. Table 2 compares the base- line characteristics of survived and non-survived cases. Non- survived patients had significantly larger IVH (p < 0.001) and hematoma (p < 0.001) volume, higher blood glucose level (p < 0.001) and blood pressure (p = 0.028), and higher WBC count (p = 0.037). 72.3% (34 cases) of non-survived patients had IVH, while only 15.6% (19 cases) of survived cases had simul- taneous ventricular hemorrhage (p < 0.001). 3.2. Accuracy of SUSPEKT score The mean SUSPEKT score of non-survived patients was sig- nificantly higher than survived cases (78.51 ± 22.64 vs 48.85 ± 28.3; p < 0.0001). The area under the ROC curve of SUSPEKT score in prediction of one-month mortality of ICH patients was 0.803 (95% CI: 0.727-0.879; P<0.001). The best cut point Figure 1: Area under the receiver operating characteristic (ROC) curve of SUSPEKT score in predicting one-month mortality of pa- tients with intracranial hemorrhage. for the score in this regard was 65 (based on ROC curve). Sen- sitivity, specificity, PPV, NPV, PLR, and NLR of SUSPEKT score at the 65 cut point were 82.97% (95% CI: 68.65% – 91.86%), 74.59% (95% CI: 65.76% – 81.84%), 55.71% (95% CI: 43.38% – 67.40%), 91.91% (95% CI: 84.23% – 96.16%), 1.25 (95% CI: 0.89 – 1.75), and 0.09 (95% CI: 0.05 – 0.17), respectively. 4. Discussion Based on the findings of the present study, the total accu- racy of SUSPEKT score in predicting one-month mortality of ICH patients is in good range and it has 82% sensitivity and 92% NPV in this regard. Despite wide researches performed on predicting mortality of primary ICH cases, there is no re- liable and widely used scoring system in this regard (6, 10, 11). There are different prognostic models in predicting mor- tality of ICH (12, 13). These studies have been focused on age, low level of consciousness, location or volume of hemor- rhage, existence of hydrocephalus in CT scan, and focal neu- rologic symptoms on admission as possible prognostic fac- tors of outcome (14-17). Tsikriki et al., in their study regarding the prognostic fac- tors of mortality following ICH, demonstrated the indepen- dent association of Apache II score, Sofa score, GCS on ad- mission, and ICH volume with 30-day mortality (18). In line with Szepesi et al. study, we showed that each item of SUS- PEKT score, except for two variables of age and serum potas- sium level, significantly correlated with the 30-day outcome of ICH patients, independently (9). It is shown that serum This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem H. Kariman et al. 4 Table 2: Comparing the baseline characteristics of survived and non-survived cases Variable Survived (n=122) Dead (n= 47) P Gender Female 52 (42.6) 21 (44.7) 0.47 Male 70 (57.4) 26 (55.3) Age (year) Mean ± SD 62.04 ± 15.60 65.83 ± 14.78 0.81 Serum potassium (meq/L) Mean ± SD 4.00 ± 15.60 3.95 ± 0.48 0.74 Bleeding size (cm3) IVH size 0.007 ± 0.017 0.026 ± 0.036 <0.001 Total hematoma 0.027 ± 0.037 0.069 ± 0.0589 <0.001 IVH presence Yes 19 (35.8) 34 (64.2) <0.001 No 103 (88.8) 13 (11.2) Serum glucose (mmol/L) Mean ± SD 7.9 ± 2.7 11.1 ± 6.2 <0.001 Blood pressure (mmHg) Systolic 155.4 ±31.2 168.5 ± 42.1 0.028 Diastolic 77.9 ± 15.8 86.1 ± 18.5 0.005 Cell blood counts WBC (109 cells/L) 9.2 ± 2.8 10.4 ± 3.9 0.037 Platelet (109 cells/L) 235.3 ± 63.8 231.2 ± 98.9 0.754 Hemoglobin (mg/dl) 13.3 ± 1.8 12.8 ± 2.0 0.131 Data are presented as mean ± standard deviation (SD) or frequency (%). IVH: intraventricular hematoma; WBC: white blood cell. glucose level is significantly associated with mortality in ICH patients (19, 20). Some other investigations showed that hy- poglycemia is not a strong predictor for mortality (13, 21-23). It is also demonstrated that, acute hyperglycemia in patients with stroke, can be reflective of adverse findings in MRI and stereoscopy studies (23). In the present study, non-survived patients had significantly higher serum glucose level. In line with the findings of Taha Nisa, et al. and in disagree- ment with SUSPEKT score, there was no significant associ- ation between the mean age of patients and mortality (24). It is shown that volume of ICH can significantly predict 30- day mortality (11, 25). In addition, existence and size of IVH, is significantly associated with final outcome (26, 27). It is shown that increased hemorrhage predisposes patients to die within 4 weeks after stroke (28). Based on our findings, both IVH and total hematoma size were significantly higher in non-survived patients. Regarding the association of serum potassium level and mortality, the finding of this study was in disagreement with the findings of the SUSPEKT score deriva- tion study. The SUSPEKT score is difficult to calculate and based on our findings it seems that we need further comprehensive re- search before considering the SUSPEKT score as a screen- ing test in our routine practice. The weight of some vari- ables, such as serum potassium and age, in predicting mor- tality should be reevaluated and some factors such as the lo- cation of hemorrhage, cause of hemorrhage, and etc. should be more considered in future studies. Performing large-scale and multi-centric studies for assessing the value of SUSPEKT score can be helpful for evaluating the generalizability of findings. 5. Limitation Small sample size and focusing on the patients of one center were among the limitations of the present study. 6. Conclusion Based on the findings of the present study, the total accuracy of SUSPEKT score in predicting one-month mortality of ICH patients is in good range and it has 82% sensitivity and 92% NPV in this regard. 7. Appendix 7.1. Acknowledgements We would like to thank all the staff of Imam Hossain Hospital who helped us perform this research. This paper is derived from the thesis project of Dr. Saljughi to earn her specialist degree in Shahid Beheshti University of Medical Sciences. 7.2. Author contribution The authors met the standard criteria for authorship based on the recommendations of the international committee of medical journal editors. This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem 5 Archives of Academic Emergency Medicine. 2019; 7 (1): e56 Authors ORCIDs Hamid Kariman: 0000-0001-8082-0356 Hamidreza Hatamabadi:0000-0002-9085-8806 Majid Shojaei: 0000-0001-6819-9237 7.3. Funding/Support None. 7.4. Conflict of interest There is no conflict of interest. References 1. Qureshi AI, Mohammad YM, Yahia AM, Suarez JI, Sid- diqui AM, Kirmani JF, et al. A prospective multicenter study to evaluate the feasibility and safety of aggressive antihypertensive treatment in patients with acute intrac- erebral hemorrhage. Journal of intensive care medicine. 2005;20(1):34-42. 2. Steiner T, Al-Shahi Salman R, Beer R, Christensen H, Cor- donnier C, Csiba L, et al. E uropean S troke O rganisation (ESO) guidelines for the management of spontaneous in- tracerebral hemorrhage. International journal of stroke. 2014;9(7):840-55. 3. Sahni R, Weinberger J. Management of intracerebral hemorrhage. Vascular health and risk management. 2007;3(5):701-9. 4. Krishnamurthi RV, Moran AE, Forouzanfar MH, Bennett DA, Mensah GA, Lawes CM, et al. The global burden of hemorrhagic stroke: a summary of findings from the GBD 2010 study. Global heart. 2014;9(1):101-6. 5. van Asch CJ, Luitse MJ, Rinkel GJ, van der Tweel I, Algra A, Klijn CJ. Incidence, case fatality, and functional out- come of intracerebral haemorrhage over time, according to age, sex, and ethnic origin: a systematic review and meta-analysis. The Lancet Neurology. 2010;9(2):167-76. 6. Ruiz-Sandoval JL, Chiquete E, Romero-Vargas S, Padilla- Martinez JJ, Gonzalez-Cornejo S. Grading scale for pre- diction of outcome in primary intracerebral hemor- rhages. Stroke. 2007;38(5):1641-4. 7. Ziai WC, Carhuapoma JR. Intracerebral Hemor- rhage. Continuum: Lifelong Learning in Neurology. 2018;24(6):1603-22. 8. Sandeep YS, Guru MR, Jena RK, Kumar VAK, Agrawal A. Clinical study to assess the outcome in surgically man- aged patients of spontaneous intracerebral hemorrhage. International journal of critical illness and injury science. 2017;7(4):218. 9. Szepesi R, Szell IK, Hortobagyi T, Kardos L, Nagy K, Lanczi LI, et al. New prognostic score for the prediction of 30-day outcome in spontaneous supratentorial cerebral haemorrhage. BioMed research international. 2015;2015. 10. Broderick JP, Brott TG, Duldner JE, Tomsick T, Hus- ter G. Volume of intracerebral hemorrhage. A powerful and easy-to-use predictor of 30-day mortality. Stroke. 1993;24(7):987-93. 11. Weimar C, Benemann J, Diener H. Development and validation of the Essen intracerebral haemorrhage score. Journal of Neurology, Neurosurgery & Psychiatry. 2006;77(5):601-5. 12. Hemphill JC, Bonovich DC, Besmertis L, Manley GT, Johnston SC. The ICH score. Stroke. 2001;32(4):891-7. 13. Tuhrim S, Dambrosia JM, Price TR, Mohr JP, Wolf PA, Hier DB, et al. Intracerebral hemorrhage: external validation and extension of a model for prediction of 30-day sur- vival. Annals of Neurology: Official Journal of the Amer- ican Neurological Association and the Child Neurology Society. 1991;29(6):658-63. 14. Gomis M, Ois A, Rodriguez-Campello A, Cuadrado-Godia E, Jimenez-Conde J, Subirana I, et al. Outcome of intrac- erebral haemorrhage patients pre-treated with statins. European journal of neurology. 2010;17(3):443-8. 15. Gebel Jr JM, Jauch EC, Brott TG, Khoury J, Sauerbeck L, Salisbury S, et al. Relative edema volume is a predictor of outcome in patients with hyperacute spontaneous in- tracerebral hemorrhage. Stroke. 2002;33(11):2636-41. 16. Nilsson OG, Lindgren A, Brandt L, Saveland H. Prediction of death in patients with primary intracerebral hemor- rhage: a prospective study of a defined population. Jour- nal of neurosurgery. 2002;97(3):531-6. 17. Reinhard M, Neunhoeffer F, Gerds TA, Niesen W-D, But- tler K-J, Timmer J, et al. Secondary decline of cere- bral autoregulation is associated with worse outcome af- ter intracerebral hemorrhage. Intensive care medicine. 2010;36(2):264-71. 18. Tsikriki S, Karathanou A, Kokoris I, Topalis T, Voutsinas E, Antoniou A, et al. Prognostic factors of 30-days mortality in primary intracerebral hemorrhage. 2015;3(S1):A983. 19. Fogelholm R, Murros K, Rissanen A, Avikainen S. Ad- mission blood glucose and short term survival in pri- mary intracerebral haemorrhage: a population based study. Journal of Neurology, Neurosurgery & Psychiatry. 2005;76(3):349-53. 20. Stead LG, Jain A, Bellolio MF, Odufuye A, Gilmore RM, Ra- binstein A, et al. Emergency Department hyperglycemia as a predictor of early mortality and worse functional outcome after intracerebral hemorrhage. Neurocritical care. 2010;13(1):67-74. 21. Hemphill III JC, Greenberg SM, Anderson CS, Becker K, Bendok BR, Cushman M, et al. Guidelines for the man- agement of spontaneous intracerebral hemorrhage: a guideline for healthcare professionals from the American This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem H. Kariman et al. 6 Heart Association/American Stroke Association. Stroke. 2015;46(7):2032-60. 22. Tetri S, Juvela S, Saloheimo P, Pyhtinen J, Hillbom M. Hy- pertension and diabetes as predictors of early death after spontaneous intracerebral hemorrhage. Journal of neu- rosurgery. 2009;110(3):411-7. 23. Lee S-H, Kim B, Bae H-J, Lee J, Lee J, Park B-J, et al. Ef- fects of glucose level on early and long-term mortality af- ter intracerebral haemorrhage: the Acute Brain Bleeding Analysis Study. Diabetologia. 2010;53(3):429-34. 24. Nisar T, Alchaki A, Hillen MJCn, neurosurgery. Validation of ICH score in a large urban population. 2018;174:36-9. 25. Tsikriki S, Karathanou A, Kokoris I, Topalis T, Voutsinas E, Antoniou A, et al. Prognostic factors of 30-days mortal- ity in primary intracerebral hemorrhage. Intensive care medicine experimental. 2015;3(S1):A983. 26. Ueshima H, Reza Choudhury S, Okayama A, Hayakawa T, Kita Y, Kadowaki T, et al. Cigarette smoking as a risk factor for stroke death in Japan: NIPPON DATA80. Stroke. 2004;35(8):1836-41. 27. Wong K. Risk factors for early death in acute ischemic stroke and intracerebral hemorrhage: a prospective hospital-based study in Asia. Stroke. 1999;30(11):2326- 30. 28. Brott T, Broderick J, Kothari R, Barsan W, Tomsick T, Sauerbeck L, et al. Early hemorrhage growth in patients with intracerebral hemorrhage. Stroke. 1997;28(1):1-5. This open-access article distributed under the terms of the Creative Commons Attribution NonCommercial 3.0 License (CC BY-NC 3.0). Downloaded from: http://journals.sbmu.ac.ir/aaem Introduction Methods Results Discussion Limitation Conclusion Appendix References