Layout 1 ISDS Annual Conference Proceedings 2012. This is an Open Access article distributed under the terms of the Creative Commons Attribution- Noncommercial 3.0 Unported License (http://creativecommons.org/licenses/by-nc/3.0/), permitting all non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. ISDS 2012 Conference Abstracts Evaluation of Heat-related Illness Surveillance Based on Chief Complaint Data from New Jersey Hospital Emergency Rooms Michael Berry1, Jerald Fagliano1, Stella Tsai*1, Katharine McGreevy1, Andrew Walsh2 and Teresa Hamby1 1NJDOH, Trenton, NJ, USA; 2Health Monitoring Systems, Inc., Pittsburgh, PA, USA Objective The purpose of this evaluation is to characterize the relationship between a patient’s initial hospital emergency room chief complaint potentially related to a heat-related illness (HRI) with final primary and secondary ICD-9 diagnoses. Introduction The NJ syndromic surveillance system, EpiCenter, developed an algorithm to quantify HRI visits using chief complaint data. While heat advisories are released by the National Weather Service, an ef- fective HRI algorithm could provide real-time health impact infor- mation that could be used to provide supplemental warnings to the public during a prolonged heat wave. Methods Data on NJ hospital emergency room visits were evaluated using two data sources: 1) the EpiCenter syndromic surveillance system of emergency room visits; and 2) the Uniform Bill-Patient Summaries (UB) system containing diagnosis data on all hospital visits. Three years of data (2009-2011) were selected, for the time window of May 1 to September 30. The UB data used for matching with the EpiCen- ter data were limited to facilities participating in EpiCenter during the evaluation period. (EpiCenter facilities captured about 1/3 of all heat-related diagnoses in 2009, increasing to about 2/3 in 2011.) The ICD-9 codes of interest included 992.0-992.9 and external cause of injury codes E900.0 and E900.9. We evaluated the sensitivity and positive predictive value (PPV) of the EpiCenter algorithm in relation to the patients’ eventual diagnoses coded in the UB data. Results During the 15 months of data examined, there were a total of 871 people identified with HRI visits based on the EpiCenter algorithm. Over the same time period in the same emergency room facilities, there were a total of 2,146 people with a primary or secondary HRI diagnosis in UB. The algorithm for the EpiCenter’s HRI definition had a sensitivity of 16% (348/2,146) when any primary or secondary ICD or E-code matched; the PPV was 40% (348/871). When data during a major heat event (July 21-23, 2011) was examined sepa- rately, both sensitivity (23%) and PPV (59%) improved. Graph 1 presents the 2011 daily number of HRI visits from Epi- Center data and the subset of UB data from facilities also reporting to EpiCenter. The pattern in the EpiCenter data tracked with the UB data for HRI visits and correctly identified several major episodes in 2011. The major heat-related illness episode of July 2011 was selected to evaluate the non-matched EpiCenter and UB data. A total of 210 (95%) of the non-matched UB cases were able to be matched to Epi- Center chief complaint data. The EpiCenter information displayed a diverse range of general complaints, including syncope, dizziness, weakness, and headache. Similarly, non-matched EpiCenter data were compared to UB data to examine diagnoses, and 22 (48%) of the EpiCenter HRI cases were matched to UB diagnostic data. Diagno- sis codes for these cases were for a variety of conditions classified under “general symptoms”; fluid balance disorders; asthma; diabetes; and unspecified hypertension. Conclusions The evaluation found that using chief complaint data to monitor HRI was relatively insensitive in comparison to the UB diagnosis codes, with a sensitivity of just over 16% for any UB HRI diagnosis. Sensitivity and PPV improved during a peak heat event. The evaluation of the non-matched data (both EpiCenter and UB) provided little guidance for modifying the algorithm. While expand- ing the algorithm to include complaints such as syncope, dizziness, or weakness may capture a few more HRI cases, it would also likely result in a greater number of false positive cases (i.e., higher back- ground noise). Though not especially sensitive, EpiCenter data did identify all major episodes of HRI in 2011. The degree of correspondence indi- cates that the EpiCenter HRI algorithm provides a useful real-time gauge of the daily HRI trends. Graph 1. 2011 HRI visits identified by EpiCenter data and UB data subset for the same EpiCenter reporting facilities. Keywords Chief complaint; Heat Related Illness; UB data Acknowledgments This evaluation was supported in part by the Environmental Public Health Tracking Program, Centers for Disease Control and Prevention, Cooper- ative Agreement #5U38EH000196. *Stella Tsai E-mail: stella.tsai@doh.state.nj.us Online Journal of Public Health Informatics * ISSN 1947-2579 * http://ojphi.org * 5(1):e125, 2013