FORECASTING DEMAND USING SURVIVAL MODELING : AN APPLICATION TO US PRISONS Joanna R. Baker Department of Information and Decision Sciences James Madison University Harrisonburg, Virginia 22807 USA Pamela K. Lattimore* National Institute of Justice US Department of Justice Washington DC 20531 USA ABSTRACT A systems approach to modeling demand which incorporates survival modeling is applied to the problem of prison population projection. The approach models the flow of inmates through the prison system and differs from earlier approaches by exploiting the differences in the incarceration hazard rates of individuals in the general population and those who have previously been incarcerated and explicitly considering the impact of constrained prison capacity on release policy and future admissions. The methodology capitalizes on the impact of recursion in the prison population and reduces the amount and complexity of data required for long-term forecasts.. First-time arrivals to prison are modeled as a Poisson process arising from the general population; recidivist arrivals are modeled using a failure model, where the reincarceradon hazard rate is a function of age and race. The model is demonstrated for the state of North Carolina located in the Southeastern region of the United States. The effect of limited prison capacity on the mean of the time-served distribution is shown. The results demonstrate that an early release policy will generate an increase in prison admissions through the return to prison of former inmates. Further, the results show that a systems approach to modeling of prison demand which includes the non-linear effect of recidivism, i.e., survival modeling, has a significant impact on the accuracy of forecasts. INTRODUCTION Prison crowding is one of the most serious domestic issues currently being faced by the United States. Between 1980 and 1988, the number of inmates in state and federal prisons increased more than 90 percent, from 329,821 to 627,402 (US Department of Justice, Bureau of Justice Statistics, 1989). At the end of 1992,43 state jurisdictions and the Federal prison system were operating at 100 percent or more of their prison capacities (US Department of Justice, Bureau of Statistics, 1993, p. 6). Recently, "get tough" sentencing policies—including "three strikes and you're out" provisions have been enacted in several states. These policies imply that if an offender is found guilt of a violent crime three times, they will receive a mandatory sentence of life imprisonment. Such policies, although popular with a voters frustrated by the escalating nature of crime in the US, will only exacerbate the current crowding situation. For example, the state of California's prison population was 115,534 on June 30, 1993 (US Department of Justice, Bureau of Justice Statistics, press release, October 3,1993) and the California Department of Corrections estimates that recently enacted "Three Strikes" legislation will increase incarceration by 81,628 prisoners by the turn of the century (California Department of Corrections, 1994). The current crowding conditions in US prisons are due, in part, to a failure to predict the long-term demand for prison capacity. While adequate one-year-hence forecasts are possible with simple tools such as moving averages or other linear models, long-term forecasts are difficult to obtain. This is due, in part, to the nature of the prison population. Specifically, a recent survey showed that recidivists, those returning to prison, comprise about half of all prisoners in this country (Beck, etaL, 1993, p.l 1). The effect of this subgroup on the flow of inmates through prison and on capacity is synergistic. That is, recidivists are more likely to receive longer sentences and thus increase demand for prison beds. The effect of insufficient capacity also has a synergistic effect with recidivists (see Lattimore and Baker, 1992, for a discussion of this point.). For example, if capacity is limited, then one of the few options open to prison administrators (assuming a lack of concern about prison conditions) is to release inmates earlier, hence recidivists are free sooner and "available" to commit a crime and be reincarcerated-the "revolving door" of the criminal justice system. Thus, the non-linearity in the long-term input-output process which characterizes the prison system has made traditional modeling techniques and traditional * Points of view are those of the author and do not necessarily represent the official position of the US Department of Justice or the National Institute of Justice. AJIS linear approaches inadequate for accurate forecasting of demand. As succinctly stated by MacDonald (1989,), "Reality has had a habit of outstripping forecasts." Determining the future capacity needs for institutions in which demand is characterized by input and output processes that are stochastic in nature, driven, wholly or in part, by a population demographics, and subject to policy intervention is a difficult problem for planners. In addition to prisons, other systems which share some or all of these characteristics include hospitals and, to a lesser extent, school systems. Traditional approaches to predicting future demand for these types of systems include time series, econometric models, simulation studies and stochastic techniques (e.g., see Rhodes, 1990). Generally, these approaches require accurate estimates of the input population, disaggregated on the basis of historical data or a priori assumptions concerning changes in population demographics and trends. For example, a prison population at time t may be represented as a mapping of the general population at time t - I onto the prison population at time t. Thus, the demand-generating population is exogenous to the model, making predictions dependent on accurate characterization of the input process. These models ignore the endogenous effect of the process on the future intake population, and the effect of policy initiatives on future capacity. We develop an approach to predicting demand for capacity which explicitly considers the feedback effect of the output process on the input process. We apply the methodology to prison population projection, extending some earlier work of Blumstein, Cohen and Miller (1980) and Barnett (1987). Our approach explicitly includes recidivists, incorporating the techniques of survival modeling into the stochastic modeling approaches of Blumstein, Cohen and Miller (BCM) and Bamett. The prison population projection model developed herein assumes that the prison intake population is generated from two distinct populations-the general population and the population of former inmates. Thus, intake is comprised of those coming to prison for the first time ("first-timers") and those returning to prison (recidivists). Secondly, our model explicitly considers the impact of limited capacity on service rate, current prison population and future prison population. Although our model is not limited to prison application, indeed the generalization to demand for hospital beds, for example, is conceptually straightforward, the application allows us to call upon the theoretical work of Bamett and BCM and address a problem which is of increasing public concern, namely the problem of prison crowding. The state of North Carolina prison system will be used to demonstrate the model. The system selected has particular relevance to the modeling approach as in 1986 the state of North Carolina instituted a capacity ceiling in response to prison overcrowding and thus provides an opportunity for a model such as ours, which considers the impact of constrained capacity on the population forecast, to be validated. The next section briefly examines the problem of prison overcrowding and reviews research in prison population project Subsequent sections present the proposed projection model assumptions and formulation, and the data and estimation technique. Demonstration of the model for the state of North Carolina under assumptions of unconstrained and constrained capacity is presented. PRISON POPULATION PROJECTION Methods used to predict prison population include a variety of models, ranging from simple linear projections to microsimulation models (US General Accounting Office, 1984; see also Rhodes, 1990). One of the first probabilistic models for predicting inmate (and parolee) population was developed by Stollmack (1973) who derived a model from deterministic differential equations representative of the correctional system input and output (i.e., admissions and releases). The system of differential equations was shown to yield a model identical to an infinite-server queuing system with exponential service times. He developed the model for the case of a general service-time distribution (M/Gl/°°) and projected estimates for the District of Columbia jails. The model included a constant intake or commitment rate.y, an exponential service distribution with service rate, U,, and associated service time S. Prison population at time t, P, was estimated recursively, by the following summation of retention and intake: P^P^-^+Y-S-O- O 7) •SSI.i: O September 1994 Commitments from the released population, R, arrive via a split-lognormal failure model. The lognormal failure function was chosen because the hazard rate of this distribution, which increases and then decreases, is consistent with observed recidivism patterns (see, for example, Schmidt and Witte, 1988). As the hazard rate associated with the lognormal distribution is not constant, the probability of returning to prison at time t is conditional on the time since release. Specifically, the probability of returning to prison in period (/ - l,t], given release in period (i-1, i], i < t, is: where (5) and 5, \i, and a are maximum likelihood estimates of the split-lognormal survival model. The splitting parameter, 5, "splits" the released population into two groups, those who will eventually recidivate and those who will not. Inclusion of this parameter adapts the more familiar failure model to the situation in which not all individuals ultimately fail and allows explicit consideration of the career criminal or chronic offender paradigm since desistance (or "retirement") is accommodated by this parameter. Thus, commitments in period (t - l,t] from the released population are: <)>, ( i ) -R,_u (6) 1=1 As can be seen, the number of commitments from the released population is a function not only of the total number of released individuals at risk in the period (t -1, t], but also of the time since their releases. Releases from prison are assumed to follow a negative exponential distribution, where sentence length (service time) is dependent upon whether the inmate is a first-timer or a recidivist. These distributions have means 1( = (5*. ) for first-timers, and Tf =(5^ ) for recidivists, where SF and 5"* are estimates of the mean time served for first-timers and recidivists, respectively. The general model for predicting prison population at time t is thus: p, = /£ •*-'' + /;* -e* +c,VsF-(i-*- The number of individuals in prison at time / is the sum of those admitted prior to time t who have not been released by t, plus those admitted and not released between t - 1 and t. Iteration of this model produces subsequent population projections. It should be noted that the prison admission rate is not necessarily constant over time, but instead is a function of the number of released individuals and the timing of their release. Note that a constant overall admission rate implies , (0 ' *;-u ' *,« =*"'**, + 5>* , (/) ' /U / N, (8) i=i 1=1 There is no reason to assume that this equality will hold, particularly in times of large demographic changes in the populations. The model presented in equation (7) assumes only two homogeneous populations from which prison admissions are generated. As propensity to crime varies by age, race and sex, improvements in projections can be achieved by estimating the model for specific demographically homogeneous classes, as suggested by Stollmack (1973) and incorporated into the models of BCM (1980) and Barnett (1987). Thus, equation (7) will be estimated for age/race/sex specific classes and the total P will be found by summing over the classes. When different age groups are considered, a small complication arises with respect to "aging" the recidivist commitments. Specifically, the probability of returning to prison is a function of age at release from the last admission to prison. By equation (6), the number of recidivist commitments of age class A in period (t - 1, t] is: 6 AJIS (9) where * (/ , A) is the probability that a member of age class A at the previous admission returns to prison in period (t- I, t] given release in period (i - /, i] and R. (A) is the number of releases who were in age class A when admitted prior to release in period (i - /, /]. However, some of the R. . ( A) individuals will have aged into an older class prior to this new commitment and some members of younger classes will have aged into class A. Thus, aging of the commitment population is necessary. Finally, the model presented in equation (7) assumes that Pt < Pf°p for all /. Rather than population, this model actually predicts demand or what Stollmack (1973) referred to as "population pressure." Imposition of a capacity constraint, e.g. P^af ', can be operationalized by assuming that the S will be reduced as prisoners are released early to meet the capacity constraint Under a status-quo assumption (meaning that prisoners incarcerated at time f = 0 will serve the same sentence as those imprisoned in t = t + n) and given that P and C are known, the number of releases (from each prison population) required in the interval (t - 1, 1] is: *,-„ = P,-, • (i - O + c,-,, • (i - T- ' • (i - O) The number of releases required, however, is cr, =*,.,+ ̂ - T" Given that R^ap is known, the following equation identifies T* and the time served distribution required to satisfy the capacity constraint: A search routine (bisection method) was used to identify T'. When P ap > P, status-quo prison population projections are obtained from equation (7), thus providing an upper bound on expected demand. When P ap < P, and P ap is known, the new service times needed to meet available capacity can be obtained. DATA AND ESTIMATION METHODS Data were obtained for the state of North Carolina. Population estimates by age and race groups were provided by the North Carolina Office of Budget and Management for 1980 through the year 2000. The North Carolina Department of Correction provided information on the probability of first-time incarceration by age and race group, average annual prison population (1979 through 1988), and the number of releasees in 1979. Data to estimate the recidivism models were obtained from the Inter-University Consortium of Political and Social Research. These data comprise the 1980 North Carolina release cohort data set described in Schmidt and Witte (1988). This data set (henceforth referred to as the S&W sample) contains recidivism information for 9,549 prisoners released from North Carolina prisons between July 1, 1979, and June 30, 1980. Projections will be made for "classes" of individuals. As male prisoners comprise about % percent of the prison population in North Carolina, forecasts will be made only for males. Specifically, first-timer and recidivists commitments and prison populations will be estimated by race (white and non-white) and age. Seven age categories will be used: [15,20), [20, 25), ..., [40,45), and [45+) years. Thus, we have 14 classes for each of our two populations. The model was initialized using data for the year 1979 (t = 0) and estimates of commitments, releases, and prison populations were generated for the years 1980 through 2000. The average 1979 male prison population (/^) was 13,489. To properly initialize the model, the population was disaggregated by age, race and previous incarceration status (first-timer- versus-recidivist) as shown in Table 1 . The number of males released from prison in 1979 was estimated to be 8,919. This total was disaggregated into age/race categories using the age/race distribution of the S&W sample. This distribution is also included in Table 1 . As this release cohort represents only a fraction of the total number of previously incarcerated individuals "on the street" in North Carolina in 1980, it was necessary to estimate a larger, more accurate /? . The number of male prisoners released for 1959 through 1978 were developed using data from volumes of the Sourcebook of Criminal Justice Statistics ( US Department of Justice, 1975, '976, 1977, 1978, 1979, 1980). The number who were still on the street at t = 0 were estimated as R,./ , times one minus the cdf (at t - 2 1 , 20, .... 1 years) of the estimated split-lognormal failure model (see September 1994 Table 1: Initial Prison and Releasee Age/Race Distribution (%) Age [15, 20) [20, 25) [25, 30) [30, 35) [35,40) [40, 45) [45+) Total First-Timers White 9.38 9.38 3.84 2.32 1.37 0.92 1.50 28.71 Non-White 7.38 8.15 4.80 2.33 1.04 0.8 0.95 25.48 Recidivists White 2.12 5.20 3.87 3.46 2.63 1.92 3.40 22.60 Non- White 1.77 5.32 5.45 3.96 2.41 1.48 2.81 23.20 Releasees White 14.04 13.70 7.20 5.35 3.66 2.84 4.5 51.31 Non- White 11.65 13.49 9.39 5.36 3.31 2.05 3.44 48.69 Lattimore and Baker, 1992). This iterative process generated an /? of 114,012. Recall that commitments in each period (/ - /, /] derive from two populations, the general population, ^V(, and the releasee population, R . Commitments from N were assumed to be generated by the distribution §F, the probability distribution of first-time incarceration. •go oS 3 J5. 3 O CD fi) 3 H (D 0) 0 0 O CD C (D cn 3 •o Q> O o Q) T3 Q) O O O 3 (/) r-hs 3' r+ O 3 (D o (D (Q (D O O C O T 10 j 01 w ^ o V1 O ? *? 5° September 1994 REFERENCES Barnett,A. (1987). "Prison Populations: A Projection Model", Operations Research, Vol 35, pp 18-34. Beck, A., Gilliard, D., Greenfield, L., Harlow, C., Heater, T., Jankowski, L., Snell, T., Stephan, J. & Morton, D. (1993) Survey of State Prison Inmates, 1991. Washington, DC: US Department of Justice, Bureau of Justice Statistics. Blumstein, A., Cohen, J. & Gooding, W. (1983) "The Influence of Capacity on Prison Population: A Critical Review of Some Recent Evidence", Crime and Delinquency, Vol 29, pp 1-51. Blumstein, A., Cohen, J. & Miller, H.D. (1980) "Demographically Disaggregated Projections of Prison Populations", Journal of Criminal Justice, Vol 8, pp 1-26. California Department of Corrections (1994) "Population and Fiscal Estimates of the "Three Strikes" Initiative", Sacramento, California, February 28. Lattimore, P. K. & Baker, J.R. (1992) "The Impact of Recidivism and Capacity on Prison Populations", Journal of Quantitative Criminology, Vol 8, pp 189-215. Rhodes, W. (1990) .Models of the Criminal Justice System: A Review of Existing Impact Models, US Department of Justice, Bureau of Justice Statistics, Washington, DC. Schmidt P-and Witte, A.D. (1988) Predicting Recidivism Using Survival Models. New York: Springer-Verlag. Stollmack, S. (1973) "Predicting Inmate Populations from Arrest, Court Disposition, and Recidivism Rates", Journal of Research in Crime and Delinquency, Vol 10, pp 141-162. US Department of Justice, US Law Enforcement Assistance Administration. (1975) Sourcebook of Criminal Justice Statistics--1974. Washington, DC: US Department of Justice. US Department of Justice, US Law Enforcement Assistance Administration. (1976) Sourcebook of Criminal Justice Statistics-1975. Washington, DC: US Department of Justice. US Department of Justice, US Law Enforcement Assistance Administration. (1977) Sourcebook of Criminal Justice Statistics-1976. Washington, DC: US Department of Justice. US Department of Justice, US Law Enforcement Assistance Administration. (1978) Sourcebook of Criminal Justice Statistics-1977. Washington, DC: US Department of Justice. US Department of Justice, US Law Enforcement Assistance Administration. (1979) Sourcebook of Criminal Justice Statistics-1978. Washington, DC: US Department of Justice. US Department of Justice, US Law Enforcement Assistance Administration. (1980) Sourcebook of Criminal Justice Statistics-1979. Washington, DC: US Department of Justice US Department of Justice, Bureau of Justice Statistics. (1981) Sourcebook of Criminal Justice Statistics-- 1980. Washington, DC: US Department of Justice. US Department of Justice, Bureau of Justice Statistics. (1982) Sourcebook of Criminal Justice Statistics— 1981, Washington, DC: US Department of Justice, US Department of Justice, Bureau of Justice Statistics. (1993) "Prisoners in 1992", Washington, DC, May. US General Accounting Office. (1984) Federal, District of Columbia, and States Future Prison and Correctional Institute Populations and Capacities: Report to the Honorable Arlen Specter United States Senate. GAO/GGD-84-56, February, Washington, DC: US General Accounting Office. 16 AJIS