FORECASTING DEMAND USING SURVIVAL MODELING :
AN APPLICATION TO US PRISONS
Joanna R. Baker
Department of Information and Decision Sciences
James Madison University
Harrisonburg, Virginia 22807
USA
Pamela K. Lattimore*
National Institute of Justice
US Department of Justice
Washington DC 20531
USA
ABSTRACT
A systems approach to modeling demand which incorporates survival modeling is applied to the problem of prison population
projection. The approach models the flow of inmates through the prison system and differs from earlier approaches by
exploiting the differences in the incarceration hazard rates of individuals in the general population and those who have
previously been incarcerated and explicitly considering the impact of constrained prison capacity on release policy and future
admissions. The methodology capitalizes on the impact of recursion in the prison population and reduces the amount and
complexity of data required for long-term forecasts.. First-time arrivals to prison are modeled as a Poisson process arising from
the general population; recidivist arrivals are modeled using a failure model, where the reincarceradon hazard rate is a function
of age and race. The model is demonstrated for the state of North Carolina located in the Southeastern region of the United
States. The effect of limited prison capacity on the mean of the time-served distribution is shown. The results demonstrate that
an early release policy will generate an increase in prison admissions through the return to prison of former inmates. Further, the
results show that a systems approach to modeling of prison demand which includes the non-linear effect of recidivism, i.e.,
survival modeling, has a significant impact on the accuracy of forecasts.
INTRODUCTION
Prison crowding is one of the most serious domestic issues currently being faced by the United States. Between 1980
and 1988, the number of inmates in state and federal prisons increased more than 90 percent, from 329,821 to 627,402
(US Department of Justice, Bureau of Justice Statistics, 1989). At the end of 1992,43 state jurisdictions and the Federal
prison system were operating at 100 percent or more of their prison capacities (US Department of Justice, Bureau of
Statistics, 1993, p. 6). Recently, "get tough" sentencing policies—including "three strikes and you're out" provisions
have been enacted in several states. These policies imply that if an offender is found guilt of a violent crime three times,
they will receive a mandatory sentence of life imprisonment. Such policies, although popular with a voters frustrated by
the escalating nature of crime in the US, will only exacerbate the current crowding situation. For example, the state of
California's prison population was 115,534 on June 30, 1993 (US Department of Justice, Bureau of Justice Statistics,
press release, October 3,1993) and the California Department of Corrections estimates that recently enacted "Three
Strikes" legislation will increase incarceration by 81,628 prisoners by the turn of the century (California Department of
Corrections, 1994).
The current crowding conditions in US prisons are due, in part, to a failure to predict the long-term demand for prison
capacity. While adequate one-year-hence forecasts are possible with simple tools such as moving averages or other
linear models, long-term forecasts are difficult to obtain. This is due, in part, to the nature of the prison population.
Specifically, a recent survey showed that recidivists, those returning to prison, comprise about half of all prisoners in
this country (Beck, etaL, 1993, p.l 1). The effect of this subgroup on the flow of inmates through prison and on capacity
is synergistic. That is, recidivists are more likely to receive longer sentences and thus increase demand for prison beds.
The effect of insufficient capacity also has a synergistic effect with recidivists (see Lattimore and Baker, 1992, for a
discussion of this point.).
For example, if capacity is limited, then one of the few options open to prison administrators (assuming a lack of concern
about prison conditions) is to release inmates earlier, hence recidivists are free sooner and "available" to commit a crime
and be reincarcerated-the "revolving door" of the criminal justice system. Thus, the non-linearity in the long-term
input-output process which characterizes the prison system has made traditional modeling techniques and traditional
* Points of view are those of the author and do not necessarily represent the official position of the US Department of
Justice or the National Institute of Justice.
AJIS
linear approaches inadequate for accurate forecasting of demand. As succinctly stated by MacDonald (1989,),
"Reality has had a habit of outstripping forecasts."
Determining the future capacity needs for institutions in which demand is characterized by input and output processes
that are stochastic in nature, driven, wholly or in part, by a population demographics, and subject to policy intervention
is a difficult problem for planners. In addition to prisons, other systems which share some or all of these characteristics
include hospitals and, to a lesser extent, school systems. Traditional approaches to predicting future demand for these
types of systems include time series, econometric models, simulation studies and stochastic techniques (e.g., see Rhodes,
1990). Generally, these approaches require accurate estimates of the input population, disaggregated on the basis of
historical data or a priori assumptions concerning changes in population demographics and trends. For example, a
prison population at time t may be represented as a mapping of the general population at time t - I onto the prison
population at time t. Thus, the demand-generating population is exogenous to the model, making predictions dependent
on accurate characterization of the input process. These models ignore the endogenous effect of the process on the
future intake population, and the effect of policy initiatives on future capacity.
We develop an approach to predicting demand for capacity which explicitly considers the feedback effect of the output
process on the input process. We apply the methodology to prison population projection, extending some earlier work
of Blumstein, Cohen and Miller (1980) and Barnett (1987). Our approach explicitly includes recidivists, incorporating
the techniques of survival modeling into the stochastic modeling approaches of Blumstein, Cohen and Miller (BCM) and
Bamett. The prison population projection model developed herein assumes that the prison intake population is
generated from two distinct populations-the general population and the population of former inmates. Thus, intake is
comprised of those coming to prison for the first time ("first-timers") and those returning to prison (recidivists).
Secondly, our model explicitly considers the impact of limited capacity on service rate, current prison population and
future prison population. Although our model is not limited to prison application, indeed the generalization to demand
for hospital beds, for example, is conceptually straightforward, the application allows us to call upon the theoretical work
of Bamett and BCM and address a problem which is of increasing public concern, namely the problem of prison
crowding. The state of North Carolina prison system will be used to demonstrate the model. The system selected has
particular relevance to the modeling approach as in 1986 the state of North Carolina instituted a capacity ceiling in
response to prison overcrowding and thus provides an opportunity for a model such as ours, which considers the impact
of constrained capacity on the population forecast, to be validated.
The next section briefly examines the problem of prison overcrowding and reviews research in prison population
project Subsequent sections present the proposed projection model assumptions and formulation, and the data and
estimation technique. Demonstration of the model for the state of North Carolina under assumptions of unconstrained
and constrained capacity is presented.
PRISON POPULATION PROJECTION
Methods used to predict prison population include a variety of models, ranging from simple linear projections to
microsimulation models (US General Accounting Office, 1984; see also Rhodes, 1990). One of the first probabilistic
models for predicting inmate (and parolee) population was developed by Stollmack (1973) who derived a model from
deterministic differential equations representative of the correctional system input and output (i.e., admissions and
releases). The system of differential equations was shown to yield a model identical to an infinite-server queuing system
with exponential service times. He developed the model for the case of a general service-time distribution (M/Gl/°°) and
projected estimates for the District of Columbia jails.
The model included a constant intake or commitment rate.y, an exponential service distribution with service rate, U,,
and associated service time S. Prison population at time t, P, was estimated recursively, by the following summation of
retention and intake:
P^P^-^+Y-S-O--") , (1)
where the first term on the right-hand side is the number of prisoners at time t -1 who remain in prison at time t and the
second term is the number of individuals committed to prison in the period (t -I, t] who remain in prison at time t.
BCM (1980) extended the approach of Stollmack by disaggregating the inputs by age (a), sex (s), race (r), and offense
() type. Information on criminal justice system processing rates (arrest, indictment, conviction, and incarceration) was
used to develop demographic-and-offense-specific arrival rates (Jano). The service rate, Uo^ , associated with the age-
race-sex-offense-specific mean time served S,̂ were also estimated. This information was then used to estimate
equation (1) for each arso group. Summing over these yielded the prison population at time t; prison population
forecasts for the State of Pennsylvania for the years 1970 through 2000 were made.
The BCM work was subsequently extended by Barnett (1987), who allowed more flexibility toward the modeling of
policy changes. Arrivals in Barnett's model were from the "chronic offender population," a subset of the general
population assumed to begin crime at age c and retire at age r. By modeling the processes governing retirement from
September 1994
crime and imprisonment, Barnett developed a status-quo model (i.e., assuming no changes in incarceration policy) of the
following form: P, = ) p,(a) • PR(a)da (2)
c
where pXa) is the age-specific density of chronic offenders and PR(a) is the probability that offenders of age a will be
incarcerated at time t. Barnett assumed one homogenous, chronic-offender class characterized by the same starting age,
retirement and incarceration processes, and sentencing distribution. Chronic offenders were assumed to be a known
proportion of the general population and the proportion of offenders of various ages, races, etc., were assumed to remain
constant over time. Barnett used data from the BCM study to arrive at his own projections state of Pennsylvania prison
population. He also made status-quo projections for other states in the US, including Massachusetts, Florida, and Utah,
and projections which assumed that policy changes would result in increased (mean) time served. Finally, Barnett used
his model to examine the impact of changes in the assumed proportion of individuals in the chronic offender population,
and sentencing policy.
The forecasting approaches of BCM and Barnett take advantage of information that can be known with some confidence
(i.e., general population forecasts) to improve prison population projections over simpler methods which, for example,
project next year's prison count on the number of individuals in prison this year. Two shortcomings of their approaches
are 1) the impact of recidivism on the intake population cannot be addressed endogenously, and 2) the impact of
capacity on time served and therefore its effect on the return of recidivists cannot be ascertained. By separately
modeling the return to prison of those previously incarcerated (about 50 percent of all prison admissions) two benefits
are derived. Firstly, the non-constant (with respect to time) hazard rate of repeat offenders can be used to more
accurately model the "career criminals" discussed by Barnett (1987). Secondly, the impact of capacity constraints and
changes in sentencing policy on future admissions can be evaluated.
MODEL
A recidivism-inclusive-population-projection model is developed as an input-output model. Inputs are assumed to be
stochastic in nature, following a well-defined probability distribution. Similarly, outputs are generated as a function of a
well-defined distribution over time served. The "stocks" at any time f, include the general population (N,), the prison
population (?„), and the population of released offenders (R,). "Flows" through the system in the interval (t - 1, t]
include first-timer commitments from the general population (C,C, , )• recidivist commitments from the former inmate
n
population ( Ct _ | t )» and releases ( /?,_,, ). This process is illustrated in Figure 1 .
The (j)^ and <))* are probability density functions that describe the probability that an individual will be incarcerated at
time t for the first time from the general population, and reincarcerated from the released population, respectively. These
distributions represent the joint probability of arrest, indictment, conviction, and incarceration for each group. For the
moment, we assume homogeneity of the two arrival-generating populations, ^V. and Rf . Thus, the components of the
model can be defined as follows:
Nt = the number of individuals in the general population at time f,
R = the number of former inmates free at time f,
P F = the total number of inmates at time f who are incarcerated for the first time;
K = the total number of inmates at time t wh
F R
PK = the total number of inmates at time t who have at least one prior incarceration;
P = the total prison population at time t = PF + P
CF_, - number of first-timer commitments in the period (/-/,/];
C* = number of recidivist commitments in the period (t - l,t] ;
ty^ = the probability of arriving to prison from the general population;
O
7)
•SSI.i:
O
September 1994
Commitments from the released population, R, arrive via a split-lognormal failure model. The lognormal failure
function was chosen because the hazard rate of this distribution, which increases and then decreases, is consistent with
observed recidivism patterns (see, for example, Schmidt and Witte, 1988). As the hazard rate associated with the
lognormal distribution is not constant, the probability of returning to prison at time t is conditional on the time since
release. Specifically, the probability of returning to prison in period (/ - l,t], given release in period (i-1, i], i < t, is:
where
(5)
and 5, \i, and a are maximum likelihood estimates of the split-lognormal survival model. The splitting parameter, 5,
"splits" the released population into two groups, those who will eventually recidivate and those who will not. Inclusion
of this parameter adapts the more familiar failure model to the situation in which not all individuals ultimately fail and
allows explicit consideration of the career criminal or chronic offender paradigm since desistance (or "retirement") is
accommodated by this parameter. Thus, commitments in period (t - l,t] from the released population are:
<)>, ( i ) -R,_u (6)
1=1
As can be seen, the number of commitments from the released population is a function not only of the total number of
released individuals at risk in the period (t -1, t], but also of the time since their releases.
Releases from prison are assumed to follow a negative exponential distribution, where sentence length (service time) is
dependent upon whether the inmate is a first-timer or a recidivist. These distributions have means 1( = (5*. )
for first-timers, and Tf =(5^ ) for recidivists, where SF and 5"* are estimates of the mean time served for
first-timers and recidivists, respectively.
The general model for predicting prison population at time t is thus:
p, = /£ •*-'' + /;* -e* +c,VsF-(i-*-
The number of individuals in prison at time / is the sum of those admitted prior to time t who have not been released by t,
plus those admitted and not released between t - 1 and t. Iteration of this model produces subsequent population
projections.
It should be noted that the prison admission rate is not necessarily constant over time, but instead is a function of the
number of released individuals and the timing of their release. Note that a constant overall admission rate implies
, (0 ' *;-u ' *,« =*"'**, + 5>* , (/) ' /U / N, (8)
i=i 1=1
There is no reason to assume that this equality will hold, particularly in times of large demographic changes in the
populations.
The model presented in equation (7) assumes only two homogeneous populations from which prison admissions are
generated. As propensity to crime varies by age, race and sex, improvements in projections can be achieved by
estimating the model for specific demographically homogeneous classes, as suggested by Stollmack (1973) and
incorporated into the models of BCM (1980) and Barnett (1987). Thus, equation (7) will be estimated for age/race/sex
specific classes and the total P will be found by summing over the classes.
When different age groups are considered, a small complication arises with respect to "aging" the recidivist
commitments. Specifically, the probability of returning to prison is a function of age at release from the last admission to
prison. By equation (6), the number of recidivist commitments of age class A in period (t - 1, t] is:
6 AJIS
(9)
where * (/ , A) is the probability that a member of age class A at the previous admission returns to prison in period (t-
I, t] given release in period (i - /, i] and R. (A) is the number of releases who were in age class A when admitted
prior to release in period (i - /, /]. However, some of the R. . ( A) individuals will have aged into an older class prior
to this new commitment and some members of younger classes will have aged into class A. Thus, aging of the
commitment population is necessary.
Finally, the model presented in equation (7) assumes that Pt < Pf°p for all /. Rather than population, this model
actually predicts demand or what Stollmack (1973) referred to as "population pressure." Imposition of a capacity
constraint, e.g. P^af ', can be operationalized by assuming that the S will be reduced as prisoners are released early to
meet the capacity constraint Under a status-quo assumption (meaning that prisoners incarcerated at time f = 0 will serve
the same sentence as those imprisoned in t = t + n) and given that P and C are known, the number of releases
(from each prison population) required in the interval (t - 1, 1] is:
*,-„ = P,-, • (i - O + c,-,, • (i - T- ' • (i - O)
The number of releases required, however, is
cr, =*,.,+ ̂ - T"
Given that R^ap is known, the following equation identifies T* and the time served distribution required to satisfy the
capacity constraint:
A search routine (bisection method) was used to identify T'.
When P ap > P, status-quo prison population projections are obtained from equation (7), thus providing an upper
bound on expected demand. When P ap < P, and P ap is known, the new service times needed to meet available
capacity can be obtained.
DATA AND ESTIMATION METHODS
Data were obtained for the state of North Carolina. Population estimates by age and race groups were provided by the
North Carolina Office of Budget and Management for 1980 through the year 2000. The North Carolina Department of
Correction provided information on the probability of first-time incarceration by age and race group, average annual
prison population (1979 through 1988), and the number of releasees in 1979. Data to estimate the recidivism models
were obtained from the Inter-University Consortium of Political and Social Research. These data comprise the 1980
North Carolina release cohort data set described in Schmidt and Witte (1988). This data set (henceforth referred to as
the S&W sample) contains recidivism information for 9,549 prisoners released from North Carolina prisons between
July 1, 1979, and June 30, 1980.
Projections will be made for "classes" of individuals. As male prisoners comprise about % percent of the prison
population in North Carolina, forecasts will be made only for males. Specifically, first-timer and recidivists commitments
and prison populations will be estimated by race (white and non-white) and age. Seven age categories will be used:
[15,20), [20, 25), ..., [40,45), and [45+) years. Thus, we have 14 classes for each of our two populations.
The model was initialized using data for the year 1979 (t = 0) and estimates of commitments, releases, and prison
populations were generated for the years 1980 through 2000. The average 1979 male prison population (/^) was
13,489. To properly initialize the model, the population was disaggregated by age, race and previous incarceration
status (first-timer- versus-recidivist) as shown in Table 1 .
The number of males released from prison in 1979 was estimated to be 8,919. This total was disaggregated into age/race
categories using the age/race distribution of the S&W sample. This distribution is also included in Table 1 . As this
release cohort represents only a fraction of the total number of previously incarcerated individuals "on the street" in
North Carolina in 1980, it was necessary to estimate a larger, more accurate /? . The number of male prisoners released
for 1959 through 1978 were developed using data from volumes of the Sourcebook of Criminal Justice Statistics ( US
Department of Justice, 1975, '976, 1977, 1978, 1979, 1980). The number who were still on the street at t = 0 were
estimated as R,./ , times one minus the cdf (at t - 2 1 , 20, .... 1 years) of the estimated split-lognormal failure model (see
September 1994
Table 1: Initial Prison and Releasee Age/Race Distribution (%)
Age
[15, 20)
[20, 25)
[25, 30)
[30, 35)
[35,40)
[40, 45)
[45+)
Total
First-Timers
White
9.38
9.38
3.84
2.32
1.37
0.92
1.50
28.71
Non-White
7.38
8.15
4.80
2.33
1.04
0.8
0.95
25.48
Recidivists
White
2.12
5.20
3.87
3.46
2.63
1.92
3.40
22.60
Non- White
1.77
5.32
5.45
3.96
2.41
1.48
2.81
23.20
Releasees
White
14.04
13.70
7.20
5.35
3.66
2.84
4.5
51.31
Non- White
11.65
13.49
9.39
5.36
3.31
2.05
3.44
48.69
Lattimore and Baker, 1992). This iterative process generated an /? of 114,012.
Recall that commitments in each period (/ - /, /] derive from two populations, the general population, ^V(, and the
releasee population, R . Commitments from N were assumed to be generated by the distribution §F, the probability
distribution of first-time incarceration.
•go
oS
3 J5.
3
O
CD
fi)
3
H
(D
0)
0
0
O
CD
C
(D
cn
3
•o
Q>
O
o
Q)
T3
Q)
O
O
O
3
(/)
r-hs
3'
r+
O
3
(D
o
(D
(Q
(D
O
O
C
O T
10 j
01
w ^
o V1
O ?
*?
5°
September 1994
REFERENCES
Barnett,A. (1987). "Prison Populations: A Projection Model", Operations Research, Vol 35, pp 18-34.
Beck, A., Gilliard, D., Greenfield, L., Harlow, C., Heater, T., Jankowski, L., Snell, T., Stephan, J. & Morton, D. (1993)
Survey of State Prison Inmates, 1991. Washington, DC: US Department of Justice, Bureau of Justice
Statistics.
Blumstein, A., Cohen, J. & Gooding, W. (1983) "The Influence of Capacity on Prison Population: A Critical Review
of Some Recent Evidence", Crime and Delinquency, Vol 29, pp 1-51.
Blumstein, A., Cohen, J. & Miller, H.D. (1980) "Demographically Disaggregated Projections of Prison Populations",
Journal of Criminal Justice, Vol 8, pp 1-26.
California Department of Corrections (1994) "Population and Fiscal Estimates of the "Three Strikes" Initiative",
Sacramento, California, February 28.
Lattimore, P. K. & Baker, J.R. (1992) "The Impact of Recidivism and Capacity on Prison Populations", Journal of
Quantitative Criminology, Vol 8, pp 189-215.
Rhodes, W. (1990) .Models of the Criminal Justice System: A Review of Existing Impact Models, US Department
of Justice, Bureau of Justice Statistics, Washington, DC.
Schmidt P-and Witte, A.D. (1988) Predicting Recidivism Using Survival Models. New York: Springer-Verlag.
Stollmack, S. (1973) "Predicting Inmate Populations from Arrest, Court Disposition, and Recidivism Rates", Journal
of Research in Crime and Delinquency, Vol 10, pp 141-162.
US Department of Justice, US Law Enforcement Assistance Administration. (1975) Sourcebook of Criminal
Justice Statistics--1974. Washington, DC: US Department of Justice.
US Department of Justice, US Law Enforcement Assistance Administration. (1976) Sourcebook of Criminal
Justice Statistics-1975. Washington, DC: US Department of Justice.
US Department of Justice, US Law Enforcement Assistance Administration. (1977) Sourcebook of Criminal
Justice Statistics-1976. Washington, DC: US Department of Justice.
US Department of Justice, US Law Enforcement Assistance Administration. (1978) Sourcebook of Criminal
Justice Statistics-1977. Washington, DC: US Department of Justice.
US Department of Justice, US Law Enforcement Assistance Administration. (1979) Sourcebook of Criminal
Justice Statistics-1978. Washington, DC: US Department of Justice.
US Department of Justice, US Law Enforcement Assistance Administration. (1980) Sourcebook of Criminal
Justice Statistics-1979. Washington, DC: US Department of Justice
US Department of Justice, Bureau of Justice Statistics. (1981) Sourcebook of Criminal Justice Statistics--
1980. Washington, DC: US Department of Justice.
US Department of Justice, Bureau of Justice Statistics. (1982) Sourcebook of Criminal Justice Statistics—
1981, Washington, DC: US Department of Justice,
US Department of Justice, Bureau of Justice Statistics. (1993) "Prisoners in 1992", Washington, DC, May.
US General Accounting Office. (1984) Federal, District of Columbia, and States Future Prison and Correctional
Institute Populations and Capacities: Report to the Honorable Arlen Specter United States Senate.
GAO/GGD-84-56, February, Washington, DC: US General Accounting Office.
16 AJIS